2026-02-17T05:38:45.531 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T05:38:45.544 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T05:38:45.623 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51055 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51055' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 2 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd pool default size: 2 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon max pg per osd: 2 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max pg per osd hard ratio: 1 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random create_rbd_pool: false flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(TOO_FEW_PGS\) - \(PENDING_CREATING_PGS\) - \(POOL_APP_NOT_ENABLED\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIYWhwkoDJ+3yHrTwlmbVrxYozWPqRMGJFgFg9doMNJWggPySf2onC+U/T/AFkRbp274XwFytXhQujhc+iz6xlY= tasks: - install: null - ceph: null - osd_max_pg_per_osd: pg_num: 2 test_create_from_mon: true teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T05:38:45.623 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T05:38:45.623 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T05:38:45.623 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T05:38:45.625 INFO:teuthology.task.internal:Checking packages... 2026-02-17T05:38:45.625 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T05:38:45.625 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T05:38:45.625 INFO:teuthology.packaging:ref: None 2026-02-17T05:38:45.625 INFO:teuthology.packaging:tag: None 2026-02-17T05:38:45.625 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T05:38:45.625 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T05:38:45.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T05:38:45.743 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705.g04cf6dd4 2026-02-17T05:38:45.744 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T05:38:45.755 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T05:38:45.755 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T05:38:45.768 INFO:teuthology.task.internal:Saving configuration 2026-02-17T05:38:45.774 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T05:38:45.785 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T05:38:45.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial160.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51055', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 05:35:17.094711', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIYWhwkoDJ+3yHrTwlmbVrxYozWPqRMGJFgFg9doMNJWggPySf2onC+U/T/AFkRbp274XwFytXhQujhc+iz6xlY='} 2026-02-17T05:38:45.847 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T05:38:45.859 INFO:teuthology.task.internal:roles: ubuntu@trial160.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1'] 2026-02-17T05:38:45.859 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T05:38:45.935 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7e43f41dd9e0>, signals=[15]) 2026-02-17T05:38:45.935 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T05:38:45.945 INFO:teuthology.task.internal:Opening connections... 2026-02-17T05:38:45.945 DEBUG:teuthology.task.internal:connecting to ubuntu@trial160.front.sepia.ceph.com 2026-02-17T05:38:45.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:38:46.008 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T05:38:46.019 DEBUG:teuthology.orchestra.run.trial160:> uname -m 2026-02-17T05:38:46.082 INFO:teuthology.orchestra.run.trial160.stdout:x86_64 2026-02-17T05:38:46.082 DEBUG:teuthology.orchestra.run.trial160:> cat /etc/os-release 2026-02-17T05:38:46.137 INFO:teuthology.orchestra.run.trial160.stdout:NAME="CentOS Stream" 2026-02-17T05:38:46.137 INFO:teuthology.orchestra.run.trial160.stdout:VERSION="9" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:ID="centos" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:ID_LIKE="rhel fedora" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:VERSION_ID="9" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:PLATFORM_ID="platform:el9" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:ANSI_COLOR="0;31" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:LOGO="fedora-logo-icon" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:HOME_URL="https://centos.org/" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T05:38:46.138 INFO:teuthology.orchestra.run.trial160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T05:38:46.138 INFO:teuthology.lock.ops:Updating trial160.front.sepia.ceph.com on lock server 2026-02-17T05:38:46.205 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T05:38:46.219 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T05:38:46.230 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T05:38:46.230 DEBUG:teuthology.orchestra.run.trial160:> test '!' -e /home/ubuntu/cephtest 2026-02-17T05:38:46.245 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T05:38:46.256 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T05:38:46.257 DEBUG:teuthology.orchestra.run.trial160:> test -z $(ls -A /var/lib/ceph) 2026-02-17T05:38:46.301 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T05:38:46.402 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T05:38:46.423 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T05:38:46.423 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T05:38:46.423 DEBUG:teuthology.orchestra.run.trial160:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T05:38:46.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:38:46.438 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-17T05:38:46.494 INFO:teuthology.orchestra.run.trial160.stdout:5.14.0-645.el9.x86_64 2026-02-17T05:38:46.494 INFO:teuthology.task.kernel:Running kernel on trial160: 5.14.0-645.el9.x86_64 2026-02-17T05:38:46.494 DEBUG:teuthology.orchestra.run.trial160:> sudo yum install -y kernel 2026-02-17T05:38:52.667 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.9 MB 00:05 2026-02-17T05:38:57.156 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 27 MB 00:03 2026-02-17T05:39:01.087 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-17T05:39:02.013 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 20 kB 00:00 2026-02-17T05:39:02.282 INFO:teuthology.orchestra.run.trial160.stdout:Extra Packages for Enterprise Linux 101 MB/s | 20 MB 00:00 2026-02-17T05:39:05.475 INFO:teuthology.orchestra.run.trial160.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T05:39:06.492 INFO:teuthology.orchestra.run.trial160.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T05:39:06.513 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:39:06.513 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:39:06.513 INFO:teuthology.orchestra.run.trial160.stdout: Package Architecture Version Repository Size 2026-02-17T05:39:06.513 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:Installing dependencies: 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:Install 4 Packages 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 88 M 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 135 M 2026-02-17T05:39:06.514 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:39:06.634 INFO:teuthology.orchestra.run.trial160.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2026-02-17T05:39:06.759 INFO:teuthology.orchestra.run.trial160.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 92 MB/s | 17 MB 00:00 2026-02-17T05:39:06.869 INFO:teuthology.orchestra.run.trial160.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 132 MB/s | 31 MB 00:00 2026-02-17T05:39:06.941 INFO:teuthology.orchestra.run.trial160.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 108 MB/s | 40 MB 00:00 2026-02-17T05:39:06.943 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:39:06.943 INFO:teuthology.orchestra.run.trial160.stdout:Total 206 MB/s | 88 MB 00:00 2026-02-17T05:39:07.133 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:39:07.349 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:39:07.350 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:39:07.696 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:39:07.696 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:39:08.787 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:39:09.073 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T05:39:09.092 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:39:10.876 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:39:10.906 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:39:13.930 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:39:13.936 INFO:teuthology.orchestra.run.trial160.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:39:17.035 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:39:47.451 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:39:47.473 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:39:47.645 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:39:47.645 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T05:39:47.645 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T05:39:47.645 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:39:47.697 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:39:47.754 DEBUG:teuthology.orchestra.run.trial160:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T05:39:47.819 INFO:teuthology.orchestra.run.trial160.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T05:39:47.819 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T05:39:47.819 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T05:39:47.819 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T05:39:47.819 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T05:39:47.819 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T05:39:47.820 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial160.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T05:39:47.820 DEBUG:teuthology.orchestra.run.trial160:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T05:39:47.884 INFO:teuthology.orchestra.run.trial160.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T05:39:47.885 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T05:39:47.885 DEBUG:teuthology.orchestra.run.trial160:> sudo rpm -qi grub2-tools 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Name : grub2-tools 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Epoch : 1 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Version : 2.06 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Release : 118.el9 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Architecture: x86_64 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Group : Unspecified 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Size : 8393909 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:License : GPLv3+ 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T05:39:47.955 INFO:teuthology.orchestra.run.trial160.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:Packager : builder@centos.org 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:Vendor : CentOS 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:Summary : Support tools for GRUB. 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:Description : 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:hardware devices. 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:39:47.956 INFO:teuthology.orchestra.run.trial160.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T05:39:47.957 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T05:39:47.957 INFO:teuthology.task.kernel:Updating grub on trial160 to boot 5.14.0-681.el9.x86_64 2026-02-17T05:39:47.957 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T05:39:48.020 INFO:teuthology.orchestra.run.trial160.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T05:39:48.021 DEBUG:teuthology.orchestra.run.trial160:> sudo command -v grubby && echo yes || echo no 2026-02-17T05:39:48.083 INFO:teuthology.orchestra.run.trial160.stdout:/sbin/grubby 2026-02-17T05:39:48.084 INFO:teuthology.orchestra.run.trial160.stdout:yes 2026-02-17T05:39:48.084 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T05:39:48.147 INFO:teuthology.orchestra.run.trial160.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T05:39:48.148 DEBUG:teuthology.orchestra.run.trial160:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T05:39:48.222 DEBUG:teuthology.orchestra.run.trial160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T05:39:48.424 INFO:teuthology.orchestra.run.trial160.stderr:Generating grub configuration file ... 2026-02-17T05:39:48.485 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T05:39:48.491 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T05:39:48.739 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T05:39:48.750 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T05:39:48.777 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T05:39:48.783 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T05:39:48.806 INFO:teuthology.orchestra.run.trial160.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T05:39:48.812 INFO:teuthology.orchestra.run.trial160.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T05:39:48.893 INFO:teuthology.orchestra.run.trial160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T05:39:48.901 INFO:teuthology.orchestra.run.trial160.stderr:done 2026-02-17T05:39:48.903 DEBUG:teuthology.orchestra.run.trial160:> test -d /sys/firmware/efi 2026-02-17T05:39:48.919 DEBUG:teuthology.orchestra.run.trial160:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T05:39:48.983 INFO:teuthology.orchestra.run.trial160.stdout:/boot/efi/EFI/BOOT 2026-02-17T05:39:48.984 INFO:teuthology.orchestra.run.trial160.stdout:/boot/efi/EFI/centos 2026-02-17T05:39:48.985 DEBUG:teuthology.orchestra.run.trial160:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T05:39:49.049 INFO:teuthology.orchestra.run.trial160.stdout:no 2026-02-17T05:39:49.049 DEBUG:teuthology.orchestra.run.trial160:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T05:39:49.112 INFO:teuthology.orchestra.run.trial160.stdout:yes 2026-02-17T05:39:49.112 DEBUG:teuthology.orchestra.run.trial160:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T05:39:49.177 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial160 2026-02-17T05:39:49.177 DEBUG:teuthology.orchestra.run.trial160:> sudo bash -c ' 2026-02-17T05:39:49.177 DEBUG:teuthology.orchestra.run.trial160:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T05:39:49.177 DEBUG:teuthology.orchestra.run.trial160:> ' 2026-02-17T05:40:19.220 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T05:40:19.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-17T05:40:19.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:40:33.536 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.160 2026-02-17T05:40:42.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-17T05:40:42.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:41:18.463 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-17T05:41:18.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-17T05:41:18.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T05:41:18.628 DEBUG:teuthology.orchestra.run.trial160:> uname -r 2026-02-17T05:41:18.684 INFO:teuthology.orchestra.run.trial160.stdout:5.14.0-681.el9.x86_64 2026-02-17T05:41:18.684 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T05:41:18.684 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T05:41:18.684 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T05:41:19.686 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T05:41:19.686 DEBUG:teuthology.orchestra.run.trial160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T05:41:19.715 INFO:teuthology.orchestra.run.trial160.stdout:ttyS1 2026-02-17T05:41:19.736 DEBUG:teuthology.parallel:result is None 2026-02-17T05:41:19.736 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T05:41:19.748 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T05:41:19.748 DEBUG:teuthology.orchestra.run.trial160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T05:41:19.793 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T05:41:19.807 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T05:41:19.824 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T05:41:19.824 DEBUG:teuthology.orchestra.run.trial160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T05:41:19.856 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T05:41:19.868 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T05:41:19.868 DEBUG:teuthology.orchestra.run.trial160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T05:41:19.914 INFO:teuthology.orchestra.run.trial160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:41:19.923 INFO:teuthology.orchestra.run.trial160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T05:41:19.925 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T05:41:19.937 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T05:41:19.937 DEBUG:teuthology.orchestra.run.trial160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T05:41:19.989 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T05:41:20.005 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T05:41:20.005 DEBUG:teuthology.orchestra.run.trial160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T05:41:20.045 DEBUG:teuthology.orchestra.run.trial160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:41:20.181 DEBUG:teuthology.orchestra.run.trial160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:41:20.206 DEBUG:teuthology.orchestra.run.trial160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:41:20.350 DEBUG:teuthology.orchestra.run.trial160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:41:20.374 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:41:20.374 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T05:41:20.439 DEBUG:teuthology.orchestra.run.trial160:> sudo service rsyslog restart 2026-02-17T05:41:20.509 INFO:teuthology.orchestra.run.trial160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T05:41:20.881 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T05:41:20.894 INFO:teuthology.task.internal:Starting timer... 2026-02-17T05:41:20.894 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T05:41:20.916 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T05:41:20.934 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T05:41:20.935 DEBUG:teuthology.orchestra.run.trial160:> sudo service auditd rotate 2026-02-17T05:41:20.962 INFO:teuthology.orchestra.run.trial160.stdout:Rotating logs: 2026-02-17T05:41:20.964 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T05:41:20.964 DEBUG:teuthology.orchestra.run.trial160:> /usr/sbin/getenforce 2026-02-17T05:41:21.020 INFO:teuthology.orchestra.run.trial160.stdout:Permissive 2026-02-17T05:41:21.020 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial160.front.sepia.ceph.com': 'permissive'} 2026-02-17T05:41:21.021 DEBUG:teuthology.orchestra.run.trial160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T05:41:21.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:41:21.085 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T05:41:21.085 DEBUG:teuthology.orchestra.run.trial160:> sudo /usr/sbin/setenforce permissive 2026-02-17T05:41:21.151 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T05:41:21.173 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T05:41:21.185 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T05:41:21.186 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T05:44:18.753 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial160.front.sepia.ceph.com')] 2026-02-17T05:44:18.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-17T05:44:18.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T05:44:18.829 DEBUG:teuthology.orchestra.run.trial160:> true 2026-02-17T05:44:18.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial160.front.sepia.ceph.com' 2026-02-17T05:44:18.906 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T05:44:18.914 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T05:44:18.914 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T05:44:18.915 DEBUG:teuthology.orchestra.run.trial160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:44:18.971 INFO:teuthology.orchestra.run.trial160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T05:44:18.982 INFO:teuthology.orchestra.run.trial160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T05:44:19.003 INFO:teuthology.orchestra.run.trial160.stderr:sudo: ntpd: command not found 2026-02-17T05:44:19.012 INFO:teuthology.orchestra.run.trial160.stdout:506 Cannot talk to daemon 2026-02-17T05:44:19.023 INFO:teuthology.orchestra.run.trial160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T05:44:19.035 INFO:teuthology.orchestra.run.trial160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T05:44:19.084 INFO:teuthology.orchestra.run.trial160.stderr:bash: line 1: ntpq: command not found 2026-02-17T05:44:19.099 INFO:teuthology.orchestra.run.trial160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T05:44:19.099 INFO:teuthology.orchestra.run.trial160.stdout:=============================================================================== 2026-02-17T05:44:19.099 INFO:teuthology.orchestra.run.trial160.stdout:^? static.36.62.78.5.client> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:44:19.099 INFO:teuthology.orchestra.run.trial160.stdout:^? gwallaceNTPpool.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:44:19.099 INFO:teuthology.orchestra.run.trial160.stdout:^? y.ns.gin.ntt.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:44:19.100 INFO:teuthology.orchestra.run.trial160.stdout:^? chi3.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T05:44:19.100 INFO:teuthology.run_tasks:Running task install... 2026-02-17T05:44:19.112 DEBUG:teuthology.task.install:project ceph 2026-02-17T05:44:19.112 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T05:44:19.112 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T05:44:19.112 INFO:teuthology.task.install:Using flavor: default 2026-02-17T05:44:19.115 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T05:44:19.115 INFO:teuthology.task.install:extra packages: [] 2026-02-17T05:44:19.115 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T05:44:19.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T05:44:19.264 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T05:44:19.264 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T05:44:19.406 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T05:44:19.406 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:44:19.406 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T05:44:19.431 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T05:44:19.431 DEBUG:teuthology.orchestra.run.trial160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T05:44:19.496 DEBUG:teuthology.orchestra.run.trial160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T05:44:19.569 DEBUG:teuthology.orchestra.run.trial160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T05:44:19.633 INFO:teuthology.orchestra.run.trial160.stdout:check_obsoletes = 1 2026-02-17T05:44:19.634 DEBUG:teuthology.orchestra.run.trial160:> sudo yum clean all 2026-02-17T05:44:19.784 INFO:teuthology.orchestra.run.trial160.stdout:41 files removed 2026-02-17T05:44:19.799 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-radosgw 2026-02-17T05:44:20.072 INFO:teuthology.orchestra.run.trial160.stdout:ceph packages for x86_64 660 kB/s | 86 kB 00:00 2026-02-17T05:44:20.202 INFO:teuthology.orchestra.run.trial160.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T05:44:20.327 INFO:teuthology.orchestra.run.trial160.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T05:44:21.151 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T05:44:24.546 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-17T05:44:28.482 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-17T05:44:29.416 INFO:teuthology.orchestra.run.trial160.stdout:CentOS Stream 9 - Extras packages 95 kB/s | 20 kB 00:00 2026-02-17T05:44:35.623 INFO:teuthology.orchestra.run.trial160.stdout:Extra Packages for Enterprise Linux 3.3 MB/s | 20 MB 00:06 2026-02-17T05:44:38.804 INFO:teuthology.orchestra.run.trial160.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-17T05:44:40.018 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:44:40.020 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:44:40.020 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repository Size 2026-02-17T05:44:40.020 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:44:40.020 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:44:40.020 INFO:teuthology.orchestra.run.trial160.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout:Upgrading: 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout:Installing dependencies: 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T05:44:40.021 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T05:44:40.022 INFO:teuthology.orchestra.run.trial160.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout:Installing weak dependencies: 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T05:44:40.023 INFO:teuthology.orchestra.run.trial160.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T05:44:40.024 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:40.024 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:44:40.024 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:44:40.024 INFO:teuthology.orchestra.run.trial160.stdout:Install 33 Packages 2026-02-17T05:44:40.024 INFO:teuthology.orchestra.run.trial160.stdout:Upgrade 2 Packages 2026-02-17T05:44:40.024 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:40.025 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 63 M 2026-02-17T05:44:40.025 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:44:40.566 INFO:teuthology.orchestra.run.trial160.stdout:(1/35): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T05:44:40.606 INFO:teuthology.orchestra.run.trial160.stdout:(2/35): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 618 kB/s | 25 kB 00:00 2026-02-17T05:44:40.668 INFO:teuthology.orchestra.run.trial160.stdout:(3/35): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 16 MB/s | 1.0 MB 00:00 2026-02-17T05:44:40.722 INFO:teuthology.orchestra.run.trial160.stdout:(4/35): libradosstriper1-19.2.3-705.g04cf6dd4.e 9.1 MB/s | 503 kB 00:00 2026-02-17T05:44:40.952 INFO:teuthology.orchestra.run.trial160.stdout:(5/35): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 15 MB/s | 11 MB 00:00 2026-02-17T05:44:40.995 INFO:teuthology.orchestra.run.trial160.stdout:(6/35): python3-ceph-argparse-19.2.3-705.g04cf6 1.0 MB/s | 45 kB 00:00 2026-02-17T05:44:41.008 INFO:teuthology.orchestra.run.trial160.stdout:(7/35): librgw2-19.2.3-705.g04cf6dd4.el9.x86_64 19 MB/s | 5.4 MB 00:00 2026-02-17T05:44:41.025 INFO:teuthology.orchestra.run.trial160.stdout:(8/35): python3-ceph-common-19.2.3-705.g04cf6dd 5.0 MB/s | 154 kB 00:00 2026-02-17T05:44:41.035 INFO:teuthology.orchestra.run.trial160.stdout:(9/35): python3-cephfs-19.2.3-705.g04cf6dd4.el9 5.9 MB/s | 165 kB 00:00 2026-02-17T05:44:41.055 INFO:teuthology.orchestra.run.trial160.stdout:(10/35): python3-rados-19.2.3-705.g04cf6dd4.el9 11 MB/s | 323 kB 00:00 2026-02-17T05:44:41.068 INFO:teuthology.orchestra.run.trial160.stdout:(11/35): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 9.2 MB/s | 303 kB 00:00 2026-02-17T05:44:41.084 INFO:teuthology.orchestra.run.trial160.stdout:(12/35): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 3.4 MB/s | 100 kB 00:00 2026-02-17T05:44:41.116 INFO:teuthology.orchestra.run.trial160.stdout:(13/35): ceph-common-19.2.3-705.g04cf6dd4.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T05:44:41.159 INFO:teuthology.orchestra.run.trial160.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 362 kB/s | 33 kB 00:00 2026-02-17T05:44:41.192 INFO:teuthology.orchestra.run.trial160.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.2 MB/s | 93 kB 00:00 2026-02-17T05:44:41.254 INFO:teuthology.orchestra.run.trial160.stdout:(16/35): nvme-cli-2.13-1.el9.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2026-02-17T05:44:41.564 INFO:teuthology.orchestra.run.trial160.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 258 kB/s | 104 kB 00:00 2026-02-17T05:44:41.645 INFO:teuthology.orchestra.run.trial160.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 362 kB/s | 164 kB 00:00 2026-02-17T05:44:41.664 INFO:teuthology.orchestra.run.trial160.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2026-02-17T05:44:41.705 INFO:teuthology.orchestra.run.trial160.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 356 kB/s | 160 kB 00:00 2026-02-17T05:44:41.882 INFO:teuthology.orchestra.run.trial160.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-17T05:44:41.888 INFO:teuthology.orchestra.run.trial160.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2026-02-17T05:44:41.914 INFO:teuthology.orchestra.run.trial160.stdout:(23/35): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2026-02-17T05:44:41.965 INFO:teuthology.orchestra.run.trial160.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 447 kB/s | 37 kB 00:00 2026-02-17T05:44:41.976 INFO:teuthology.orchestra.run.trial160.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 757 kB/s | 66 kB 00:00 2026-02-17T05:44:42.390 INFO:teuthology.orchestra.run.trial160.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 60 kB/s | 25 kB 00:00 2026-02-17T05:44:42.554 INFO:teuthology.orchestra.run.trial160.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 299 kB/s | 49 kB 00:00 2026-02-17T05:44:42.718 INFO:teuthology.orchestra.run.trial160.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 411 kB/s | 67 kB 00:00 2026-02-17T05:44:42.729 INFO:teuthology.orchestra.run.trial160.stdout:(29/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 378 kB/s | 308 kB 00:00 2026-02-17T05:44:42.972 INFO:teuthology.orchestra.run.trial160.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 787 kB/s | 191 kB 00:00 2026-02-17T05:44:43.622 INFO:teuthology.orchestra.run.trial160.stdout:(31/35): thrift-0.15.0-4.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2026-02-17T05:44:43.737 INFO:teuthology.orchestra.run.trial160.stdout:(32/35): librados2-19.2.3-705.g04cf6dd4.el9.x86 30 MB/s | 3.4 MB 00:00 2026-02-17T05:44:43.780 INFO:teuthology.orchestra.run.trial160.stdout:(33/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 789 kB/s | 838 kB 00:01 2026-02-17T05:44:43.797 INFO:teuthology.orchestra.run.trial160.stdout:(34/35): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 53 MB/s | 3.2 MB 00:00 2026-02-17T05:44:44.265 INFO:teuthology.orchestra.run.trial160.stdout:(35/35): libarrow-9.0.0-15.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2026-02-17T05:44:44.268 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:44:44.268 INFO:teuthology.orchestra.run.trial160.stdout:Total 15 MB/s | 63 MB 00:04 2026-02-17T05:44:44.367 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:44:44.385 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:44:44.385 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:44:44.621 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:44:44.622 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:44:44.912 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:44:44.921 INFO:teuthology.orchestra.run.trial160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T05:44:44.923 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T05:44:44.935 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T05:44:45.090 INFO:teuthology.orchestra.run.trial160.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T05:44:45.093 INFO:teuthology.orchestra.run.trial160.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T05:44:45.124 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T05:44:45.167 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T05:44:45.168 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T05:44:45.181 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T05:44:45.185 INFO:teuthology.orchestra.run.trial160.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T05:44:45.194 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/37 2026-02-17T05:44:45.216 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T05:44:45.217 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T05:44:45.231 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T05:44:45.263 INFO:teuthology.orchestra.run.trial160.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T05:44:45.267 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T05:44:45.274 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T05:44:45.276 INFO:teuthology.orchestra.run.trial160.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T05:44:45.279 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T05:44:45.284 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T05:44:45.426 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T05:44:45.427 INFO:teuthology.orchestra.run.trial160.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T05:44:45.453 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/37 2026-02-17T05:44:45.455 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/37 2026-02-17T05:44:45.461 INFO:teuthology.orchestra.run.trial160.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T05:44:45.691 INFO:teuthology.orchestra.run.trial160.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T05:44:45.692 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T05:44:45.709 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/37 2026-02-17T05:44:45.713 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/37 2026-02-17T05:44:45.719 INFO:teuthology.orchestra.run.trial160.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T05:44:45.722 INFO:teuthology.orchestra.run.trial160.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T05:44:45.723 INFO:teuthology.orchestra.run.trial160.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T05:44:45.742 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T05:44:45.854 INFO:teuthology.orchestra.run.trial160.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T05:44:45.856 INFO:teuthology.orchestra.run.trial160.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T05:44:46.139 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T05:44:46.140 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T05:44:46.140 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:46.180 INFO:teuthology.orchestra.run.trial160.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T05:44:46.182 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 31/37 2026-02-17T05:44:47.181 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T05:44:47.184 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T05:44:47.469 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/37 2026-02-17T05:44:47.472 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T05:44:47.511 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/37 2026-02-17T05:44:47.512 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T05:44:47.512 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T05:44:47.512 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:47.514 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T05:44:52.025 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T05:44:52.025 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /sys 2026-02-17T05:44:52.025 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /proc 2026-02-17T05:44:52.025 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /mnt 2026-02-17T05:44:52.026 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /var/tmp 2026-02-17T05:44:52.026 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /home 2026-02-17T05:44:52.026 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /root 2026-02-17T05:44:52.026 INFO:teuthology.orchestra.run.trial160.stdout:skipping the directory /tmp 2026-02-17T05:44:52.026 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:52.492 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T05:44:52.516 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/37 2026-02-17T05:44:52.516 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:44:52.516 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T05:44:52.516 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:44:52.516 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T05:44:52.516 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:52.518 INFO:teuthology.orchestra.run.trial160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T05:44:52.530 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T05:44:52.531 INFO:teuthology.orchestra.run.trial160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T05:44:52.585 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T05:44:52.585 INFO:teuthology.orchestra.run.trial160.stdout:Creating group 'qat' with GID 992. 2026-02-17T05:44:52.585 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:52.863 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/37 2026-02-17T05:44:52.863 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/37 2026-02-17T05:44:52.863 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/37 2026-02-17T05:44:52.863 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/37 2026-02-17T05:44:52.863 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/37 2026-02-17T05:44:52.863 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T05:44:52.864 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T05:44:52.865 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T05:44:52.866 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 36/37 2026-02-17T05:44:52.925 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T05:44:52.925 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:52.925 INFO:teuthology.orchestra.run.trial160.stdout:Upgraded: 2026-02-17T05:44:52.925 INFO:teuthology.orchestra.run.trial160.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T05:44:52.926 INFO:teuthology.orchestra.run.trial160.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T05:44:52.927 INFO:teuthology.orchestra.run.trial160.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:52.928 INFO:teuthology.orchestra.run.trial160.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T05:44:52.929 INFO:teuthology.orchestra.run.trial160.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T05:44:52.929 INFO:teuthology.orchestra.run.trial160.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T05:44:52.929 INFO:teuthology.orchestra.run.trial160.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T05:44:52.929 INFO:teuthology.orchestra.run.trial160.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T05:44:52.929 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:52.929 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:44:52.966 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-test 2026-02-17T05:44:53.276 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:15 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:44:53.358 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:44:53.358 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:44:53.358 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repository Size 2026-02-17T05:44:53.358 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout:Installing dependencies: 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:53.359 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:44:53.360 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:44:53.360 INFO:teuthology.orchestra.run.trial160.stdout:Install 5 Packages 2026-02-17T05:44:53.360 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:53.361 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 50 M 2026-02-17T05:44:53.361 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 212 M 2026-02-17T05:44:53.361 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:44:53.488 INFO:teuthology.orchestra.run.trial160.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.3 MB/s | 233 kB 00:00 2026-02-17T05:44:53.522 INFO:teuthology.orchestra.run.trial160.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 8.8 MB/s | 303 kB 00:00 2026-02-17T05:44:53.544 INFO:teuthology.orchestra.run.trial160.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.7 MB/s | 64 kB 00:00 2026-02-17T05:44:53.861 INFO:teuthology.orchestra.run.trial160.stdout:(4/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 368 kB/s | 163 kB 00:00 2026-02-17T05:44:55.957 INFO:teuthology.orchestra.run.trial160.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 20 MB/s | 50 MB 00:02 2026-02-17T05:44:55.959 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:44:55.959 INFO:teuthology.orchestra.run.trial160.stdout:Total 19 MB/s | 50 MB 00:02 2026-02-17T05:44:55.985 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:44:55.994 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:44:55.995 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:44:56.180 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:44:56.181 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:44:56.391 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:44:56.397 INFO:teuthology.orchestra.run.trial160.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T05:44:56.401 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T05:44:56.409 INFO:teuthology.orchestra.run.trial160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T05:44:56.410 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T05:44:58.658 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T05:44:58.676 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T05:44:58.915 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T05:44:58.915 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T05:44:58.915 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T05:44:58.915 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T05:44:58.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T05:44:58.967 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T05:44:58.967 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:58.967 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:44:58.967 INFO:teuthology.orchestra.run.trial160.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:58.968 INFO:teuthology.orchestra.run.trial160.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:44:58.968 INFO:teuthology.orchestra.run.trial160.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T05:44:58.968 INFO:teuthology.orchestra.run.trial160.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T05:44:58.968 INFO:teuthology.orchestra.run.trial160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T05:44:58.968 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:58.968 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:44:59.000 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph 2026-02-17T05:44:59.327 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:21 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:44:59.412 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout:====================================================================================== 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repository Size 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout:====================================================================================== 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout:Installing dependencies: 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T05:44:59.415 INFO:teuthology.orchestra.run.trial160.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T05:44:59.416 INFO:teuthology.orchestra.run.trial160.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T05:44:59.417 INFO:teuthology.orchestra.run.trial160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout:Installing weak dependencies: 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T05:44:59.418 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout:====================================================================================== 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout:Install 99 Packages 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 95 M 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 520 M 2026-02-17T05:44:59.419 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:00.089 INFO:teuthology.orchestra.run.trial160.stdout:(1/99): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 123 kB/s | 6.5 kB 00:00 2026-02-17T05:45:00.156 INFO:teuthology.orchestra.run.trial160.stdout:(2/99): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 9.0 MB/s | 1.1 MB 00:00 2026-02-17T05:45:00.222 INFO:teuthology.orchestra.run.trial160.stdout:(3/99): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-17T05:45:00.256 INFO:teuthology.orchestra.run.trial160.stdout:(4/99): ceph-grafana-dashboards-19.2.3-705.g04c 902 kB/s | 31 kB 00:00 2026-02-17T05:45:00.295 INFO:teuthology.orchestra.run.trial160.stdout:(5/99): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 3.8 MB/s | 150 kB 00:00 2026-02-17T05:45:00.386 INFO:teuthology.orchestra.run.trial160.stdout:(6/99): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 16 MB/s | 4.7 MB 00:00 2026-02-17T05:45:00.520 INFO:teuthology.orchestra.run.trial160.stdout:(7/99): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 17 MB/s | 3.8 MB 00:00 2026-02-17T05:45:00.566 INFO:teuthology.orchestra.run.trial160.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 480 kB/s | 22 kB 00:00 2026-02-17T05:45:00.619 INFO:teuthology.orchestra.run.trial160.stdout:(9/99): ceph-mgr-modules-core-19.2.3-705.g04cf6 4.7 MB/s | 253 kB 00:00 2026-02-17T05:45:00.670 INFO:teuthology.orchestra.run.trial160.stdout:(10/99): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 967 kB/s | 49 kB 00:00 2026-02-17T05:45:00.722 INFO:teuthology.orchestra.run.trial160.stdout:(11/99): ceph-prometheus-alerts-19.2.3-705.g04c 320 kB/s | 17 kB 00:00 2026-02-17T05:45:00.753 INFO:teuthology.orchestra.run.trial160.stdout:(12/99): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 29 MB/s | 17 MB 00:00 2026-02-17T05:45:00.755 INFO:teuthology.orchestra.run.trial160.stdout:(13/99): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 8.8 MB/s | 299 kB 00:00 2026-02-17T05:45:00.764 INFO:teuthology.orchestra.run.trial160.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-7 20 MB/s | 7.4 MB 00:00 2026-02-17T05:45:00.769 INFO:teuthology.orchestra.run.trial160.stdout:(15/99): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 47 MB/s | 769 kB 00:00 2026-02-17T05:45:01.222 INFO:teuthology.orchestra.run.trial160.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 88 kB/s | 40 kB 00:00 2026-02-17T05:45:01.388 INFO:teuthology.orchestra.run.trial160.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 116 kB/s | 72 kB 00:00 2026-02-17T05:45:01.620 INFO:teuthology.orchestra.run.trial160.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 405 kB/s | 350 kB 00:00 2026-02-17T05:45:01.734 INFO:teuthology.orchestra.run.trial160.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 533 kB/s | 184 kB 00:00 2026-02-17T05:45:01.965 INFO:teuthology.orchestra.run.trial160.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 734 kB/s | 253 kB 00:00 2026-02-17T05:45:02.149 INFO:teuthology.orchestra.run.trial160.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 579 kB/s | 106 kB 00:00 2026-02-17T05:45:02.332 INFO:teuthology.orchestra.run.trial160.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 738 kB/s | 135 kB 00:00 2026-02-17T05:45:02.596 INFO:teuthology.orchestra.run.trial160.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 570 kB/s | 150 kB 00:00 2026-02-17T05:45:02.780 INFO:teuthology.orchestra.run.trial160.stdout:(24/99): python3-requests-2.25.1-10.el9.noarch. 689 kB/s | 126 kB 00:00 2026-02-17T05:45:03.124 INFO:teuthology.orchestra.run.trial160.stdout:(25/99): python3-urllib3-1.26.5-7.el9.noarch.rp 632 kB/s | 218 kB 00:00 2026-02-17T05:45:03.197 INFO:teuthology.orchestra.run.trial160.stdout:(26/99): libgfortran-11.5.0-14.el9.x86_64.rpm 402 kB/s | 794 kB 00:01 2026-02-17T05:45:03.305 INFO:teuthology.orchestra.run.trial160.stdout:(27/99): python3-cryptography-36.0.1-5.el9.x86_ 812 kB/s | 1.2 MB 00:01 2026-02-17T05:45:03.379 INFO:teuthology.orchestra.run.trial160.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 402 kB/s | 30 kB 00:00 2026-02-17T05:45:03.387 INFO:teuthology.orchestra.run.trial160.stdout:(29/99): unzip-6.0-59.el9.x86_64.rpm 691 kB/s | 182 kB 00:00 2026-02-17T05:45:03.453 INFO:teuthology.orchestra.run.trial160.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 226 kB/s | 15 kB 00:00 2026-02-17T05:45:03.530 INFO:teuthology.orchestra.run.trial160.stdout:(31/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 20 MB/s | 3.0 MB 00:00 2026-02-17T05:45:03.541 INFO:teuthology.orchestra.run.trial160.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.7 MB/s | 246 kB 00:00 2026-02-17T05:45:03.544 INFO:teuthology.orchestra.run.trial160.stdout:(33/99): zip-3.0-35.el9.x86_64.rpm 767 kB/s | 266 kB 00:00 2026-02-17T05:45:03.559 INFO:teuthology.orchestra.run.trial160.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 6.3 MB/s | 188 kB 00:00 2026-02-17T05:45:03.564 INFO:teuthology.orchestra.run.trial160.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T05:45:03.585 INFO:teuthology.orchestra.run.trial160.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 38 MB/s | 1.0 MB 00:00 2026-02-17T05:45:03.610 INFO:teuthology.orchestra.run.trial160.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 9.6 MB/s | 244 kB 00:00 2026-02-17T05:45:03.635 INFO:teuthology.orchestra.run.trial160.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.8 MB/s | 249 kB 00:00 2026-02-17T05:45:03.660 INFO:teuthology.orchestra.run.trial160.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.0 MB/s | 177 kB 00:00 2026-02-17T05:45:03.716 INFO:teuthology.orchestra.run.trial160.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 22 MB/s | 1.2 MB 00:00 2026-02-17T05:45:03.740 INFO:teuthology.orchestra.run.trial160.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.9 MB/s | 172 kB 00:00 2026-02-17T05:45:03.749 INFO:teuthology.orchestra.run.trial160.stdout:(42/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 26 MB/s | 5.3 MB 00:00 2026-02-17T05:45:03.763 INFO:teuthology.orchestra.run.trial160.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-17T05:45:03.782 INFO:teuthology.orchestra.run.trial160.stdout:(44/99): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2026-02-17T05:45:03.788 INFO:teuthology.orchestra.run.trial160.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 18 MB/s | 442 kB 00:00 2026-02-17T05:45:03.808 INFO:teuthology.orchestra.run.trial160.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-17T05:45:03.813 INFO:teuthology.orchestra.run.trial160.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 10 MB/s | 267 kB 00:00 2026-02-17T05:45:03.824 INFO:teuthology.orchestra.run.trial160.stdout:(48/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 82 MB/s | 6.1 MB 00:00 2026-02-17T05:45:03.834 INFO:teuthology.orchestra.run.trial160.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.1 MB/s | 159 kB 00:00 2026-02-17T05:45:03.838 INFO:teuthology.orchestra.run.trial160.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-17T05:45:03.846 INFO:teuthology.orchestra.run.trial160.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 2.4 MB/s | 54 kB 00:00 2026-02-17T05:45:03.861 INFO:teuthology.orchestra.run.trial160.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T05:45:03.868 INFO:teuthology.orchestra.run.trial160.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.2 MB/s | 189 kB 00:00 2026-02-17T05:45:03.885 INFO:teuthology.orchestra.run.trial160.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.6 MB/s | 90 kB 00:00 2026-02-17T05:45:04.114 INFO:teuthology.orchestra.run.trial160.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 90 kB/s | 22 kB 00:00 2026-02-17T05:45:04.292 INFO:teuthology.orchestra.run.trial160.stdout:(56/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 42 MB/s | 19 MB 00:00 2026-02-17T05:45:04.705 INFO:teuthology.orchestra.run.trial160.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 47 kB/s | 19 kB 00:00 2026-02-17T05:45:05.029 INFO:teuthology.orchestra.run.trial160.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 466 kB/s | 151 kB 00:00 2026-02-17T05:45:05.194 INFO:teuthology.orchestra.run.trial160.stdout:(59/99): protobuf-compiler-3.14.0-17.el9.x86_64 659 kB/s | 862 kB 00:01 2026-02-17T05:45:05.194 INFO:teuthology.orchestra.run.trial160.stdout:(60/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 510 kB/s | 551 kB 00:01 2026-02-17T05:45:05.278 INFO:teuthology.orchestra.run.trial160.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 719 kB/s | 60 kB 00:00 2026-02-17T05:45:05.361 INFO:teuthology.orchestra.run.trial160.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 525 kB/s | 43 kB 00:00 2026-02-17T05:45:05.445 INFO:teuthology.orchestra.run.trial160.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 389 kB/s | 32 kB 00:00 2026-02-17T05:45:05.527 INFO:teuthology.orchestra.run.trial160.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 172 kB/s | 14 kB 00:00 2026-02-17T05:45:05.605 INFO:teuthology.orchestra.run.trial160.stdout:(65/99): python3-autocommand-2.2.2-8.el9.noarch 72 kB/s | 29 kB 00:00 2026-02-17T05:45:05.678 INFO:teuthology.orchestra.run.trial160.stdout:(66/99): python3-asyncssh-2.13.2-5.el9.noarch.r 845 kB/s | 548 kB 00:00 2026-02-17T05:45:05.773 INFO:teuthology.orchestra.run.trial160.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 705 kB/s | 173 kB 00:00 2026-02-17T05:45:06.003 INFO:teuthology.orchestra.run.trial160.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 782 kB/s | 254 kB 00:00 2026-02-17T05:45:06.011 INFO:teuthology.orchestra.run.trial160.stdout:(69/99): python3-cherrypy-18.6.1-2.el9.noarch.r 884 kB/s | 358 kB 00:00 2026-02-17T05:45:06.174 INFO:teuthology.orchestra.run.trial160.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 855 kB/s | 139 kB 00:00 2026-02-17T05:45:06.247 INFO:teuthology.orchestra.run.trial160.stdout:(71/99): python3-grpcio-tools-1.46.7-10.el9.x86 593 kB/s | 144 kB 00:00 2026-02-17T05:45:06.255 INFO:teuthology.orchestra.run.trial160.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 684 kB/s | 56 kB 00:00 2026-02-17T05:45:06.328 INFO:teuthology.orchestra.run.trial160.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 131 kB/s | 11 kB 00:00 2026-02-17T05:45:06.337 INFO:teuthology.orchestra.run.trial160.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 216 kB/s | 18 kB 00:00 2026-02-17T05:45:06.410 INFO:teuthology.orchestra.run.trial160.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 283 kB/s | 23 kB 00:00 2026-02-17T05:45:06.419 INFO:teuthology.orchestra.run.trial160.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 240 kB/s | 20 kB 00:00 2026-02-17T05:45:06.492 INFO:teuthology.orchestra.run.trial160.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 238 kB/s | 19 kB 00:00 2026-02-17T05:45:06.501 INFO:teuthology.orchestra.run.trial160.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 323 kB/s | 26 kB 00:00 2026-02-17T05:45:06.583 INFO:teuthology.orchestra.run.trial160.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 566 kB/s | 46 kB 00:00 2026-02-17T05:45:06.675 INFO:teuthology.orchestra.run.trial160.stdout:(80/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.3 MB/s | 2.0 MB 00:00 2026-02-17T05:45:06.745 INFO:teuthology.orchestra.run.trial160.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 485 kB/s | 79 kB 00:00 2026-02-17T05:45:06.758 INFO:teuthology.orchestra.run.trial160.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2026-02-17T05:45:06.827 INFO:teuthology.orchestra.run.trial160.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 706 kB/s | 58 kB 00:00 2026-02-17T05:45:06.842 INFO:teuthology.orchestra.run.trial160.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2026-02-17T05:45:06.909 INFO:teuthology.orchestra.run.trial160.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 200 kB/s | 16 kB 00:00 2026-02-17T05:45:06.925 INFO:teuthology.orchestra.run.trial160.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2026-02-17T05:45:06.991 INFO:teuthology.orchestra.run.trial160.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 377 kB/s | 31 kB 00:00 2026-02-17T05:45:07.008 INFO:teuthology.orchestra.run.trial160.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2026-02-17T05:45:07.074 INFO:teuthology.orchestra.run.trial160.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 713 kB/s | 59 kB 00:00 2026-02-17T05:45:07.091 INFO:teuthology.orchestra.run.trial160.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.5 MB/s | 125 kB 00:00 2026-02-17T05:45:07.156 INFO:teuthology.orchestra.run.trial160.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 438 kB/s | 36 kB 00:00 2026-02-17T05:45:07.174 INFO:teuthology.orchestra.run.trial160.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 1.0 MB/s | 86 kB 00:00 2026-02-17T05:45:07.257 INFO:teuthology.orchestra.run.trial160.stdout:(93/99): python3-websocket-client-1.2.3-2.el9.n 1.1 MB/s | 90 kB 00:00 2026-02-17T05:45:07.341 INFO:teuthology.orchestra.run.trial160.stdout:(94/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.9 MB/s | 427 kB 00:00 2026-02-17T05:45:07.424 INFO:teuthology.orchestra.run.trial160.stdout:(95/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 586 kB/s | 48 kB 00:00 2026-02-17T05:45:07.480 INFO:teuthology.orchestra.run.trial160.stdout:(96/99): python3-webob-1.8.8-2.el9.noarch.rpm 711 kB/s | 230 kB 00:00 2026-02-17T05:45:07.506 INFO:teuthology.orchestra.run.trial160.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 269 kB/s | 22 kB 00:00 2026-02-17T05:45:07.562 INFO:teuthology.orchestra.run.trial160.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 243 kB/s | 20 kB 00:00 2026-02-17T05:45:07.709 INFO:teuthology.orchestra.run.trial160.stdout:(99/99): python3-kubernetes-26.1.0-3.el9.noarch 858 kB/s | 1.0 MB 00:01 2026-02-17T05:45:07.714 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:07.714 INFO:teuthology.orchestra.run.trial160.stdout:Total 12 MB/s | 95 MB 00:08 2026-02-17T05:45:08.138 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:08.176 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:08.176 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:08.591 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:08.591 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:09.038 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:09.040 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T05:45:09.072 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T05:45:09.077 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T05:45:09.098 INFO:teuthology.orchestra.run.trial160.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T05:45:09.105 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T05:45:09.139 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T05:45:09.149 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T05:45:09.154 INFO:teuthology.orchestra.run.trial160.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T05:45:09.156 INFO:teuthology.orchestra.run.trial160.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T05:45:09.160 INFO:teuthology.orchestra.run.trial160.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T05:45:09.183 INFO:teuthology.orchestra.run.trial160.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T05:45:09.196 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T05:45:09.199 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T05:45:09.205 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T05:45:09.206 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T05:45:09.217 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T05:45:09.223 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T05:45:09.248 INFO:teuthology.orchestra.run.trial160.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T05:45:09.251 INFO:teuthology.orchestra.run.trial160.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T05:45:09.258 INFO:teuthology.orchestra.run.trial160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T05:45:09.282 INFO:teuthology.orchestra.run.trial160.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T05:45:09.334 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T05:45:09.346 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T05:45:09.348 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T05:45:09.353 INFO:teuthology.orchestra.run.trial160.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T05:45:09.358 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T05:45:09.363 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T05:45:09.366 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T05:45:09.381 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T05:45:09.402 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T05:45:09.407 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T05:45:09.412 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T05:45:09.423 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T05:45:09.432 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T05:45:09.438 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T05:45:09.458 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T05:45:09.467 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T05:45:09.521 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T05:45:09.533 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T05:45:09.549 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T05:45:09.553 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T05:45:09.561 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T05:45:09.601 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T05:45:09.927 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T05:45:09.937 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T05:45:09.941 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T05:45:09.946 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T05:45:09.948 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T05:45:09.976 INFO:teuthology.orchestra.run.trial160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T05:45:10.020 INFO:teuthology.orchestra.run.trial160.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T05:45:10.026 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T05:45:10.030 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T05:45:10.035 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T05:45:10.039 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T05:45:10.046 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T05:45:10.049 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T05:45:10.078 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T05:45:10.087 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T05:45:10.122 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T05:45:10.347 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T05:45:10.371 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T05:45:10.374 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T05:45:10.433 INFO:teuthology.orchestra.run.trial160.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T05:45:10.435 INFO:teuthology.orchestra.run.trial160.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T05:45:10.457 INFO:teuthology.orchestra.run.trial160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T05:45:10.783 INFO:teuthology.orchestra.run.trial160.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T05:45:10.856 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T05:45:11.527 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T05:45:11.544 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T05:45:11.554 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T05:45:11.561 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T05:45:11.575 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T05:45:11.590 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T05:45:11.666 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T05:45:11.674 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T05:45:11.698 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T05:45:11.727 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T05:45:11.778 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T05:45:11.784 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T05:45:11.788 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T05:45:11.789 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T05:45:11.807 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T05:45:11.808 INFO:teuthology.orchestra.run.trial160.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T05:45:11.808 INFO:teuthology.orchestra.run.trial160.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T05:45:11.808 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:11.815 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T05:45:11.841 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T05:45:11.841 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T05:45:11.841 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:11.878 INFO:teuthology.orchestra.run.trial160.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T05:45:11.942 INFO:teuthology.orchestra.run.trial160.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T05:45:11.944 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T05:45:11.958 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 85/99 2026-02-17T05:45:11.958 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:45:11.958 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T05:45:11.959 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:12.656 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T05:45:12.680 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 86/99 2026-02-17T05:45:12.680 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:45:12.681 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T05:45:12.681 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T05:45:12.681 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T05:45:12.681 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:12.735 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T05:45:12.737 INFO:teuthology.orchestra.run.trial160.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 87/99 2026-02-17T05:45:12.742 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 88/99 2026-02-17T05:45:12.762 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 89/99 2026-02-17T05:45:12.763 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T05:45:13.253 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 90/99 2026-02-17T05:45:13.256 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T05:45:13.707 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 91/99 2026-02-17T05:45:13.708 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T05:45:13.720 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 92/99 2026-02-17T05:45:13.721 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T05:45:13.779 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 93/99 2026-02-17T05:45:13.828 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 94/99 2026-02-17T05:45:13.829 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T05:45:13.851 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 95/99 2026-02-17T05:45:13.851 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:45:13.851 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T05:45:13.851 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T05:45:13.851 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T05:45:13.851 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:13.863 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T05:45:14.082 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 96/99 2026-02-17T05:45:14.083 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T05:45:14.105 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/99 2026-02-17T05:45:14.105 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:45:14.105 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T05:45:14.106 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T05:45:14.106 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T05:45:14.106 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:14.208 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T05:45:14.228 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/99 2026-02-17T05:45:14.228 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:45:14.229 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T05:45:14.229 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T05:45:14.229 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T05:45:14.229 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:14.247 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T05:45:14.915 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 99/99 2026-02-17T05:45:14.915 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/99 2026-02-17T05:45:14.915 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/99 2026-02-17T05:45:14.915 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/99 2026-02-17T05:45:14.916 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T05:45:14.917 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T05:45:14.918 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T05:45:14.919 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T05:45:14.920 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T05:45:14.921 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T05:45:14.922 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T05:45:14.923 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T05:45:14.977 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T05:45:14.977 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:14.977 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.978 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T05:45:14.979 INFO:teuthology.orchestra.run.trial160.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T05:45:14.980 INFO:teuthology.orchestra.run.trial160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T05:45:14.981 INFO:teuthology.orchestra.run.trial160.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T05:45:14.982 INFO:teuthology.orchestra.run.trial160.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T05:45:14.983 INFO:teuthology.orchestra.run.trial160.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T05:45:14.984 INFO:teuthology.orchestra.run.trial160.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T05:45:14.985 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T05:45:14.986 INFO:teuthology.orchestra.run.trial160.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T05:45:14.986 INFO:teuthology.orchestra.run.trial160.stdout: zip-3.0-35.el9.x86_64 2026-02-17T05:45:14.986 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:14.986 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:15.034 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-base 2026-02-17T05:45:15.350 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:15.414 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:15.431 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:15.431 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:15.432 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:15.454 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install cephadm 2026-02-17T05:45:15.765 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:15.829 INFO:teuthology.orchestra.run.trial160.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T05:45:15.846 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:15.846 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:15.846 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:15.868 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T05:45:16.173 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repo Size 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:16.255 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:45:16.256 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:16.256 INFO:teuthology.orchestra.run.trial160.stdout:Install 1 Package 2026-02-17T05:45:16.256 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:16.256 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 145 k 2026-02-17T05:45:16.256 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 431 k 2026-02-17T05:45:16.256 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:16.461 INFO:teuthology.orchestra.run.trial160.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 707 kB/s | 145 kB 00:00 2026-02-17T05:45:16.463 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:16.463 INFO:teuthology.orchestra.run.trial160.stdout:Total 697 kB/s | 145 kB 00:00 2026-02-17T05:45:16.464 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:16.467 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:16.467 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:16.498 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:16.498 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:16.553 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:16.554 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T05:45:16.576 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T05:45:16.576 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:45:16.576 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T05:45:16.576 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:16.880 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T05:45:16.880 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:16.880 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:16.880 INFO:teuthology.orchestra.run.trial160.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:16.881 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:16.881 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:16.906 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-mgr 2026-02-17T05:45:17.218 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:17.283 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:17.300 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:17.301 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:17.301 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:17.323 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T05:45:17.639 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:17.705 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T05:45:17.722 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:17.723 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:17.723 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:17.744 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T05:45:18.053 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:18.117 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T05:45:18.135 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:18.135 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:18.136 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:18.156 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-mgr-rook 2026-02-17T05:45:18.466 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:18.529 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T05:45:18.547 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:18.547 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:18.547 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:18.569 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T05:45:18.880 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:18.944 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T05:45:18.962 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:18.962 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:18.962 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:18.983 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-fuse 2026-02-17T05:45:19.287 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:19.368 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout: Package Architecture Version Repository Size 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:19.369 INFO:teuthology.orchestra.run.trial160.stdout:Install 1 Package 2026-02-17T05:45:19.370 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:19.370 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 1.2 M 2026-02-17T05:45:19.370 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 3.6 M 2026-02-17T05:45:19.370 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:19.877 INFO:teuthology.orchestra.run.trial160.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.3 MB/s | 1.2 MB 00:00 2026-02-17T05:45:19.877 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:19.877 INFO:teuthology.orchestra.run.trial160.stdout:Total 2.3 MB/s | 1.2 MB 00:00 2026-02-17T05:45:19.877 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:19.881 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:19.881 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:19.914 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:19.914 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:20.015 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:20.032 INFO:teuthology.orchestra.run.trial160.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:20.270 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:20.327 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:20.327 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:20.327 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:20.327 INFO:teuthology.orchestra.run.trial160.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:20.327 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:20.327 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:20.353 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install ceph-volume 2026-02-17T05:45:20.664 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:20.729 INFO:teuthology.orchestra.run.trial160.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T05:45:20.746 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:20.747 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:20.767 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install librados-devel 2026-02-17T05:45:21.077 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repo Size 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout:Install 1 Package 2026-02-17T05:45:21.159 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:21.160 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 126 k 2026-02-17T05:45:21.160 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 456 k 2026-02-17T05:45:21.160 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:21.246 INFO:teuthology.orchestra.run.trial160.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-17T05:45:21.246 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:21.247 INFO:teuthology.orchestra.run.trial160.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T05:45:21.247 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:21.249 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:21.249 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:21.280 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:21.280 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:21.334 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:21.350 INFO:teuthology.orchestra.run.trial160.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:21.427 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:21.483 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:21.483 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:21.483 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:21.483 INFO:teuthology.orchestra.run.trial160.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:21.484 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:21.484 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:21.511 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install libcephfs2 2026-02-17T05:45:21.826 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:21.889 INFO:teuthology.orchestra.run.trial160.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:21.906 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:21.907 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:21.907 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:21.928 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install libcephfs-devel 2026-02-17T05:45:22.235 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:22.317 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:22.317 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repo Size 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout:Install 1 Package 2026-02-17T05:45:22.318 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:22.319 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 34 k 2026-02-17T05:45:22.319 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 153 k 2026-02-17T05:45:22.319 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:22.504 INFO:teuthology.orchestra.run.trial160.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 181 kB/s | 34 kB 00:00 2026-02-17T05:45:22.504 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:22.504 INFO:teuthology.orchestra.run.trial160.stdout:Total 180 kB/s | 34 kB 00:00 2026-02-17T05:45:22.504 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:22.506 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:22.506 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:22.508 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:22.508 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:22.529 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:22.545 INFO:teuthology.orchestra.run.trial160.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:22.601 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:22.656 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:22.656 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:22.657 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:22.657 INFO:teuthology.orchestra.run.trial160.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:22.657 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:22.657 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:22.684 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install librados2 2026-02-17T05:45:22.995 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:23.059 INFO:teuthology.orchestra.run.trial160.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:23.076 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:23.077 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:23.077 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:23.098 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install librbd1 2026-02-17T05:45:23.411 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:23.475 INFO:teuthology.orchestra.run.trial160.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:23.492 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:23.493 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:23.493 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:23.515 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install python3-rados 2026-02-17T05:45:23.823 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:23.887 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:23.904 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:23.905 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:23.905 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:23.926 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install python3-rgw 2026-02-17T05:45:24.234 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:24.299 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:24.316 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:24.316 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:24.316 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:24.337 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install python3-cephfs 2026-02-17T05:45:24.646 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:24.711 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:24.728 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:24.729 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:24.729 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:24.750 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install python3-rbd 2026-02-17T05:45:25.061 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:25.124 INFO:teuthology.orchestra.run.trial160.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T05:45:25.141 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:25.142 INFO:teuthology.orchestra.run.trial160.stdout:Nothing to do. 2026-02-17T05:45:25.142 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:25.163 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install rbd-fuse 2026-02-17T05:45:25.474 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout: Package Architecture Version Repository Size 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:25.557 INFO:teuthology.orchestra.run.trial160.stdout:Install 1 Package 2026-02-17T05:45:25.558 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:25.558 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 85 k 2026-02-17T05:45:25.558 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 227 k 2026-02-17T05:45:25.558 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:25.646 INFO:teuthology.orchestra.run.trial160.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 970 kB/s | 85 kB 00:00 2026-02-17T05:45:25.646 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:25.646 INFO:teuthology.orchestra.run.trial160.stdout:Total 960 kB/s | 85 kB 00:00 2026-02-17T05:45:25.646 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:25.649 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:25.649 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:25.680 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:25.680 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:25.730 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:25.747 INFO:teuthology.orchestra.run.trial160.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:25.820 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:25.877 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:25.877 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:25.877 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:25.877 INFO:teuthology.orchestra.run.trial160.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:25.877 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:25.877 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:25.906 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install rbd-mirror 2026-02-17T05:45:26.219 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:26.301 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout: Package Arch Version Repo Size 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:Install 1 Package 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 3.1 M 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 13 M 2026-02-17T05:45:26.302 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:27.613 INFO:teuthology.orchestra.run.trial160.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.4 MB/s | 3.1 MB 00:01 2026-02-17T05:45:27.614 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:27.614 INFO:teuthology.orchestra.run.trial160.stdout:Total 2.4 MB/s | 3.1 MB 00:01 2026-02-17T05:45:27.614 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:27.618 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:27.618 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:27.660 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:27.660 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:27.856 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:27.858 INFO:teuthology.orchestra.run.trial160.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:27.881 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:27.881 INFO:teuthology.orchestra.run.trial160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T05:45:27.881 INFO:teuthology.orchestra.run.trial160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T05:45:27.881 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T05:45:27.882 INFO:teuthology.orchestra.run.trial160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T05:45:27.882 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:28.204 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:28.204 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:28.204 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:28.204 INFO:teuthology.orchestra.run.trial160.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:28.204 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:28.204 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:28.231 DEBUG:teuthology.orchestra.run.trial160:> sudo yum -y install rbd-nbd 2026-02-17T05:45:28.540 INFO:teuthology.orchestra.run.trial160.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 05:44:38 AM UTC. 2026-02-17T05:45:28.623 INFO:teuthology.orchestra.run.trial160.stdout:Dependencies resolved. 2026-02-17T05:45:28.623 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:28.623 INFO:teuthology.orchestra.run.trial160.stdout: Package Architecture Version Repository Size 2026-02-17T05:45:28.623 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:28.623 INFO:teuthology.orchestra.run.trial160.stdout:Installing: 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout:Transaction Summary 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout:================================================================================ 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout:Install 1 Package 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout:Total download size: 171 k 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout:Installed size: 490 k 2026-02-17T05:45:28.624 INFO:teuthology.orchestra.run.trial160.stdout:Downloading Packages: 2026-02-17T05:45:28.709 INFO:teuthology.orchestra.run.trial160.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T05:45:28.709 INFO:teuthology.orchestra.run.trial160.stdout:-------------------------------------------------------------------------------- 2026-02-17T05:45:28.709 INFO:teuthology.orchestra.run.trial160.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T05:45:28.709 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction check 2026-02-17T05:45:28.712 INFO:teuthology.orchestra.run.trial160.stdout:Transaction check succeeded. 2026-02-17T05:45:28.713 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction test 2026-02-17T05:45:28.743 INFO:teuthology.orchestra.run.trial160.stdout:Transaction test succeeded. 2026-02-17T05:45:28.743 INFO:teuthology.orchestra.run.trial160.stdout:Running transaction 2026-02-17T05:45:28.799 INFO:teuthology.orchestra.run.trial160.stdout: Preparing : 1/1 2026-02-17T05:45:28.816 INFO:teuthology.orchestra.run.trial160.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:28.901 INFO:teuthology.orchestra.run.trial160.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:28.957 INFO:teuthology.orchestra.run.trial160.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T05:45:28.958 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:28.958 INFO:teuthology.orchestra.run.trial160.stdout:Installed: 2026-02-17T05:45:28.958 INFO:teuthology.orchestra.run.trial160.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T05:45:28.958 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:28.958 INFO:teuthology.orchestra.run.trial160.stdout:Complete! 2026-02-17T05:45:28.988 DEBUG:teuthology.parallel:result is None 2026-02-17T05:45:28.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T05:45:29.172 DEBUG:teuthology.orchestra.run.trial160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T05:45:29.194 INFO:teuthology.orchestra.run.trial160.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T05:45:29.194 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T05:45:29.195 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T05:45:29.197 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T05:45:29.197 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:29.197 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T05:45:29.260 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T05:45:29.260 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:29.260 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T05:45:29.324 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T05:45:29.387 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T05:45:29.387 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:29.387 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T05:45:29.451 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T05:45:29.516 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T05:45:29.516 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:29.516 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T05:45:29.579 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T05:45:29.645 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T05:45:29.748 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T05:45:29.748 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 777 /var/log/ceph 2026-02-17T05:45:29.773 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T05:45:29.773 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T05:45:29.836 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T05:45:29.836 DEBUG:teuthology.orchestra.run.trial160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T05:45:29.917 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T05:45:29.918 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'osd pool default size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 2, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', '\\(PENDING_CREATING_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T05:45:29.918 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51055', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51055', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 2, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'osd pool default size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 2, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'create_rbd_pool': False, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', '\\(PENDING_CREATING_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIYWhwkoDJ+3yHrTwlmbVrxYozWPqRMGJFgFg9doMNJWggPySf2onC+U/T/AFkRbp274XwFytXhQujhc+iz6xlY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'osd_max_pg_per_osd': {'pg_num': 2, 'test_create_from_mon': True}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T05:45:29.919 DEBUG:teuthology.orchestra.run.trial160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T05:45:29.956 DEBUG:teuthology.orchestra.run.trial160:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T05:45:30.022 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:30.022 DEBUG:teuthology.orchestra.run.trial160:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T05:45:30.079 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T05:45:30.079 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_1 2026-02-17T05:45:30.137 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-17 05:45:28.022495449 +0000 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-17 05:44:46.165115809 +0000 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-17 05:44:46.165115809 +0000 2026-02-17T05:45:30.138 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-17 05:44:46.165115809 +0000 2026-02-17T05:45:30.139 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T05:45:30.200 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-17T05:45:30.200 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-17T05:45:30.201 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000156192 s, 3.3 MB/s 2026-02-17T05:45:30.202 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T05:45:30.260 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_2 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-17 05:45:28.022495449 +0000 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-17 05:44:46.165115809 +0000 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-17 05:44:46.165115809 +0000 2026-02-17T05:45:30.316 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-17 05:44:46.165115809 +0000 2026-02-17T05:45:30.316 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T05:45:30.378 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-17T05:45:30.379 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-17T05:45:30.379 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000152846 s, 3.3 MB/s 2026-02-17T05:45:30.380 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T05:45:30.437 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_3 2026-02-17T05:45:30.495 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T05:45:30.495 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:45:30.496 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1314 Links: 1 2026-02-17T05:45:30.496 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:45:30.496 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:45:30.496 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-17 05:45:28.022495449 +0000 2026-02-17T05:45:30.496 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-17 05:44:46.166115793 +0000 2026-02-17T05:45:30.496 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-17 05:44:46.166115793 +0000 2026-02-17T05:45:30.496 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-17 05:44:46.166115793 +0000 2026-02-17T05:45:30.497 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T05:45:30.557 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-17T05:45:30.557 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-17T05:45:30.558 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000154599 s, 3.3 MB/s 2026-02-17T05:45:30.559 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T05:45:30.617 DEBUG:teuthology.orchestra.run.trial160:> stat /dev/vg_nvme/lv_4 2026-02-17T05:45:30.674 INFO:teuthology.orchestra.run.trial160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T05:45:30.674 INFO:teuthology.orchestra.run.trial160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T05:45:30.674 INFO:teuthology.orchestra.run.trial160.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-17T05:45:30.674 INFO:teuthology.orchestra.run.trial160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T05:45:30.675 INFO:teuthology.orchestra.run.trial160.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T05:45:30.675 INFO:teuthology.orchestra.run.trial160.stdout:Access: 2026-02-17 05:45:28.023495435 +0000 2026-02-17T05:45:30.675 INFO:teuthology.orchestra.run.trial160.stdout:Modify: 2026-02-17 05:44:46.166115793 +0000 2026-02-17T05:45:30.675 INFO:teuthology.orchestra.run.trial160.stdout:Change: 2026-02-17 05:44:46.166115793 +0000 2026-02-17T05:45:30.675 INFO:teuthology.orchestra.run.trial160.stdout: Birth: 2026-02-17 05:44:46.166115793 +0000 2026-02-17T05:45:30.675 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T05:45:30.738 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records in 2026-02-17T05:45:30.738 INFO:teuthology.orchestra.run.trial160.stderr:1+0 records out 2026-02-17T05:45:30.738 INFO:teuthology.orchestra.run.trial160.stderr:512 bytes copied, 0.000138258 s, 3.7 MB/s 2026-02-17T05:45:30.739 DEBUG:teuthology.orchestra.run.trial160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T05:45:30.796 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-17T05:45:30.797 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}} 2026-02-17T05:45:30.797 INFO:tasks.ceph:Generating config... 2026-02-17T05:45:30.799 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T05:45:30.799 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T05:45:30.800 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T05:45:30.800 INFO:tasks.ceph:[global] ms type = async 2026-02-17T05:45:30.800 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T05:45:30.800 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T05:45:30.800 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T05:45:30.800 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T05:45:30.800 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T05:45:30.800 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T05:45:30.800 INFO:tasks.ceph:[mon] osd pool default size = 2 2026-02-17T05:45:30.800 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T05:45:30.800 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2026-02-17T05:45:30.800 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T05:45:30.800 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] mon max pg per osd = 2 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] osd max pg per osd hard ratio = 1 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T05:45:30.801 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T05:45:30.802 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T05:45:30.802 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T05:45:30.802 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T05:45:30.802 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T05:45:30.802 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T05:45:30.870 INFO:teuthology.orchestra.run.trial160.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T05:45:30.872 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T05:45:30.947 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T05:45:31.011 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.160')] 2026-02-17T05:45:31.011 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.160', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 2, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300, 'osd pool default size': 2}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T05:45:31.012 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:31.012 DEBUG:teuthology.orchestra.run.trial160:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T05:45:31.066 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.160 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:45:31.140 INFO:teuthology.orchestra.run.trial160.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:45:31.140 INFO:teuthology.orchestra.run.trial160.stdout:monmaptool: generated fsid 2ad9bd9c-4357-400a-90e9-6d120fce401a 2026-02-17T05:45:31.140 INFO:teuthology.orchestra.run.trial160.stdout:setting min_mon_release = quincy 2026-02-17T05:45:31.141 INFO:teuthology.orchestra.run.trial160.stdout:epoch 0 2026-02-17T05:45:31.141 INFO:teuthology.orchestra.run.trial160.stdout:fsid 2ad9bd9c-4357-400a-90e9-6d120fce401a 2026-02-17T05:45:31.141 INFO:teuthology.orchestra.run.trial160.stdout:last_changed 2026-02-17T05:45:31.137465+0000 2026-02-17T05:45:31.141 INFO:teuthology.orchestra.run.trial160.stdout:created 2026-02-17T05:45:31.137465+0000 2026-02-17T05:45:31.141 INFO:teuthology.orchestra.run.trial160.stdout:min_mon_release 17 (quincy) 2026-02-17T05:45:31.142 INFO:teuthology.orchestra.run.trial160.stdout:election_strategy: 3 2026-02-17T05:45:31.142 INFO:teuthology.orchestra.run.trial160.stdout:0: [v2:10.20.193.160:3300/0,v1:10.20.193.160:6789/0] mon.a 2026-02-17T05:45:31.142 INFO:teuthology.orchestra.run.trial160.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T05:45:31.143 DEBUG:teuthology.orchestra.run.trial160:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T05:45:31.198 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2ad9bd9c-4357-400a-90e9-6d120fce401a... 2026-02-17T05:45:31.199 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T05:45:31.277 INFO:teuthology.orchestra.run.trial160.stdout:[global] 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: chdir = "" 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: auth supported = cephx 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: filestore xattr use omap = true 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: mon clock drift allowed = 1.000 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.278 INFO:teuthology.orchestra.run.trial160.stdout: osd crush chooseleaf type = 0 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: auth debug = true 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: ms die on old message = true 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: ms die on bug = true 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: mon pg warn max object skew = 0 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T05:45:31.279 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: osd pool default size = 2 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon osd allow primary affinity = true 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon osd allow pg remap = true 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on legacy crush tunables = false 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on crush straw calc version zero = false 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on no sortbitwise = false 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on osd down out interval zero = false 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon warn on too few osds = false 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: mon_allow_pool_size_one = true 2026-02-17T05:45:31.280 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: osd default data pool replay window = 5 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: mon allow pool delete = true 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: mon cluster log file level = debug 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: debug asserts on shutdown = true 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: mon health detail to clog = false 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: mon host = 10.20.193.160 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: mon client directed command retry = 5 2026-02-17T05:45:31.281 INFO:teuthology.orchestra.run.trial160.stdout: mon election default strategy = 3 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: ms inject socket failures = 5000 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: ms type = async 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: fsid = 2ad9bd9c-4357-400a-90e9-6d120fce401a 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout:[osd] 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: osd journal size = 100 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: osd scrub load threshold = 5.0 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: osd scrub max interval = 600 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: osd mclock profile = high_recovery_ops 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: osd recover clone overlap = true 2026-02-17T05:45:31.282 INFO:teuthology.orchestra.run.trial160.stdout: osd recovery max chunk = 1048576 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd debug shutdown = true 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd debug op order = true 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd debug verify stray on activate = true 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd debug trim objects = true 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd open classes on start = true 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd debug pg log writeout = true 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd deep scrub update digest min age = 30 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: osd map max advance = 10 2026-02-17T05:45:31.283 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: journal zero on create = true 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: filestore ondisk finisher threads = 3 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: filestore apply finisher threads = 3 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: bdev debug aio = true 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: osd debug misdirected ops = true 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: bluestore block size = 96636764160 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: bluestore compression algorithm = snappy 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: bluestore compression mode = aggressive 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: bluestore fsck on mount = True 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: bluestore zero block detection = True 2026-02-17T05:45:31.284 INFO:teuthology.orchestra.run.trial160.stdout: debug bluefs = 20 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: debug bluestore = 20 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: debug ms = 1 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: debug osd = 20 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: debug rocksdb = 10 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: mon max pg per osd = 2 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: mon osd full ratio = 0.9 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: mon osd nearfull ratio = 0.8 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: osd debug verify cached snaps = True 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: osd debug verify missing on start = True 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: osd failsafe full ratio = 0.95 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: osd max pg per osd hard ratio = 1 2026-02-17T05:45:31.285 INFO:teuthology.orchestra.run.trial160.stdout: osd mclock override recovery settings = True 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: osd objectstore = bluestore 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: osd op queue = debug_random 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: osd op queue cut off = debug_random 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout:[mgr] 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: debug ms = 1 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: debug mgr = 20 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: debug mon = 20 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: debug auth = 20 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min pgs per osd = 4 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min bytes per osd = 10 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: mgr/telemetry/nag = false 2026-02-17T05:45:31.286 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout:[mon] 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: debug ms = 1 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: debug mon = 20 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: debug paxos = 20 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: debug auth = 20 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: mon data avail warn = 5 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: mon mgr mkfs grace = 240 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min pgs per osd = 4 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: mon osd reporter subtree level = osd 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: mon osd prime pg temp = true 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: mon reweight min bytes per osd = 10 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.287 INFO:teuthology.orchestra.run.trial160.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: # 1m isn't quite enough 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: mon_down_mkfs_grace = 2m 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: mon_warn_on_filestore_osds = false 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: mon scrub interval = 300 2026-02-17T05:45:31.288 INFO:teuthology.orchestra.run.trial160.stdout: osd pool default size = 2 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout:[client] 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout: rgw cache enabled = true 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout: rgw enable ops log = true 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout: rgw enable usage log = true 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T05:45:31.289 INFO:teuthology.orchestra.run.trial160.stdout:[mon.a] 2026-02-17T05:45:31.290 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T05:45:31.291 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T05:45:31.371 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T05:45:31.372 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:31.372 DEBUG:teuthology.orchestra.run.trial160:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T05:45:31.428 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:31.429 DEBUG:teuthology.orchestra.run.trial160:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T05:45:31.486 INFO:tasks.ceph:Sending monmap to node ubuntu@trial160.front.sepia.ceph.com 2026-02-17T05:45:31.486 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:31.486 DEBUG:teuthology.orchestra.run.trial160:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T05:45:31.486 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T05:45:31.558 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:31.558 DEBUG:teuthology.orchestra.run.trial160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:45:31.615 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T05:45:31.615 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T05:45:31.615 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T05:45:31.700 INFO:teuthology.orchestra.run.trial160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T05:45:31.702 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T05:45:31.703 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T05:45:31.703 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T05:45:31.703 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}} 2026-02-17T05:45:31.703 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T05:45:31.727 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-17T05:45:31.727 INFO:tasks.ceph:role: osd.0 2026-02-17T05:45:31.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial160.front.sepia.ceph.com 2026-02-17T05:45:31.727 DEBUG:teuthology.orchestra.run.trial160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:45:31.794 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:45:31.795 INFO:teuthology.orchestra.run.trial160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:45:32.367 INFO:teuthology.orchestra.run.trial160.stdout:Discarding blocks...Done. 2026-02-17T05:45:32.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial160.front.sepia.ceph.com -o noatime 2026-02-17T05:45:32.369 DEBUG:teuthology.orchestra.run.trial160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T05:45:32.437 DEBUG:teuthology.orchestra.run.trial160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T05:45:32.504 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T05:45:32.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-17T05:45:32.568 INFO:tasks.ceph:role: osd.1 2026-02-17T05:45:32.569 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial160.front.sepia.ceph.com 2026-02-17T05:45:32.569 DEBUG:teuthology.orchestra.run.trial160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T05:45:32.633 INFO:teuthology.orchestra.run.trial160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T05:45:32.633 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T05:45:32.633 INFO:teuthology.orchestra.run.trial160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T05:45:32.633 INFO:teuthology.orchestra.run.trial160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T05:45:32.634 INFO:teuthology.orchestra.run.trial160.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T05:45:32.634 INFO:teuthology.orchestra.run.trial160.stdout: = sunit=0 swidth=0 blks 2026-02-17T05:45:32.634 INFO:teuthology.orchestra.run.trial160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T05:45:32.634 INFO:teuthology.orchestra.run.trial160.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T05:45:32.634 INFO:teuthology.orchestra.run.trial160.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T05:45:32.634 INFO:teuthology.orchestra.run.trial160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T05:45:33.192 INFO:teuthology.orchestra.run.trial160.stdout:Discarding blocks...Done. 2026-02-17T05:45:33.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial160.front.sepia.ceph.com -o noatime 2026-02-17T05:45:33.194 DEBUG:teuthology.orchestra.run.trial160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T05:45:33.262 DEBUG:teuthology.orchestra.run.trial160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T05:45:33.330 DEBUG:teuthology.orchestra.run.trial160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:45:33.411 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:33.408+0000 7efca2e25780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T05:45:33.411 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:33.409+0000 7efca2e25780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T05:45:33.412 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:33.409+0000 7efca2e25780 -1 bdev(0x56082990f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T05:45:33.412 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:33.409+0000 7efca2e25780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T05:45:36.323 DEBUG:teuthology.orchestra.run.trial160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T05:45:36.388 DEBUG:teuthology.orchestra.run.trial160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:45:36.465 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:36.463+0000 7fb8b8f91780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T05:45:36.466 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:36.463+0000 7fb8b8f91780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T05:45:36.466 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:36.463+0000 7fb8b8f91780 -1 bdev(0x558baadcb800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T05:45:36.466 INFO:teuthology.orchestra.run.trial160.stderr:2026-02-17T05:45:36.463+0000 7fb8b8f91780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T05:45:39.376 DEBUG:teuthology.orchestra.run.trial160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T05:45:39.443 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T05:45:39.443 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:39.443 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T05:45:39.506 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:39.506 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T05:45:39.570 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:39.571 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T05:45:39.637 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T05:45:39.637 DEBUG:teuthology.orchestra.run.trial160:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T05:45:39.701 INFO:teuthology.orchestra.run.trial160.stdout:[mgr.x] 2026-02-17T05:45:39.701 INFO:teuthology.orchestra.run.trial160.stdout: key = AQB7AJRpZzyvKRAAbpATyPMroEMdbqQroM7mOg== 2026-02-17T05:45:39.701 INFO:teuthology.orchestra.run.trial160.stdout:[osd.0] 2026-02-17T05:45:39.701 INFO:teuthology.orchestra.run.trial160.stdout: key = AQB9AJRpvpNyGBAAfhTUdHtUMYmr3izJg4vDrQ== 2026-02-17T05:45:39.701 INFO:teuthology.orchestra.run.trial160.stdout:[osd.1] 2026-02-17T05:45:39.701 INFO:teuthology.orchestra.run.trial160.stdout: key = AQCAAJRptEm0GxAAQzW/blPsFgvd7D1q2dhAJg== 2026-02-17T05:45:39.703 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T05:45:39.783 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:45:39.863 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T05:45:39.941 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T05:45:39.941 DEBUG:teuthology.orchestra.run.trial160:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T05:45:40.004 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T05:45:40.089 DEBUG:teuthology.orchestra.run.trial160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T05:45:40.153 DEBUG:teuthology.orchestra.run.trial160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T05:45:40.209 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T05:45:40.210 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T05:45:40.210 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T05:45:40.251 INFO:tasks.ceph.mon.a:Started 2026-02-17T05:45:40.252 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T05:45:40.357 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T05:45:40.358 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T05:45:40.358 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T05:45:40.359 INFO:tasks.ceph.mgr.x:Started 2026-02-17T05:45:40.359 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T05:45:40.359 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T05:45:40.459 INFO:teuthology.orchestra.run.trial160.stderr:adjusted tunables profile to default 2026-02-17T05:45:40.467 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T05:45:40.467 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T05:45:40.467 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:40.467 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T05:45:40.490 DEBUG:teuthology.orchestra.run.trial160:> set -ex 2026-02-17T05:45:40.490 DEBUG:teuthology.orchestra.run.trial160:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T05:45:40.554 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph osd new 626a4f4a-3188-484a-83a0-4048d65876d4 0 2026-02-17T05:45:40.698 INFO:teuthology.orchestra.run.trial160.stdout:0 2026-02-17T05:45:40.706 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph osd new 7ced4839-c92d-4a3a-a75d-fb59541cbd2b 1 2026-02-17T05:45:40.763 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:40.761+0000 7fa7a3e0e140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T05:45:40.809 INFO:teuthology.orchestra.run.trial160.stdout:1 2026-02-17T05:45:40.817 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T05:45:40.818 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T05:45:40.820 INFO:tasks.ceph.osd.0:Started 2026-02-17T05:45:40.820 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T05:45:40.820 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T05:45:40.822 INFO:tasks.ceph.osd.1:Started 2026-02-17T05:45:40.823 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:45:40.887 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:40.885+0000 7fa7a3e0e140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T05:45:40.914 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:40.912+0000 7fa7a3e0e140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T05:45:40.921 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:40.921 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":4,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:45:40.808667+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:45:40.928 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T05:45:40.928 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T05:45:40.947 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:40.945+0000 7fa7a3e0e140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T05:45:40.970 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:40.968+0000 7fa7a3e0e140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T05:45:40.996 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:40.994+0000 7fa7a3e0e140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T05:45:41.051 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.049+0000 7fa7a3e0e140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T05:45:41.112 INFO:tasks.ceph.mgr.x.trial160.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T05:45:41.112 INFO:tasks.ceph.mgr.x.trial160.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T05:45:41.112 INFO:tasks.ceph.mgr.x.trial160.stderr: from numpy import show_config as show_numpy_config 2026-02-17T05:45:41.115 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.113+0000 7fa7a3e0e140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T05:45:41.129 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T05:45:41.140 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.138+0000 7fa7a3e0e140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T05:45:41.195 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.193+0000 7fa7a3e0e140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T05:45:41.223 INFO:teuthology.misc.health.trial160.stdout: 2026-02-17T05:45:41.224 INFO:teuthology.misc.health.trial160.stdout:{"epoch":4,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:45:40.808667+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:45:41.230 DEBUG:teuthology.misc:0 of 2 OSDs are up 2026-02-17T05:45:41.237 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.236+0000 7fa7a3e0e140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T05:45:41.263 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.261+0000 7fa7a3e0e140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T05:45:41.287 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.285+0000 7fa7a3e0e140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T05:45:41.312 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.310+0000 7fa7a3e0e140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T05:45:41.334 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.332+0000 7fa7a3e0e140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T05:45:41.528 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.526+0000 7fa7a3e0e140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T05:45:41.582 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.580+0000 7fa7a3e0e140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T05:45:41.604 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.602+0000 7fa7a3e0e140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T05:45:41.626 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.625+0000 7fa7a3e0e140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T05:45:41.679 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.677+0000 7fa7a3e0e140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T05:45:41.699 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.697+0000 7fa7a3e0e140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T05:45:41.750 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:41.748+0000 7fa7a3e0e140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T05:45:42.155 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:42.153+0000 7fa7a3e0e140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T05:45:42.177 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:42.175+0000 7fa7a3e0e140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T05:45:42.267 INFO:tasks.ceph.osd.1.trial160.stderr:2026-02-17T05:45:42.265+0000 7f5ae2c1c780 -1 Falling back to public interface 2026-02-17T05:45:42.500 INFO:tasks.ceph.osd.0.trial160.stderr:2026-02-17T05:45:42.498+0000 7f9116920780 -1 Falling back to public interface 2026-02-17T05:45:42.514 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:42.513+0000 7fa7a3e0e140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T05:45:43.521 INFO:tasks.ceph.mgr.x.trial160.stderr:2026-02-17T05:45:43.519+0000 7fa6c082d640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T05:45:46.229 INFO:tasks.ceph.osd.0.trial160.stderr:2026-02-17T05:45:46.227+0000 7f9116920780 -1 osd.0 0 log_to_monitors true 2026-02-17T05:45:46.273 INFO:tasks.ceph.osd.1.trial160.stderr:2026-02-17T05:45:46.271+0000 7f5ae2c1c780 -1 osd.1 0 log_to_monitors true 2026-02-17T05:45:47.432 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T05:45:47.528 INFO:tasks.ceph.osd.1.trial160.stderr:2026-02-17T05:45:47.526+0000 7f5ade576640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T05:45:47.549 INFO:tasks.ceph.osd.1.trial160.stderr:2026-02-17T05:45:47.547+0000 7f5ada3a0640 -1 osd.1 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:45:47.586 INFO:teuthology.misc.health.trial160.stdout: 2026-02-17T05:45:47.587 INFO:teuthology.misc.health.trial160.stdout:{"epoch":6,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:45:47.523917+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:45:47.595 DEBUG:teuthology.misc:0 of 2 OSDs are up 2026-02-17T05:45:47.805 INFO:tasks.ceph.osd.0.trial160.stderr:2026-02-17T05:45:47.803+0000 7f91128af640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T05:45:47.815 INFO:tasks.ceph.osd.0.trial160.stderr:2026-02-17T05:45:47.813+0000 7f910a6d1640 -1 osd.0 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T05:45:53.797 DEBUG:teuthology.orchestra.run.trial160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T05:45:53.951 INFO:teuthology.misc.health.trial160.stdout: 2026-02-17T05:45:53.952 INFO:teuthology.misc.health.trial160.stdout:{"epoch":7,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:45:48.526168+0000","last_up_change":"2026-02-17T05:45:48.526168+0000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6809","nonce":744205762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6811","nonce":744205762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6814","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6815","nonce":744205762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6812","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6813","nonce":744205762}]},"public_addr":"10.20.193.160:6809/744205762","cluster_addr":"10.20.193.160:6811/744205762","heartbeat_back_addr":"10.20.193.160:6815/744205762","heartbeat_front_addr":"10.20.193.160:6813/744205762","state":["exists","up"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6801","nonce":3458853929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6802","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6803","nonce":3458853929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6806","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6807","nonce":3458853929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6805","nonce":3458853929}]},"public_addr":"10.20.193.160:6801/3458853929","cluster_addr":"10.20.193.160:6803/3458853929","heartbeat_back_addr":"10.20.193.160:6807/3458853929","heartbeat_front_addr":"10.20.193.160:6805/3458853929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:45:53.959 DEBUG:teuthology.misc:2 of 2 OSDs are up 2026-02-17T05:45:53.959 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T05:45:53.959 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T05:45:53.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T05:45:53.960 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T05:45:53.960 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T05:45:54.142 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:54.151 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6816","nonce":1134290603},{"type":"v1","addr":"10.20.193.160:6817","nonce":1134290603}]},"active_addr":"10.20.193.160:6817/1134290603","active_change":"2026-02-17T05:45:42.515325+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.160:0","nonce":3534778574}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.160:0","nonce":2423692359}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.160:0","nonce":2532682704}]}]} 2026-02-17T05:45:54.155 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T05:45:54.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T05:45:54.155 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:45:54.311 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:54.312 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":7,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:45:48.526168+0000","last_up_change":"2026-02-17T05:45:48.526168+0000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6809","nonce":744205762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6811","nonce":744205762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6814","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6815","nonce":744205762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6812","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6813","nonce":744205762}]},"public_addr":"10.20.193.160:6809/744205762","cluster_addr":"10.20.193.160:6811/744205762","heartbeat_back_addr":"10.20.193.160:6815/744205762","heartbeat_front_addr":"10.20.193.160:6813/744205762","state":["exists","up"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6801","nonce":3458853929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6802","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6803","nonce":3458853929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6806","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6807","nonce":3458853929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6805","nonce":3458853929}]},"public_addr":"10.20.193.160:6801/3458853929","cluster_addr":"10.20.193.160:6803/3458853929","heartbeat_back_addr":"10.20.193.160:6807/3458853929","heartbeat_front_addr":"10.20.193.160:6805/3458853929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:45:54.320 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T05:45:54.320 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:45:54.482 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:54.482 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":7,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:45:48.526168+0000","last_up_change":"2026-02-17T05:45:48.526168+0000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6809","nonce":744205762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6811","nonce":744205762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6814","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6815","nonce":744205762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6812","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6813","nonce":744205762}]},"public_addr":"10.20.193.160:6809/744205762","cluster_addr":"10.20.193.160:6811/744205762","heartbeat_back_addr":"10.20.193.160:6815/744205762","heartbeat_front_addr":"10.20.193.160:6813/744205762","state":["exists","up"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6801","nonce":3458853929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6802","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6803","nonce":3458853929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6806","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6807","nonce":3458853929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6805","nonce":3458853929}]},"public_addr":"10.20.193.160:6801/3458853929","cluster_addr":"10.20.193.160:6803/3458853929","heartbeat_back_addr":"10.20.193.160:6807/3458853929","heartbeat_front_addr":"10.20.193.160:6805/3458853929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:45:54.490 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:45:54.490 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:45:54.575 INFO:teuthology.orchestra.run.trial160.stdout:30064771077 2026-02-17T05:45:54.575 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:45:54.576 INFO:teuthology.orchestra.run.trial160.stdout:30064771077 2026-02-17T05:45:54.577 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:45:54.773 INFO:teuthology.orchestra.run.trial160.stdout:30064771075 2026-02-17T05:45:54.778 INFO:teuthology.orchestra.run.trial160.stdout:30064771075 2026-02-17T05:45:54.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771075 for osd.0 2026-02-17T05:45:54.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771075 for osd.1 2026-02-17T05:45:55.783 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:45:55.789 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:45:55.945 INFO:teuthology.orchestra.run.trial160.stdout:30064771075 2026-02-17T05:45:55.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771075 for osd.0 2026-02-17T05:45:55.987 INFO:teuthology.orchestra.run.trial160.stdout:30064771075 2026-02-17T05:45:55.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771075 for osd.1 2026-02-17T05:45:56.956 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:45:56.997 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:45:57.116 INFO:teuthology.orchestra.run.trial160.stdout:30064771077 2026-02-17T05:45:57.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771077 for osd.0 2026-02-17T05:45:57.126 DEBUG:teuthology.parallel:result is None 2026-02-17T05:45:57.157 INFO:teuthology.orchestra.run.trial160.stdout:30064771077 2026-02-17T05:45:57.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771077 for osd.1 2026-02-17T05:45:57.167 DEBUG:teuthology.parallel:result is None 2026-02-17T05:45:57.167 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T05:45:57.167 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:45:57.361 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:57.362 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:45:57.369 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2026-02-17T05:45:56.519179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":188743680,"kb_used":54056,"kb_used_data":128,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689624,"statfs":{"total":193273528320,"available":193218174976,"internally_reserved":0,"allocated":131072,"data_stored":24510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":64,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":65536,"data_stored":12255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":64,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":65536,"data_stored":12255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T05:45:57.370 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:45:57.529 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:57.530 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:45:57.537 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2026-02-17T05:45:56.519179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":188743680,"kb_used":54056,"kb_used_data":128,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689624,"statfs":{"total":193273528320,"available":193218174976,"internally_reserved":0,"allocated":131072,"data_stored":24510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":64,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":65536,"data_stored":12255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":64,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":65536,"data_stored":12255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T05:45:57.537 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T05:45:57.538 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T05:45:57.538 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T05:45:57.538 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T05:45:57.713 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:45:57.713 INFO:teuthology.orchestra.run.trial160.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T05:45:57.721 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T05:45:57.721 INFO:teuthology.run_tasks:Running task osd_max_pg_per_osd... 2026-02-17T05:45:57.734 INFO:tasks.osd_max_pg_per_osd:1. creating pool.a 2026-02-17T05:45:57.734 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-17T05:45:57.734 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 2 2026-02-17T05:45:58.541 INFO:teuthology.orchestra.run.trial160.stderr:pool 'unique_pool_0' created 2026-02-17T05:45:58.552 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-17T05:45:59.544 INFO:teuthology.orchestra.run.trial160.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T05:46:00.558 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:46:00.720 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:00.720 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":10,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:46:00.544269+0000","last_up_change":"2026-02-17T05:45:48.526168+0000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T05:45:57.900175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":2,"pg_placement_num":2,"pg_placement_num_target":2,"pg_num_target":2,"pg_num_pending":2,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6809","nonce":744205762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6811","nonce":744205762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6814","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6815","nonce":744205762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6812","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6813","nonce":744205762}]},"public_addr":"10.20.193.160:6809/744205762","cluster_addr":"10.20.193.160:6811/744205762","heartbeat_back_addr":"10.20.193.160:6815/744205762","heartbeat_front_addr":"10.20.193.160:6813/744205762","state":["exists","up"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6801","nonce":3458853929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6802","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6803","nonce":3458853929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6806","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6807","nonce":3458853929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6805","nonce":3458853929}]},"public_addr":"10.20.193.160:6801/3458853929","cluster_addr":"10.20.193.160:6803/3458853929","heartbeat_back_addr":"10.20.193.160:6807/3458853929","heartbeat_front_addr":"10.20.193.160:6805/3458853929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.269886+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.279480+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:46:00.729 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:46:00.730 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:46:00.816 INFO:teuthology.orchestra.run.trial160.stdout:30064771079 2026-02-17T05:46:00.816 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:00.818 INFO:teuthology.orchestra.run.trial160.stdout:30064771079 2026-02-17T05:46:00.818 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:01.015 INFO:teuthology.orchestra.run.trial160.stdout:30064771078 2026-02-17T05:46:01.017 INFO:teuthology.orchestra.run.trial160.stdout:30064771078 2026-02-17T05:46:01.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771079 got 30064771078 for osd.1 2026-02-17T05:46:01.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771079 got 30064771078 for osd.0 2026-02-17T05:46:02.024 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:02.028 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:02.187 INFO:teuthology.orchestra.run.trial160.stdout:30064771078 2026-02-17T05:46:02.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771079 got 30064771078 for osd.1 2026-02-17T05:46:02.229 INFO:teuthology.orchestra.run.trial160.stdout:30064771078 2026-02-17T05:46:02.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771079 got 30064771078 for osd.0 2026-02-17T05:46:03.198 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:03.239 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:03.355 INFO:teuthology.orchestra.run.trial160.stdout:30064771079 2026-02-17T05:46:03.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771079 got 30064771079 for osd.1 2026-02-17T05:46:03.365 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:03.404 INFO:teuthology.orchestra.run.trial160.stdout:30064771079 2026-02-17T05:46:03.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771079 got 30064771079 for osd.0 2026-02-17T05:46:03.414 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:03.414 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:03.612 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:03.612 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:03.621 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T05:46:02.519851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54096,"kb_used_data":160,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689584,"statfs":{"total":193273528320,"available":193218134016,"internally_reserved":0,"allocated":163840,"data_stored":35468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":10,"state":"active+clean","last_fresh":"2026-02-17T05:46:00.731832+0000","last_change":"2026-02-17T05:45:59.547431+0000","last_active":"2026-02-17T05:46:00.731832+0000","last_peered":"2026-02-17T05:46:00.731832+0000","last_clean":"2026-02-17T05:46:00.731832+0000","last_became_active":"2026-02-17T05:45:59.547294+0000","last_became_peered":"2026-02-17T05:45:59.547294+0000","last_unstale":"2026-02-17T05:46:00.731832+0000","last_undegraded":"2026-02-17T05:46:00.731832+0000","last_fullsized":"2026-02-17T05:46:00.731832+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:12:06.746344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":10,"state":"active+clean","last_fresh":"2026-02-17T05:46:00.547729+0000","last_change":"2026-02-17T05:45:59.547132+0000","last_active":"2026-02-17T05:46:00.547729+0000","last_peered":"2026-02-17T05:46:00.547729+0000","last_clean":"2026-02-17T05:46:00.547729+0000","last_became_active":"2026-02-17T05:45:59.546872+0000","last_became_peered":"2026-02-17T05:45:59.546872+0000","last_unstale":"2026-02-17T05:46:00.547729+0000","last_undegraded":"2026-02-17T05:46:00.547729+0000","last_fullsized":"2026-02-17T05:46:00.547729+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:49.683836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27048,"kb_used_data":80,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344792,"statfs":{"total":96636764160,"available":96609067008,"internally_reserved":0,"allocated":81920,"data_stored":17734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27048,"kb_used_data":80,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344792,"statfs":{"total":96636764160,"available":96609067008,"internally_reserved":0,"allocated":81920,"data_stored":17734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:09.623 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:46:09.624 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:46:09.712 INFO:teuthology.orchestra.run.trial160.stdout:30064771082 2026-02-17T05:46:09.713 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:09.714 INFO:teuthology.orchestra.run.trial160.stdout:30064771082 2026-02-17T05:46:09.714 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:09.907 INFO:teuthology.orchestra.run.trial160.stdout:30064771080 2026-02-17T05:46:09.910 INFO:teuthology.orchestra.run.trial160.stdout:30064771080 2026-02-17T05:46:09.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771082 got 30064771080 for osd.1 2026-02-17T05:46:09.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771082 got 30064771080 for osd.0 2026-02-17T05:46:10.917 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:10.919 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:11.078 INFO:teuthology.orchestra.run.trial160.stdout:30064771082 2026-02-17T05:46:11.079 INFO:teuthology.orchestra.run.trial160.stdout:30064771082 2026-02-17T05:46:11.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771082 got 30064771082 for osd.0 2026-02-17T05:46:11.088 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:11.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771082 got 30064771082 for osd.1 2026-02-17T05:46:11.089 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:11.089 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:11.284 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:11.284 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:11.292 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-17T05:46:10.520730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54112,"kb_used_data":176,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689568,"statfs":{"total":193273528320,"available":193218117632,"internally_reserved":0,"allocated":180224,"data_stored":40812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":10,"state":"active+clean","last_fresh":"2026-02-17T05:46:00.731832+0000","last_change":"2026-02-17T05:45:59.547431+0000","last_active":"2026-02-17T05:46:00.731832+0000","last_peered":"2026-02-17T05:46:00.731832+0000","last_clean":"2026-02-17T05:46:00.731832+0000","last_became_active":"2026-02-17T05:45:59.547294+0000","last_became_peered":"2026-02-17T05:45:59.547294+0000","last_unstale":"2026-02-17T05:46:00.731832+0000","last_undegraded":"2026-02-17T05:46:00.731832+0000","last_fullsized":"2026-02-17T05:46:00.731832+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:12:06.746344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":10,"state":"active+clean","last_fresh":"2026-02-17T05:46:00.547729+0000","last_change":"2026-02-17T05:45:59.547132+0000","last_active":"2026-02-17T05:46:00.547729+0000","last_peered":"2026-02-17T05:46:00.547729+0000","last_clean":"2026-02-17T05:46:00.547729+0000","last_became_active":"2026-02-17T05:45:59.546872+0000","last_became_peered":"2026-02-17T05:45:59.546872+0000","last_unstale":"2026-02-17T05:46:00.547729+0000","last_undegraded":"2026-02-17T05:46:00.547729+0000","last_fullsized":"2026-02-17T05:46:00.547729+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:49.683836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771082,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27060,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344780,"statfs":{"total":96636764160,"available":96609054720,"internally_reserved":0,"allocated":90112,"data_stored":20406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771082,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":20406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:11.293 INFO:tasks.osd_max_pg_per_osd:2. creating pool.b 2026-02-17T05:46:11.293 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-17T05:46:11.293 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 2 2026-02-17T05:46:11.558 INFO:teuthology.orchestra.run.trial160.stderr:pool 'unique_pool_1' created 2026-02-17T05:46:11.568 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-17T05:46:12.559 INFO:teuthology.orchestra.run.trial160.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-17T05:46:13.569 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:46:13.732 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:13.732 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":12,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:46:12.557451+0000","last_up_change":"2026-02-17T05:45:48.526168+0000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T05:45:57.900175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":2,"pg_placement_num":2,"pg_placement_num_target":2,"pg_num_target":2,"pg_num_pending":2,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"unique_pool_1","create_time":"2026-02-17T05:46:11.458119+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":2,"pg_placement_num":2,"pg_placement_num_target":2,"pg_num_target":2,"pg_num_pending":2,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6809","nonce":744205762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6811","nonce":744205762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6814","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6815","nonce":744205762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6812","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6813","nonce":744205762}]},"public_addr":"10.20.193.160:6809/744205762","cluster_addr":"10.20.193.160:6811/744205762","heartbeat_back_addr":"10.20.193.160:6815/744205762","heartbeat_front_addr":"10.20.193.160:6813/744205762","state":["exists","up"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6801","nonce":3458853929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6802","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6803","nonce":3458853929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6806","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6807","nonce":3458853929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6805","nonce":3458853929}]},"public_addr":"10.20.193.160:6801/3458853929","cluster_addr":"10.20.193.160:6803/3458853929","heartbeat_back_addr":"10.20.193.160:6807/3458853929","heartbeat_front_addr":"10.20.193.160:6805/3458853929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.269886+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.279480+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:46:13.741 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:46:13.742 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:46:13.827 INFO:teuthology.orchestra.run.trial160.stdout:30064771083 2026-02-17T05:46:13.828 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:13.829 INFO:teuthology.orchestra.run.trial160.stdout:30064771083 2026-02-17T05:46:13.830 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:14.027 INFO:teuthology.orchestra.run.trial160.stdout:30064771082 2026-02-17T05:46:14.033 INFO:teuthology.orchestra.run.trial160.stdout:30064771082 2026-02-17T05:46:14.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771083 got 30064771082 for osd.0 2026-02-17T05:46:14.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771083 got 30064771082 for osd.1 2026-02-17T05:46:15.037 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:15.043 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:15.202 INFO:teuthology.orchestra.run.trial160.stdout:30064771083 2026-02-17T05:46:15.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771083 got 30064771083 for osd.0 2026-02-17T05:46:15.212 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:15.239 INFO:teuthology.orchestra.run.trial160.stdout:30064771083 2026-02-17T05:46:15.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771083 got 30064771083 for osd.1 2026-02-17T05:46:15.248 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:15.248 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:15.443 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:15.443 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:15.451 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-17T05:46:14.521295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54132,"kb_used_data":200,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689548,"statfs":{"total":193273528320,"available":193218097152,"internally_reserved":0,"allocated":204800,"data_stored":49961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T05:46:11.554203+0000","last_change":"2026-02-17T05:46:11.554203+0000","last_active":"2026-02-17T05:46:11.554203+0000","last_peered":"2026-02-17T05:46:11.554203+0000","last_clean":"2026-02-17T05:46:11.554203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T05:46:11.554203+0000","last_undegraded":"2026-02-17T05:46:11.554203+0000","last_fullsized":"2026-02-17T05:46:11.554203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T05:46:11.554203+0000","last_change":"2026-02-17T05:46:11.554203+0000","last_active":"2026-02-17T05:46:11.554203+0000","last_peered":"2026-02-17T05:46:11.554203+0000","last_clean":"2026-02-17T05:46:11.554203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T05:46:11.554203+0000","last_undegraded":"2026-02-17T05:46:11.554203+0000","last_fullsized":"2026-02-17T05:46:11.554203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T05:46:13.151841+0000","last_change":"2026-02-17T05:45:59.547431+0000","last_active":"2026-02-17T05:46:13.151841+0000","last_peered":"2026-02-17T05:46:13.151841+0000","last_clean":"2026-02-17T05:46:13.151841+0000","last_became_active":"2026-02-17T05:45:59.547294+0000","last_became_peered":"2026-02-17T05:45:59.547294+0000","last_unstale":"2026-02-17T05:46:13.151841+0000","last_undegraded":"2026-02-17T05:46:13.151841+0000","last_fullsized":"2026-02-17T05:46:13.151841+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:12:06.746344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T05:46:12.560088+0000","last_change":"2026-02-17T05:45:59.547132+0000","last_active":"2026-02-17T05:46:12.560088+0000","last_peered":"2026-02-17T05:46:12.560088+0000","last_clean":"2026-02-17T05:46:12.560088+0000","last_became_active":"2026-02-17T05:45:59.546872+0000","last_became_peered":"2026-02-17T05:45:59.546872+0000","last_unstale":"2026-02-17T05:46:12.560088+0000","last_undegraded":"2026-02-17T05:46:12.560088+0000","last_fullsized":"2026-02-17T05:46:12.560088+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:49.683836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344768,"statfs":{"total":96636764160,"available":96609042432,"internally_reserved":0,"allocated":106496,"data_stored":26499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27060,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344780,"statfs":{"total":96636764160,"available":96609054720,"internally_reserved":0,"allocated":98304,"data_stored":23462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:21.453 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:46:21.453 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:46:21.541 INFO:teuthology.orchestra.run.trial160.stdout:30064771086 2026-02-17T05:46:21.541 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:21.542 INFO:teuthology.orchestra.run.trial160.stdout:30064771086 2026-02-17T05:46:21.543 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:21.739 INFO:teuthology.orchestra.run.trial160.stdout:30064771085 2026-02-17T05:46:21.741 INFO:teuthology.orchestra.run.trial160.stdout:30064771085 2026-02-17T05:46:21.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771086 got 30064771085 for osd.0 2026-02-17T05:46:21.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771086 got 30064771085 for osd.1 2026-02-17T05:46:22.750 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:22.752 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:22.909 INFO:teuthology.orchestra.run.trial160.stdout:30064771086 2026-02-17T05:46:22.911 INFO:teuthology.orchestra.run.trial160.stdout:30064771086 2026-02-17T05:46:22.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771086 got 30064771086 for osd.1 2026-02-17T05:46:22.919 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:22.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771086 got 30064771086 for osd.0 2026-02-17T05:46:22.921 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:22.921 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:23.118 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:23.119 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:23.127 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-17T05:46:22.522077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54140,"kb_used_data":208,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689540,"statfs":{"total":193273528320,"available":193218088960,"internally_reserved":0,"allocated":212992,"data_stored":52998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T05:46:11.554203+0000","last_change":"2026-02-17T05:46:11.554203+0000","last_active":"2026-02-17T05:46:11.554203+0000","last_peered":"2026-02-17T05:46:11.554203+0000","last_clean":"2026-02-17T05:46:11.554203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T05:46:11.554203+0000","last_undegraded":"2026-02-17T05:46:11.554203+0000","last_fullsized":"2026-02-17T05:46:11.554203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T05:46:11.554203+0000","last_change":"2026-02-17T05:46:11.554203+0000","last_active":"2026-02-17T05:46:11.554203+0000","last_peered":"2026-02-17T05:46:11.554203+0000","last_clean":"2026-02-17T05:46:11.554203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T05:46:11.554203+0000","last_undegraded":"2026-02-17T05:46:11.554203+0000","last_fullsized":"2026-02-17T05:46:11.554203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T05:46:13.151841+0000","last_change":"2026-02-17T05:45:59.547431+0000","last_active":"2026-02-17T05:46:13.151841+0000","last_peered":"2026-02-17T05:46:13.151841+0000","last_clean":"2026-02-17T05:46:13.151841+0000","last_became_active":"2026-02-17T05:45:59.547294+0000","last_became_peered":"2026-02-17T05:45:59.547294+0000","last_unstale":"2026-02-17T05:46:13.151841+0000","last_undegraded":"2026-02-17T05:46:13.151841+0000","last_fullsized":"2026-02-17T05:46:13.151841+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:12:06.746344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T05:46:12.560088+0000","last_change":"2026-02-17T05:45:59.547132+0000","last_active":"2026-02-17T05:46:12.560088+0000","last_peered":"2026-02-17T05:46:12.560088+0000","last_clean":"2026-02-17T05:46:12.560088+0000","last_became_active":"2026-02-17T05:45:59.546872+0000","last_became_peered":"2026-02-17T05:45:59.546872+0000","last_unstale":"2026-02-17T05:46:12.560088+0000","last_undegraded":"2026-02-17T05:46:12.560088+0000","last_fullsized":"2026-02-17T05:46:12.560088+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:45:58.538882+0000","last_clean_scrub_stamp":"2026-02-17T05:45:58.538882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:49.683836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771086,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344768,"statfs":{"total":96636764160,"available":96609042432,"internally_reserved":0,"allocated":106496,"data_stored":26499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771086,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344772,"statfs":{"total":96636764160,"available":96609046528,"internally_reserved":0,"allocated":106496,"data_stored":26499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:23.128 INFO:tasks.osd_max_pg_per_osd:3. removing pool.a 2026-02-17T05:46:23.128 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-17T05:46:23.129 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-17T05:46:23.565 INFO:teuthology.orchestra.run.trial160.stderr:pool 'unique_pool_0' removed 2026-02-17T05:46:23.578 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:46:23.735 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:23.735 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":13,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:46:23.563748+0000","last_up_change":"2026-02-17T05:45:48.526168+0000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":2,"pool_name":"unique_pool_1","create_time":"2026-02-17T05:46:11.458119+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":2,"pg_placement_num":2,"pg_placement_num_target":2,"pg_num_target":2,"pg_num_pending":2,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6809","nonce":744205762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6811","nonce":744205762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6814","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6815","nonce":744205762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6812","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6813","nonce":744205762}]},"public_addr":"10.20.193.160:6809/744205762","cluster_addr":"10.20.193.160:6811/744205762","heartbeat_back_addr":"10.20.193.160:6815/744205762","heartbeat_front_addr":"10.20.193.160:6813/744205762","state":["exists","up"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6801","nonce":3458853929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6802","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6803","nonce":3458853929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6806","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6807","nonce":3458853929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6805","nonce":3458853929}]},"public_addr":"10.20.193.160:6801/3458853929","cluster_addr":"10.20.193.160:6803/3458853929","heartbeat_back_addr":"10.20.193.160:6807/3458853929","heartbeat_front_addr":"10.20.193.160:6805/3458853929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.269886+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.279480+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:46:23.744 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:46:23.744 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:46:23.829 INFO:teuthology.orchestra.run.trial160.stdout:30064771087 2026-02-17T05:46:23.830 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:23.833 INFO:teuthology.orchestra.run.trial160.stdout:30064771087 2026-02-17T05:46:23.833 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:24.028 INFO:teuthology.orchestra.run.trial160.stdout:30064771086 2026-02-17T05:46:24.033 INFO:teuthology.orchestra.run.trial160.stdout:30064771086 2026-02-17T05:46:24.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771087 got 30064771086 for osd.1 2026-02-17T05:46:24.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771087 got 30064771086 for osd.0 2026-02-17T05:46:25.038 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:25.043 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:25.200 INFO:teuthology.orchestra.run.trial160.stdout:30064771087 2026-02-17T05:46:25.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771087 got 30064771087 for osd.1 2026-02-17T05:46:25.210 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:25.240 INFO:teuthology.orchestra.run.trial160.stdout:30064771087 2026-02-17T05:46:25.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771087 got 30064771087 for osd.0 2026-02-17T05:46:25.250 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:25.250 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:25.448 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:25.449 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:25.458 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2026-02-17T05:46:24.568950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54160,"kb_used_data":232,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689520,"statfs":{"total":193273528320,"available":193218068480,"internally_reserved":0,"allocated":237568,"data_stored":58408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2026-02-17T05:46:23.925778+0000","last_change":"2026-02-17T05:46:23.925778+0000","last_active":"2026-02-17T05:46:11.554203+0000","last_peered":"2026-02-17T05:46:11.554203+0000","last_clean":"2026-02-17T05:46:11.554203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T05:46:23.925778+0000","last_undegraded":"2026-02-17T05:46:23.925778+0000","last_fullsized":"2026-02-17T05:46:23.925778+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2026-02-17T05:46:24.241482+0000","last_change":"2026-02-17T05:46:24.241482+0000","last_active":"2026-02-17T05:46:11.554203+0000","last_peered":"2026-02-17T05:46:11.554203+0000","last_clean":"2026-02-17T05:46:11.554203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T05:46:24.241482+0000","last_undegraded":"2026-02-17T05:46:24.241482+0000","last_fullsized":"2026-02-17T05:46:24.241482+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":118784,"data_stored":29204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771088,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":118784,"data_stored":29204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:31.460 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:46:31.461 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:46:31.550 INFO:teuthology.orchestra.run.trial160.stdout:30064771090 2026-02-17T05:46:31.550 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:31.551 INFO:teuthology.orchestra.run.trial160.stdout:30064771090 2026-02-17T05:46:31.551 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:31.750 INFO:teuthology.orchestra.run.trial160.stdout:30064771089 2026-02-17T05:46:31.752 INFO:teuthology.orchestra.run.trial160.stdout:30064771089 2026-02-17T05:46:31.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771090 got 30064771089 for osd.0 2026-02-17T05:46:31.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771090 got 30064771089 for osd.1 2026-02-17T05:46:32.760 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:32.762 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:32.917 INFO:teuthology.orchestra.run.trial160.stdout:30064771090 2026-02-17T05:46:32.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771090 got 30064771090 for osd.0 2026-02-17T05:46:32.927 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:32.965 INFO:teuthology.orchestra.run.trial160.stdout:30064771090 2026-02-17T05:46:32.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771090 got 30064771090 for osd.1 2026-02-17T05:46:32.976 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:32.976 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:33.170 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:33.170 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:33.178 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-02-17T05:46:32.523049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54196,"kb_used_data":264,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689484,"statfs":{"total":193273528320,"available":193218031616,"internally_reserved":0,"allocated":270336,"data_stored":68448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T05:46:28.176089+0000","last_change":"2026-02-17T05:46:24.570896+0000","last_active":"2026-02-17T05:46:28.176089+0000","last_peered":"2026-02-17T05:46:28.176089+0000","last_clean":"2026-02-17T05:46:28.176089+0000","last_became_active":"2026-02-17T05:46:24.570784+0000","last_became_peered":"2026-02-17T05:46:24.570784+0000","last_unstale":"2026-02-17T05:46:28.176089+0000","last_undegraded":"2026-02-17T05:46:28.176089+0000","last_fullsized":"2026-02-17T05:46:28.176089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:03:45.715045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T05:46:25.571899+0000","last_change":"2026-02-17T05:46:24.570684+0000","last_active":"2026-02-17T05:46:25.571899+0000","last_peered":"2026-02-17T05:46:25.571899+0000","last_clean":"2026-02-17T05:46:25.571899+0000","last_became_active":"2026-02-17T05:46:24.570554+0000","last_became_peered":"2026-02-17T05:46:24.570554+0000","last_unstale":"2026-02-17T05:46:25.571899+0000","last_undegraded":"2026-02-17T05:46:25.571899+0000","last_fullsized":"2026-02-17T05:46:25.571899+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:20:38.254878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771090,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771090,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:39.180 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T05:46:39.180 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T05:46:39.267 INFO:teuthology.orchestra.run.trial160.stdout:30064771092 2026-02-17T05:46:39.268 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:39.269 INFO:teuthology.orchestra.run.trial160.stdout:30064771092 2026-02-17T05:46:39.269 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:39.466 INFO:teuthology.orchestra.run.trial160.stdout:30064771091 2026-02-17T05:46:39.467 INFO:teuthology.orchestra.run.trial160.stdout:30064771091 2026-02-17T05:46:39.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771092 got 30064771091 for osd.1 2026-02-17T05:46:39.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771092 got 30064771091 for osd.0 2026-02-17T05:46:40.476 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T05:46:40.477 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T05:46:40.634 INFO:teuthology.orchestra.run.trial160.stdout:30064771093 2026-02-17T05:46:40.636 INFO:teuthology.orchestra.run.trial160.stdout:30064771093 2026-02-17T05:46:40.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771092 got 30064771093 for osd.0 2026-02-17T05:46:40.644 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:40.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771092 got 30064771093 for osd.1 2026-02-17T05:46:40.645 DEBUG:teuthology.parallel:result is None 2026-02-17T05:46:40.645 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:40.839 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:40.839 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:40.847 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-17T05:46:40.523838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54196,"kb_used_data":264,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689484,"statfs":{"total":193273528320,"available":193218031616,"internally_reserved":0,"allocated":270336,"data_stored":68448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T05:46:28.176089+0000","last_change":"2026-02-17T05:46:24.570896+0000","last_active":"2026-02-17T05:46:28.176089+0000","last_peered":"2026-02-17T05:46:28.176089+0000","last_clean":"2026-02-17T05:46:28.176089+0000","last_became_active":"2026-02-17T05:46:24.570784+0000","last_became_peered":"2026-02-17T05:46:24.570784+0000","last_unstale":"2026-02-17T05:46:28.176089+0000","last_undegraded":"2026-02-17T05:46:28.176089+0000","last_fullsized":"2026-02-17T05:46:28.176089+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:03:45.715045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T05:46:25.571899+0000","last_change":"2026-02-17T05:46:24.570684+0000","last_active":"2026-02-17T05:46:25.571899+0000","last_peered":"2026-02-17T05:46:25.571899+0000","last_clean":"2026-02-17T05:46:25.571899+0000","last_became_active":"2026-02-17T05:46:24.570554+0000","last_became_peered":"2026-02-17T05:46:24.570554+0000","last_unstale":"2026-02-17T05:46:25.571899+0000","last_undegraded":"2026-02-17T05:46:25.571899+0000","last_fullsized":"2026-02-17T05:46:25.571899+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T05:46:11.554203+0000","last_clean_scrub_stamp":"2026-02-17T05:46:11.554203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:20:38.254878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":2,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T05:46:40.848 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-17T05:46:40.848 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-17T05:46:41.580 INFO:teuthology.orchestra.run.trial160.stderr:pool 'unique_pool_1' removed 2026-02-17T05:46:41.591 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T05:46:41.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T05:46:41.600 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:41.757 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:41.757 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:41.765 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T05:46:41.580105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54196,"kb_used_data":264,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689484,"statfs":{"total":193273528320,"available":193218031616,"internally_reserved":0,"allocated":270336,"data_stored":68448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T05:46:41.765 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:41.919 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:41.919 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:41.927 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T05:46:41.580105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54196,"kb_used_data":264,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689484,"statfs":{"total":193273528320,"available":193218031616,"internally_reserved":0,"allocated":270336,"data_stored":68448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T05:46:41.927 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T05:46:41.927 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:42.084 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:42.084 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:42.093 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T05:46:41.580105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54196,"kb_used_data":264,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689484,"statfs":{"total":193273528320,"available":193218031616,"internally_reserved":0,"allocated":270336,"data_stored":68448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T05:46:42.093 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T05:46:42.253 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:42.253 INFO:teuthology.orchestra.run.trial160.stdout:{"epoch":16,"fsid":"2ad9bd9c-4357-400a-90e9-6d120fce401a","created":"2026-02-17T05:45:40.314340+0000","modified":"2026-02-17T05:46:41.579239+0000","last_up_change":"2026-02-17T05:45:48.526168+0000","last_in_change":"2026-02-17T05:45:40.808667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"626a4f4a-3188-484a-83a0-4048d65876d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6808","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6809","nonce":744205762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6810","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6811","nonce":744205762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6814","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6815","nonce":744205762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6812","nonce":744205762},{"type":"v1","addr":"10.20.193.160:6813","nonce":744205762}]},"public_addr":"10.20.193.160:6809/744205762","cluster_addr":"10.20.193.160:6811/744205762","heartbeat_back_addr":"10.20.193.160:6815/744205762","heartbeat_front_addr":"10.20.193.160:6813/744205762","state":["exists","up"]},{"osd":1,"uuid":"7ced4839-c92d-4a3a-a75d-fb59541cbd2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6800","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6801","nonce":3458853929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6802","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6803","nonce":3458853929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6806","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6807","nonce":3458853929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.160:6804","nonce":3458853929},{"type":"v1","addr":"10.20.193.160:6805","nonce":3458853929}]},"public_addr":"10.20.193.160:6801/3458853929","cluster_addr":"10.20.193.160:6803/3458853929","heartbeat_back_addr":"10.20.193.160:6807/3458853929","heartbeat_front_addr":"10.20.193.160:6805/3458853929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.269886+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T05:45:47.279480+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T05:46:43.263 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T05:46:43.263 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:43.343 INFO:teuthology.orchestra.run.trial160.stdout:{ 2026-02-17T05:46:43.344 INFO:teuthology.orchestra.run.trial160.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:43.344 INFO:teuthology.orchestra.run.trial160.stdout:} 2026-02-17T05:46:43.349 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T05:46:43.506 INFO:teuthology.orchestra.run.trial160.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T05:46:43.515 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T05:46:43.516 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T05:46:43.595 INFO:teuthology.orchestra.run.trial160.stdout:{ 2026-02-17T05:46:43.595 INFO:teuthology.orchestra.run.trial160.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T05:46:43.595 INFO:teuthology.orchestra.run.trial160.stdout:} 2026-02-17T05:46:43.600 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T05:46:43.759 INFO:teuthology.orchestra.run.trial160.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T05:46:43.768 DEBUG:teuthology.orchestra.run.trial160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T05:46:43.921 INFO:teuthology.orchestra.run.trial160.stdout: 2026-02-17T05:46:43.922 INFO:teuthology.orchestra.run.trial160.stderr:dumped all 2026-02-17T05:46:43.929 INFO:teuthology.orchestra.run.trial160.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-02-17T05:46:42.524068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54196,"kb_used_data":264,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689484,"statfs":{"total":193273528320,"available":193218031616,"internally_reserved":0,"allocated":270336,"data_stored":68448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3188,"internal_metadata":55178124},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771093,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27100,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":135168,"data_stored":34224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T05:46:43.929 DEBUG:teuthology.orchestra.run.trial160:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T05:46:44.094 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T05:46:44.094 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T05:46:44.094 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T05:46:44.094 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:46:44.133 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T05:46:44.133 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T05:46:44.133 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:46:44.205 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T05:46:44.205 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T05:46:44.206 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T05:46:44.206 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:46:44.278 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T05:46:44.278 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T05:46:44.278 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T05:46:44.278 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T05:46:44.327 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T05:46:44.328 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T05:46:44.328 DEBUG:teuthology.orchestra.run.trial160:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v '\(PENDING_CREATING_PGS\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(MON_DOWN\)' | head -n 1 2026-02-17T05:46:44.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial160.front.sepia.ceph.com 2026-02-17T05:46:44.395 DEBUG:teuthology.orchestra.run.trial160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T05:46:44.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial160.front.sepia.ceph.com 2026-02-17T05:46:44.462 DEBUG:teuthology.orchestra.run.trial160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T05:46:44.529 INFO:tasks.ceph:Archiving mon data... 2026-02-17T05:46:44.532 DEBUG:teuthology.misc:Transferring archived files from trial160:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51055/data/mon.a.tgz 2026-02-17T05:46:44.533 DEBUG:teuthology.orchestra.run.trial160:> mktemp 2026-02-17T05:46:44.584 INFO:teuthology.orchestra.run.trial160.stdout:/tmp/tmp.kr1I4J4xWO 2026-02-17T05:46:44.584 DEBUG:teuthology.orchestra.run.trial160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kr1I4J4xWO 2026-02-17T05:46:44.664 DEBUG:teuthology.orchestra.run.trial160:> sudo chmod 0666 /tmp/tmp.kr1I4J4xWO 2026-02-17T05:46:44.786 DEBUG:teuthology.orchestra.remote:trial160:/tmp/tmp.kr1I4J4xWO is 132KB 2026-02-17T05:46:44.833 DEBUG:teuthology.orchestra.run.trial160:> rm -fr /tmp/tmp.kr1I4J4xWO 2026-02-17T05:46:44.848 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T05:46:44.849 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T05:46:44.967 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T05:46:44.967 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T05:46:44.970 DEBUG:teuthology.misc:Transferring archived files from trial160:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51055/remote/trial160/crash 2026-02-17T05:46:44.971 DEBUG:teuthology.orchestra.run.trial160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T05:46:45.031 INFO:tasks.ceph:Compressing logs... 2026-02-17T05:46:45.031 DEBUG:teuthology.orchestra.run.trial160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:46:45.094 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2026-02-17T05:46:45.095 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2026-02-17T05:46:45.095 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44078.log 2026-02-17T05:46:45.095 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2026-02-17T05:46:45.095 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46561.log 2026-02-17T05:46:45.095 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2026-02-17T05:46:45.095 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44078.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.44078.log.gz --verbose -- 2026-02-17T05:46:45.095 INFO:teuthology.orchestra.run.trial160.stderr: /var/log/ceph/ceph-mon.a.log 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46561.log.gz 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45434.log 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41607.log 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45434.log.gz 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44767.log 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.41607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44940.log 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41607.log.gz 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44767.log.gz 2026-02-17T05:46:45.096 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T05:46:45.097 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45159.log 2026-02-17T05:46:45.097 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2026-02-17T05:46:45.097 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44500.log 2026-02-17T05:46:45.097 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46044.log 2026-02-17T05:46:45.097 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45159.log.gz 2026-02-17T05:46:45.097 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44500.log.gz 2026-02-17T05:46:45.097 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44326.log 2026-02-17T05:46:45.098 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47514.log 2026-02-17T05:46:45.098 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46044.log.gz 2026-02-17T05:46:45.098 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44326.log.gz 2026-02-17T05:46:45.098 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2026-02-17T05:46:45.098 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47514.log.gz 2026-02-17T05:46:45.098 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47002.log 2026-02-17T05:46:45.099 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43467.log 2026-02-17T05:46:45.099 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2026-02-17T05:46:45.099 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47002.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47002.log.gz /var/log/ceph/ceph-client.admin.44401.log 2026-02-17T05:46:45.099 INFO:teuthology.orchestra.run.trial160.stderr: 2026-02-17T05:46:45.099 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2026-02-17T05:46:45.099 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43467.log.gz 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44401.log.gz 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.41229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44225.log 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45995.log 0.0% 2026-02-17T05:46:45.100 INFO:teuthology.orchestra.run.trial160.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44225.log.gzgzip 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45995.log.gz 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46903.log 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43713.log 2026-02-17T05:46:45.101 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46903.log.gz 2026-02-17T05:46:45.102 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47318.log 2026-02-17T05:46:45.102 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2026-02-17T05:46:45.102 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47122.log 2026-02-17T05:46:45.102 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43713.log.gz 2026-02-17T05:46:45.102 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45038.log 2026-02-17T05:46:45.102 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47318.log.gz 2026-02-17T05:46:45.103 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45534.log 2026-02-17T05:46:45.103 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47122.log.gz 2026-02-17T05:46:45.103 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2026-02-17T05:46:45.103 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45038.log.gz 2026-02-17T05:46:45.103 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45534.log.gz 2026-02-17T05:46:45.103 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47001.log 2026-02-17T05:46:45.103 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46806.log 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47001.log.gz 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46560.log 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41459.log 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46806.log.gz 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46560.log.gz 2026-02-17T05:46:45.104 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.41459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43712.log 2026-02-17T05:46:45.105 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41459.log.gz 2026-02-17T05:46:45.105 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2026-02-17T05:46:45.105 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2026-02-17T05:46:45.105 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45433.log 2026-02-17T05:46:45.105 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43712.log.gz 2026-02-17T05:46:45.105 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2026-02-17T05:46:45.105 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45211.log 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45678.log 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45211.log.gz 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44706.log 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 2026-02-17T05:46:45.106 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45678.log.gz 2026-02-17T05:46:45.107 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44706.log.gz 2026-02-17T05:46:45.107 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44669.log 2026-02-17T05:46:45.107 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2026-02-17T05:46:45.107 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2026-02-17T05:46:45.107 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44669.log.gz 2026-02-17T05:46:45.107 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43409.log 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47171.log 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43409.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43409.log.gz -5 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47171.log.gz 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46904.log 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2026-02-17T05:46:45.108 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46904.log.gz 2026-02-17T05:46:45.109 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45679.log 2026-02-17T05:46:45.109 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gz 2026-02-17T05:46:45.109 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2026-02-17T05:46:45.109 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45679.log.gz 2026-02-17T05:46:45.109 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2026-02-17T05:46:45.109 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2026-02-17T05:46:45.109 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2026-02-17T05:46:45.110 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2026-02-17T05:46:45.110 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46730.log 2026-02-17T05:46:45.110 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2026-02-17T05:46:45.110 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46387.log 2026-02-17T05:46:45.110 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46730.log.gz 2026-02-17T05:46:45.110 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43588.log 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46387.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46387.log.gz 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43588.log.gz 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45603.log 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr: 87.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45603.log.gz 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46317.log 2026-02-17T05:46:45.111 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38049.log 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46317.log.gz 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47465.log 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph.tmp-client.admin.38049.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38049.log.gz 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47465.log.gz 2026-02-17T05:46:45.112 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47220.log 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47220.log.gz 2026-02-17T05:46:45.113 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2026-02-17T05:46:45.114 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45874.log 2026-02-17T05:46:45.114 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2026-02-17T05:46:45.114 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43911.log 2026-02-17T05:46:45.114 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46461.log 2026-02-17T05:46:45.114 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2026-02-17T05:46:45.115 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43911.log.gz 2026-02-17T05:46:45.115 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46463.log 2026-02-17T05:46:45.115 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44608.log 2026-02-17T05:46:45.115 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46461.log.gz 2026-02-17T05:46:45.115 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46463.log.gz 2026-02-17T05:46:45.115 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45336.log 2026-02-17T05:46:45.116 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43637.log 2026-02-17T05:46:45.116 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2026-02-17T05:46:45.116 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45336.log.gz 2026-02-17T05:46:45.116 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46632.log 2026-02-17T05:46:45.116 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44842.log 2026-02-17T05:46:45.116 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43637.log.gz 2026-02-17T05:46:45.116 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46632.log.gz 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41506.log 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44842.log.gz 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44127.log 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.41506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41506.log.gz 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41654.log 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44127.log.gz 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43539.log 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.41654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41654.log.gz 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47610.log 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.43539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43539.log.gz 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47610.log.gz 2026-02-17T05:46:45.117 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2026-02-17T05:46:45.118 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44843.log 2026-02-17T05:46:45.118 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2026-02-17T05:46:45.118 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46678.log 2026-02-17T05:46:45.118 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47367.log 2026-02-17T05:46:45.118 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44843.log.gz 2026-02-17T05:46:45.118 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46678.log.gz 2026-02-17T05:46:45.119 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T05:46:45.119 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2026-02-17T05:46:45.119 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz 2026-02-17T05:46:45.119 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47073.log 2026-02-17T05:46:45.119 INFO:teuthology.orchestra.run.trial160.stderr: 82.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.47073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47073.log.gz 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.44176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45875.log 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.46218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2026-02-17T05:46:45.120 INFO:teuthology.orchestra.run.trial160.stderr:/var/log/ceph/ceph-client.admin.45875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45875.log.gz 2026-02-17T05:46:45.124 INFO:teuthology.orchestra.run.trial160.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T05:46:45.124 INFO:teuthology.orchestra.run.trial160.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T05:46:45.138 INFO:teuthology.orchestra.run.trial160.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T05:46:45.362 INFO:teuthology.orchestra.run.trial160.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T05:46:45.363 INFO:teuthology.orchestra.run.trial160.stderr: 2026-02-17T05:46:45.363 INFO:teuthology.orchestra.run.trial160.stderr:real 0m0.277s 2026-02-17T05:46:45.363 INFO:teuthology.orchestra.run.trial160.stderr:user 0m0.337s 2026-02-17T05:46:45.363 INFO:teuthology.orchestra.run.trial160.stderr:sys 0m0.065s 2026-02-17T05:46:45.364 INFO:tasks.ceph:Archiving logs... 2026-02-17T05:46:45.364 DEBUG:teuthology.misc:Transferring archived files from trial160:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51055/remote/trial160/log 2026-02-17T05:46:45.365 DEBUG:teuthology.orchestra.run.trial160:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T05:46:45.522 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T05:46:45.536 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T05:46:45.536 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T05:46:45.643 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T05:46:45.654 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T05:46:45.654 DEBUG:teuthology.orchestra.run.trial160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T05:46:45.671 INFO:teuthology.orchestra.run.trial160.stderr:bash: line 1: ntpq: command not found 2026-02-17T05:46:45.705 INFO:teuthology.orchestra.run.trial160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T05:46:45.705 INFO:teuthology.orchestra.run.trial160.stdout:=============================================================================== 2026-02-17T05:46:45.705 INFO:teuthology.orchestra.run.trial160.stdout:^- static.36.62.78.5.client> 4 6 77 11 +1084us[+1070us] +/- 59ms 2026-02-17T05:46:45.705 INFO:teuthology.orchestra.run.trial160.stdout:^- gwallaceNTPpool.com 2 6 77 10 -207us[ -220us] +/- 41ms 2026-02-17T05:46:45.705 INFO:teuthology.orchestra.run.trial160.stdout:^- y.ns.gin.ntt.net 2 6 77 9 -102us[ -102us] +/- 41ms 2026-02-17T05:46:45.705 INFO:teuthology.orchestra.run.trial160.stdout:^* chi3.us.ntp.li 2 6 77 10 -5884ns[ -19us] +/- 10ms 2026-02-17T05:46:45.706 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T05:46:45.722 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T05:46:45.722 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T05:46:45.738 DEBUG:teuthology.orchestra.run.trial160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T05:46:45.799 DEBUG:teuthology.orchestra.run.trial160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T05:46:45.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:46:45.824 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T05:46:45.835 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T05:46:45.849 INFO:teuthology.task.internal:Duration was 324.954632 seconds 2026-02-17T05:46:45.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T05:46:45.867 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T05:46:45.867 DEBUG:teuthology.orchestra.run.trial160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T05:46:45.903 INFO:teuthology.orchestra.run.trial160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T05:46:46.126 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T05:46:46.126 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial160.front.sepia.ceph.com 2026-02-17T05:46:46.126 DEBUG:teuthology.orchestra.run.trial160:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T05:46:46.185 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T05:46:46.185 DEBUG:teuthology.orchestra.run.trial160:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:46:46.282 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T05:46:46.283 DEBUG:teuthology.orchestra.run.trial160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T05:46:46.305 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T05:46:46.306 INFO:teuthology.orchestra.run.trial160.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T05:46:46.306 INFO:teuthology.orchestra.run.trial160.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T05:46:46.306 INFO:teuthology.orchestra.run.trial160.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T05:46:46.306 INFO:teuthology.orchestra.run.trial160.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T05:46:46.316 INFO:teuthology.orchestra.run.trial160.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T05:46:46.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T05:46:46.329 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T05:46:46.329 DEBUG:teuthology.orchestra.run.trial160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T05:46:46.381 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T05:46:46.393 DEBUG:teuthology.orchestra.run.trial160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:46:46.447 INFO:teuthology.orchestra.run.trial160.stdout:kernel.core_pattern = core 2026-02-17T05:46:46.461 DEBUG:teuthology.orchestra.run.trial160:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T05:46:46.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T05:46:46.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T05:46:46.528 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T05:46:46.528 DEBUG:teuthology.misc:Transferring archived files from trial160:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51055/remote/trial160 2026-02-17T05:46:46.529 DEBUG:teuthology.orchestra.run.trial160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T05:46:46.588 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T05:46:46.589 DEBUG:teuthology.orchestra.run.trial160:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T05:46:46.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T05:46:46.650 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T05:46:46.650 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T05:46:46.662 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T05:46:46.662 DEBUG:teuthology.orchestra.run.trial160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T05:46:46.694 INFO:teuthology.orchestra.run.trial160.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 05:46 /home/ubuntu/cephtest 2026-02-17T05:46:46.695 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T05:46:46.707 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T05:46:46.737 INFO:teuthology.run:Summary data: description: rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} duration: 324.9546320438385 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T05:46:46.737 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T05:46:46.830 INFO:teuthology.run:pass