2026-02-26T02:31:36.995 INFO:root:teuthology version: 1.2.4.dev11+g6e3d0419c 2026-02-26T02:31:37.011 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T02:31:37.090 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027 branch: wip-yuri9-testing-2026-02-25-1600-squid description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '71027' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri9-testing-2026-02-25-1600-squid ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true osd_class_default_list: '*' osd_class_load_list: '*' flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result mon_bind_msgr2: false sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri9-testing-2026-02-25-1600-squid sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 1525 sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri9-testing-2026-02-25-1600-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 targets: trial093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHt++30EwYkFfRfsYjJeoQPCNEKgxDI+wxwNZhM8ccNkXzLXT+Xqak6ay9QzrLUti438bPP7BMdKafVYDjoP/yY= trial130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7oeftG/UjEyZ4FD0+JBNfjnHcJdrtMApX3LN4uZ946ekqHKS5cTH9X+ZVjz6BdZ+tQfRnZYPdyFtqUiVNF63o= trial161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK1ReN88deVHuPs0gaPaxZRz2/yPDuH0PToX9YGZOUBveP8HeqBYJEsY8PsD+mnXpPjug5Wi42OX6yc0sHKNNyc= trial192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCnrCF9NhSdfojWS3Zz2vL6BzKES7jfgeiFYPAm5VP48ubCOIZbhdB4dyCN3w/HeNEyVGTFp32KMuxVkrG0vuSQ= tasks: - install: null - ceph: null - workunit: clients: client.0: - cls teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6e3d0419ccca0e75a03e08feb708946e198236f4 timestamp: 2026-02-26_01:51:16 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-26T02:31:37.090 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa; will attempt to use it 2026-02-26T02:31:37.091 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks 2026-02-26T02:31:37.091 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-26T02:31:37.092 INFO:teuthology.task.internal:Checking packages... 2026-02-26T02:31:37.092 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5' 2026-02-26T02:31:37.092 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-26T02:31:37.092 INFO:teuthology.packaging:ref: None 2026-02-26T02:31:37.093 INFO:teuthology.packaging:tag: None 2026-02-26T02:31:37.093 INFO:teuthology.packaging:branch: wip-yuri9-testing-2026-02-25-1600-squid 2026-02-26T02:31:37.093 INFO:teuthology.packaging:sha1: 8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:31:37.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri9-testing-2026-02-25-1600-squid 2026-02-26T02:31:37.217 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-687.g8d724284 2026-02-26T02:31:37.219 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-26T02:31:37.230 INFO:teuthology.task.internal:no buildpackages task found 2026-02-26T02:31:37.230 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-26T02:31:37.243 INFO:teuthology.task.internal:Saving configuration 2026-02-26T02:31:37.250 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-26T02:31:37.262 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-26T02:31:37.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial093.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-26 02:28:00.854075', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHt++30EwYkFfRfsYjJeoQPCNEKgxDI+wxwNZhM8ccNkXzLXT+Xqak6ay9QzrLUti438bPP7BMdKafVYDjoP/yY='} 2026-02-26T02:31:37.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial130.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-26 02:28:00.853736', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7oeftG/UjEyZ4FD0+JBNfjnHcJdrtMApX3LN4uZ946ekqHKS5cTH9X+ZVjz6BdZ+tQfRnZYPdyFtqUiVNF63o='} 2026-02-26T02:31:37.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial161.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-26 02:28:00.853177', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK1ReN88deVHuPs0gaPaxZRz2/yPDuH0PToX9YGZOUBveP8HeqBYJEsY8PsD+mnXpPjug5Wi42OX6yc0sHKNNyc='} 2026-02-26T02:31:37.506 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial192.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-26 02:28:00.854394', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCnrCF9NhSdfojWS3Zz2vL6BzKES7jfgeiFYPAm5VP48ubCOIZbhdB4dyCN3w/HeNEyVGTFp32KMuxVkrG0vuSQ='} 2026-02-26T02:31:37.506 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-26T02:31:37.518 INFO:teuthology.task.internal:roles: ubuntu@trial093.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-26T02:31:37.518 INFO:teuthology.task.internal:roles: ubuntu@trial130.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-26T02:31:37.518 INFO:teuthology.task.internal:roles: ubuntu@trial161.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-26T02:31:37.518 INFO:teuthology.task.internal:roles: ubuntu@trial192.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-26T02:31:37.518 INFO:teuthology.run_tasks:Running task console_log... 2026-02-26T02:31:37.808 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x73e773e36660>, signals=[15]) 2026-02-26T02:31:37.809 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-26T02:31:37.824 INFO:teuthology.task.internal:Opening connections... 2026-02-26T02:31:37.824 DEBUG:teuthology.task.internal:connecting to ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:31:37.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:31:37.888 DEBUG:teuthology.task.internal:connecting to ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:31:37.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:31:37.948 DEBUG:teuthology.task.internal:connecting to ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:31:37.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:31:38.012 DEBUG:teuthology.task.internal:connecting to ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:31:38.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:31:38.072 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-26T02:31:38.085 DEBUG:teuthology.orchestra.run.trial093:> uname -m 2026-02-26T02:31:38.101 INFO:teuthology.orchestra.run.trial093.stdout:x86_64 2026-02-26T02:31:38.101 DEBUG:teuthology.orchestra.run.trial093:> cat /etc/os-release 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:NAME="CentOS Stream" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:VERSION="9" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:ID="centos" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:ID_LIKE="rhel fedora" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:VERSION_ID="9" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:PLATFORM_ID="platform:el9" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:ANSI_COLOR="0;31" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:LOGO="fedora-logo-icon" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:HOME_URL="https://centos.org/" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T02:31:38.156 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T02:31:38.157 INFO:teuthology.orchestra.run.trial093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T02:31:38.157 INFO:teuthology.lock.ops:Updating trial093.front.sepia.ceph.com on lock server 2026-02-26T02:31:38.221 DEBUG:teuthology.orchestra.run.trial130:> uname -m 2026-02-26T02:31:38.238 INFO:teuthology.orchestra.run.trial130.stdout:x86_64 2026-02-26T02:31:38.238 DEBUG:teuthology.orchestra.run.trial130:> cat /etc/os-release 2026-02-26T02:31:38.294 INFO:teuthology.orchestra.run.trial130.stdout:NAME="CentOS Stream" 2026-02-26T02:31:38.294 INFO:teuthology.orchestra.run.trial130.stdout:VERSION="9" 2026-02-26T02:31:38.294 INFO:teuthology.orchestra.run.trial130.stdout:ID="centos" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:ID_LIKE="rhel fedora" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:VERSION_ID="9" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:PLATFORM_ID="platform:el9" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:ANSI_COLOR="0;31" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:LOGO="fedora-logo-icon" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:HOME_URL="https://centos.org/" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T02:31:38.295 INFO:teuthology.orchestra.run.trial130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T02:31:38.295 INFO:teuthology.lock.ops:Updating trial130.front.sepia.ceph.com on lock server 2026-02-26T02:31:38.370 DEBUG:teuthology.orchestra.run.trial161:> uname -m 2026-02-26T02:31:38.385 INFO:teuthology.orchestra.run.trial161.stdout:x86_64 2026-02-26T02:31:38.386 DEBUG:teuthology.orchestra.run.trial161:> cat /etc/os-release 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:NAME="CentOS Stream" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:VERSION="9" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:ID="centos" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:ID_LIKE="rhel fedora" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:VERSION_ID="9" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:PLATFORM_ID="platform:el9" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:ANSI_COLOR="0;31" 2026-02-26T02:31:38.441 INFO:teuthology.orchestra.run.trial161.stdout:LOGO="fedora-logo-icon" 2026-02-26T02:31:38.442 INFO:teuthology.orchestra.run.trial161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T02:31:38.442 INFO:teuthology.orchestra.run.trial161.stdout:HOME_URL="https://centos.org/" 2026-02-26T02:31:38.442 INFO:teuthology.orchestra.run.trial161.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T02:31:38.442 INFO:teuthology.orchestra.run.trial161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T02:31:38.442 INFO:teuthology.orchestra.run.trial161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T02:31:38.442 INFO:teuthology.lock.ops:Updating trial161.front.sepia.ceph.com on lock server 2026-02-26T02:31:38.520 DEBUG:teuthology.orchestra.run.trial192:> uname -m 2026-02-26T02:31:38.535 INFO:teuthology.orchestra.run.trial192.stdout:x86_64 2026-02-26T02:31:38.536 DEBUG:teuthology.orchestra.run.trial192:> cat /etc/os-release 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:NAME="CentOS Stream" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:VERSION="9" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:ID="centos" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:ID_LIKE="rhel fedora" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:VERSION_ID="9" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:PLATFORM_ID="platform:el9" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:ANSI_COLOR="0;31" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:LOGO="fedora-logo-icon" 2026-02-26T02:31:38.592 INFO:teuthology.orchestra.run.trial192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-26T02:31:38.593 INFO:teuthology.orchestra.run.trial192.stdout:HOME_URL="https://centos.org/" 2026-02-26T02:31:38.593 INFO:teuthology.orchestra.run.trial192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-26T02:31:38.593 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-26T02:31:38.593 INFO:teuthology.orchestra.run.trial192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-26T02:31:38.593 INFO:teuthology.lock.ops:Updating trial192.front.sepia.ceph.com on lock server 2026-02-26T02:31:38.679 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-26T02:31:38.692 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-26T02:31:38.704 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-26T02:31:38.705 DEBUG:teuthology.orchestra.run.trial093:> test '!' -e /home/ubuntu/cephtest 2026-02-26T02:31:38.707 DEBUG:teuthology.orchestra.run.trial130:> test '!' -e /home/ubuntu/cephtest 2026-02-26T02:31:38.708 DEBUG:teuthology.orchestra.run.trial161:> test '!' -e /home/ubuntu/cephtest 2026-02-26T02:31:38.710 DEBUG:teuthology.orchestra.run.trial192:> test '!' -e /home/ubuntu/cephtest 2026-02-26T02:31:38.725 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-26T02:31:38.737 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-26T02:31:38.737 DEBUG:teuthology.orchestra.run.trial093:> test -z $(ls -A /var/lib/ceph) 2026-02-26T02:31:38.762 DEBUG:teuthology.orchestra.run.trial130:> test -z $(ls -A /var/lib/ceph) 2026-02-26T02:31:38.764 DEBUG:teuthology.orchestra.run.trial161:> test -z $(ls -A /var/lib/ceph) 2026-02-26T02:31:38.766 DEBUG:teuthology.orchestra.run.trial192:> test -z $(ls -A /var/lib/ceph) 2026-02-26T02:31:38.783 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-26T02:31:39.442 INFO:teuthology.run_tasks:Running task kernel... 2026-02-26T02:31:39.466 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-26T02:31:39.466 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-26T02:31:39.467 DEBUG:teuthology.orchestra.run.trial093:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-26T02:31:39.467 DEBUG:teuthology.orchestra.run.trial130:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-26T02:31:39.467 DEBUG:teuthology.orchestra.run.trial161:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-26T02:31:39.467 DEBUG:teuthology.orchestra.run.trial192:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-26T02:31:39.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:31:39.482 DEBUG:teuthology.orchestra.run.trial130:> uname -r 2026-02-26T02:31:39.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:31:39.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:31:39.483 DEBUG:teuthology.orchestra.run.trial093:> uname -r 2026-02-26T02:31:39.483 DEBUG:teuthology.orchestra.run.trial192:> uname -r 2026-02-26T02:31:39.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:31:39.483 DEBUG:teuthology.orchestra.run.trial161:> uname -r 2026-02-26T02:31:39.537 INFO:teuthology.orchestra.run.trial130.stdout:5.14.0-681.el9.x86_64 2026-02-26T02:31:39.537 INFO:teuthology.task.kernel:Running kernel on trial130: 5.14.0-681.el9.x86_64 2026-02-26T02:31:39.537 DEBUG:teuthology.orchestra.run.trial130:> sudo yum install -y kernel 2026-02-26T02:31:39.537 INFO:teuthology.orchestra.run.trial093.stdout:5.14.0-681.el9.x86_64 2026-02-26T02:31:39.538 INFO:teuthology.task.kernel:Running kernel on trial093: 5.14.0-681.el9.x86_64 2026-02-26T02:31:39.538 DEBUG:teuthology.orchestra.run.trial093:> sudo yum install -y kernel 2026-02-26T02:31:39.538 INFO:teuthology.orchestra.run.trial161.stdout:5.14.0-681.el9.x86_64 2026-02-26T02:31:39.538 INFO:teuthology.orchestra.run.trial192.stdout:5.14.0-681.el9.x86_64 2026-02-26T02:31:39.538 INFO:teuthology.task.kernel:Running kernel on trial161: 5.14.0-681.el9.x86_64 2026-02-26T02:31:39.538 DEBUG:teuthology.orchestra.run.trial161:> sudo yum install -y kernel 2026-02-26T02:31:39.539 INFO:teuthology.task.kernel:Running kernel on trial192: 5.14.0-681.el9.x86_64 2026-02-26T02:31:39.539 DEBUG:teuthology.orchestra.run.trial192:> sudo yum install -y kernel 2026-02-26T02:31:40.235 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - BaseOS 28 MB/s | 8.9 MB 00:00 2026-02-26T02:31:41.293 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-26T02:31:43.501 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-26T02:31:44.498 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-26T02:31:48.324 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-26T02:31:48.403 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-26T02:31:49.259 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - AppStream 67 MB/s | 27 MB 00:00 2026-02-26T02:31:51.166 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 8.0 MB 00:04 2026-02-26T02:31:51.869 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 27 MB 00:02 2026-02-26T02:31:52.107 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 20 kB 00:00 2026-02-26T02:31:53.469 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 8.0 MB 00:01 2026-02-26T02:31:54.499 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - CRB 32 MB/s | 8.0 MB 00:00 2026-02-26T02:31:55.097 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-26T02:31:55.391 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - Extras packages 128 kB/s | 20 kB 00:00 2026-02-26T02:31:55.686 INFO:teuthology.orchestra.run.trial192.stdout:Extra Packages for Enterprise Linux 88 MB/s | 20 MB 00:00 2026-02-26T02:31:55.860 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - CRB 815 kB/s | 8.0 MB 00:10 2026-02-26T02:31:56.102 INFO:teuthology.orchestra.run.trial161.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-26T02:31:56.898 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 20 kB 00:00 2026-02-26T02:31:58.002 INFO:teuthology.orchestra.run.trial130.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 20 MB 00:05 2026-02-26T02:31:58.827 INFO:teuthology.orchestra.run.trial192.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-26T02:31:59.296 INFO:teuthology.orchestra.run.trial161.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-26T02:31:59.860 INFO:teuthology.orchestra.run.trial192.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-26T02:31:59.860 INFO:teuthology.orchestra.run.trial192.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-26T02:31:59.880 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:31:59.880 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:31:59.880 INFO:teuthology.orchestra.run.trial192.stdout: Package Architecture Version Repository Size 2026-02-26T02:31:59.880 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:31:59.880 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:31:59.880 INFO:teuthology.orchestra.run.trial192.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-26T02:31:59.880 INFO:teuthology.orchestra.run.trial192.stdout:Installing dependencies: 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout:Install 4 Packages 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 89 M 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 135 M 2026-02-26T02:31:59.881 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:32:00.319 INFO:teuthology.orchestra.run.trial161.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-26T02:32:00.319 INFO:teuthology.orchestra.run.trial161.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-26T02:32:00.331 INFO:teuthology.orchestra.run.trial192.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 4.3 MB/s | 901 kB 00:00 2026-02-26T02:32:00.339 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:32:00.340 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:32:00.340 INFO:teuthology.orchestra.run.trial161.stdout: Package Architecture Version Repository Size 2026-02-26T02:32:00.340 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:32:00.340 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:32:00.340 INFO:teuthology.orchestra.run.trial161.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-26T02:32:00.340 INFO:teuthology.orchestra.run.trial161.stdout:Installing dependencies: 2026-02-26T02:32:00.340 INFO:teuthology.orchestra.run.trial161.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout:Install 4 Packages 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 89 M 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 135 M 2026-02-26T02:32:00.341 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:32:00.632 INFO:teuthology.orchestra.run.trial192.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 34 MB/s | 17 MB 00:00 2026-02-26T02:32:00.938 INFO:teuthology.orchestra.run.trial192.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 51 MB/s | 31 MB 00:00 2026-02-26T02:32:01.090 INFO:teuthology.orchestra.run.trial192.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 41 MB/s | 40 MB 00:00 2026-02-26T02:32:01.091 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:32:01.091 INFO:teuthology.orchestra.run.trial192.stdout:Total 74 MB/s | 89 MB 00:01 2026-02-26T02:32:01.242 INFO:teuthology.orchestra.run.trial130.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-26T02:32:01.282 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:32:01.406 INFO:teuthology.orchestra.run.trial161.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 930 kB/s | 901 kB 00:00 2026-02-26T02:32:01.484 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:32:01.484 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:32:01.854 INFO:teuthology.orchestra.run.trial161.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2026-02-26T02:32:01.870 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:32:01.870 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:32:02.270 INFO:teuthology.orchestra.run.trial130.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-26T02:32:02.270 INFO:teuthology.orchestra.run.trial130.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-26T02:32:02.290 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:32:02.291 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:32:02.291 INFO:teuthology.orchestra.run.trial130.stdout: Package Architecture Version Repository Size 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout:Installing dependencies: 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:32:02.292 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:32:02.293 INFO:teuthology.orchestra.run.trial130.stdout:Install 4 Packages 2026-02-26T02:32:02.293 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:32:02.293 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 89 M 2026-02-26T02:32:02.293 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 135 M 2026-02-26T02:32:02.293 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:32:02.456 INFO:teuthology.orchestra.run.trial161.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 20 MB/s | 40 MB 00:02 2026-02-26T02:32:02.982 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:32:03.173 INFO:teuthology.orchestra.run.trial161.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-26T02:32:03.173 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:32:03.173 INFO:teuthology.orchestra.run.trial161.stdout:Total 31 MB/s | 89 MB 00:02 2026-02-26T02:32:03.273 INFO:teuthology.orchestra.run.trial192.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:32:03.295 INFO:teuthology.orchestra.run.trial192.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:03.365 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:32:03.570 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:32:03.571 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:32:03.952 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:32:03.952 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:32:04.027 INFO:teuthology.orchestra.run.trial130.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 538 kB/s | 901 kB 00:01 2026-02-26T02:32:05.062 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:32:05.352 INFO:teuthology.orchestra.run.trial161.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:32:05.374 INFO:teuthology.orchestra.run.trial161.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:05.851 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:05.884 INFO:teuthology.orchestra.run.trial192.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:07.937 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:07.971 INFO:teuthology.orchestra.run.trial161.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:08.988 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:08.994 INFO:teuthology.orchestra.run.trial192.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:11.070 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:11.077 INFO:teuthology.orchestra.run.trial161.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:12.046 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:14.123 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:20.547 INFO:teuthology.orchestra.run.trial130.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 967 kB/s | 17 MB 00:18 2026-02-26T02:32:21.158 INFO:teuthology.orchestra.run.trial130.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 2.1 MB/s | 40 MB 00:18 2026-02-26T02:32:29.636 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:29.656 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:29.841 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:29.841 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:32:29.842 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:29.842 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:29.898 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:32:29.899 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:32:29.961 DEBUG:teuthology.orchestra.run.trial192:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:32:29.990 INFO:teuthology.orchestra.run.trial192.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:32:29.990 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:32:29.990 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-26T02:32:29.990 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-26T02:32:29.990 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-26T02:32:29.990 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-26T02:32:29.990 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial192.front.sepia.ceph.com, path=None, version=distro) 2026-02-26T02:32:29.990 DEBUG:teuthology.orchestra.run.trial192:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:32:30.059 INFO:teuthology.orchestra.run.trial192.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:32:30.060 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:32:30.060 DEBUG:teuthology.orchestra.run.trial192:> sudo rpm -qi grub2-tools 2026-02-26T02:32:30.128 INFO:teuthology.orchestra.run.trial192.stdout:Name : grub2-tools 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Epoch : 1 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Version : 2.06 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Release : 120.el9 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Architecture: x86_64 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Group : Unspecified 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Size : 9108611 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:License : GPLv3+ 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Packager : builder@centos.org 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Vendor : CentOS 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Summary : Support tools for GRUB. 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:Description : 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:hardware devices. 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:32:30.129 INFO:teuthology.orchestra.run.trial192.stdout:This subpackage provides tools for support of all platforms. 2026-02-26T02:32:30.130 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-26T02:32:30.130 INFO:teuthology.task.kernel:Updating grub on trial192 to boot 5.14.0-686.el9.x86_64 2026-02-26T02:32:30.130 DEBUG:teuthology.orchestra.run.trial192:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-26T02:32:30.192 INFO:teuthology.orchestra.run.trial192.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-26T02:32:30.194 DEBUG:teuthology.orchestra.run.trial192:> sudo command -v grubby && echo yes || echo no 2026-02-26T02:32:30.259 INFO:teuthology.orchestra.run.trial192.stdout:/sbin/grubby 2026-02-26T02:32:30.260 INFO:teuthology.orchestra.run.trial192.stdout:yes 2026-02-26T02:32:30.260 DEBUG:teuthology.orchestra.run.trial192:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-26T02:32:30.325 INFO:teuthology.orchestra.run.trial192.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-26T02:32:30.326 DEBUG:teuthology.orchestra.run.trial192:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-26T02:32:30.397 DEBUG:teuthology.orchestra.run.trial192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-26T02:32:30.600 INFO:teuthology.orchestra.run.trial192.stderr:Generating grub configuration file ... 2026-02-26T02:32:30.667 INFO:teuthology.orchestra.run.trial192.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-26T02:32:30.673 INFO:teuthology.orchestra.run.trial192.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-26T02:32:30.921 INFO:teuthology.orchestra.run.trial192.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-26T02:32:30.928 INFO:teuthology.orchestra.run.trial192.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-26T02:32:30.962 INFO:teuthology.orchestra.run.trial192.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-26T02:32:30.968 INFO:teuthology.orchestra.run.trial192.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-26T02:32:30.999 INFO:teuthology.orchestra.run.trial192.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-26T02:32:31.006 INFO:teuthology.orchestra.run.trial192.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-26T02:32:31.029 INFO:teuthology.orchestra.run.trial192.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-26T02:32:31.035 INFO:teuthology.orchestra.run.trial192.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-26T02:32:31.120 INFO:teuthology.orchestra.run.trial192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-26T02:32:31.129 INFO:teuthology.orchestra.run.trial192.stderr:done 2026-02-26T02:32:31.130 DEBUG:teuthology.orchestra.run.trial192:> test -d /sys/firmware/efi 2026-02-26T02:32:31.146 DEBUG:teuthology.orchestra.run.trial192:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-26T02:32:31.213 INFO:teuthology.orchestra.run.trial192.stdout:/boot/efi/EFI/BOOT 2026-02-26T02:32:31.214 INFO:teuthology.orchestra.run.trial192.stdout:/boot/efi/EFI/centos 2026-02-26T02:32:31.215 DEBUG:teuthology.orchestra.run.trial192:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-26T02:32:31.280 INFO:teuthology.orchestra.run.trial192.stdout:no 2026-02-26T02:32:31.280 DEBUG:teuthology.orchestra.run.trial192:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-26T02:32:31.345 INFO:teuthology.orchestra.run.trial192.stdout:yes 2026-02-26T02:32:31.345 DEBUG:teuthology.orchestra.run.trial192:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-26T02:32:31.408 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial192 2026-02-26T02:32:31.408 DEBUG:teuthology.orchestra.run.trial192:> sudo bash -c ' 2026-02-26T02:32:31.408 DEBUG:teuthology.orchestra.run.trial192:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-26T02:32:31.408 DEBUG:teuthology.orchestra.run.trial192:> ' 2026-02-26T02:32:31.681 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:31.704 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:31.895 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:31.895 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:32:31.895 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:31.895 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:31.952 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:32:31.953 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:32:32.013 DEBUG:teuthology.orchestra.run.trial161:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:32:32.044 INFO:teuthology.orchestra.run.trial161.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:32:32.045 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:32:32.045 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-26T02:32:32.045 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-26T02:32:32.045 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-26T02:32:32.046 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-26T02:32:32.046 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial161.front.sepia.ceph.com, path=None, version=distro) 2026-02-26T02:32:32.046 DEBUG:teuthology.orchestra.run.trial161:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:32:32.109 INFO:teuthology.orchestra.run.trial161.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:32:32.110 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:32:32.110 DEBUG:teuthology.orchestra.run.trial161:> sudo rpm -qi grub2-tools 2026-02-26T02:32:32.179 INFO:teuthology.orchestra.run.trial161.stdout:Name : grub2-tools 2026-02-26T02:32:32.179 INFO:teuthology.orchestra.run.trial161.stdout:Epoch : 1 2026-02-26T02:32:32.179 INFO:teuthology.orchestra.run.trial161.stdout:Version : 2.06 2026-02-26T02:32:32.179 INFO:teuthology.orchestra.run.trial161.stdout:Release : 120.el9 2026-02-26T02:32:32.179 INFO:teuthology.orchestra.run.trial161.stdout:Architecture: x86_64 2026-02-26T02:32:32.179 INFO:teuthology.orchestra.run.trial161.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Group : Unspecified 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Size : 9108611 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:License : GPLv3+ 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Packager : builder@centos.org 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Vendor : CentOS 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Summary : Support tools for GRUB. 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:Description : 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-26T02:32:32.180 INFO:teuthology.orchestra.run.trial161.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-26T02:32:32.181 INFO:teuthology.orchestra.run.trial161.stdout:hardware devices. 2026-02-26T02:32:32.181 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:32:32.181 INFO:teuthology.orchestra.run.trial161.stdout:This subpackage provides tools for support of all platforms. 2026-02-26T02:32:32.181 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-26T02:32:32.182 INFO:teuthology.task.kernel:Updating grub on trial161 to boot 5.14.0-686.el9.x86_64 2026-02-26T02:32:32.182 DEBUG:teuthology.orchestra.run.trial161:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-26T02:32:32.245 INFO:teuthology.orchestra.run.trial161.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-26T02:32:32.247 DEBUG:teuthology.orchestra.run.trial161:> sudo command -v grubby && echo yes || echo no 2026-02-26T02:32:32.310 INFO:teuthology.orchestra.run.trial161.stdout:/sbin/grubby 2026-02-26T02:32:32.311 INFO:teuthology.orchestra.run.trial161.stdout:yes 2026-02-26T02:32:32.311 DEBUG:teuthology.orchestra.run.trial161:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-26T02:32:32.377 INFO:teuthology.orchestra.run.trial161.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-26T02:32:32.378 DEBUG:teuthology.orchestra.run.trial161:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-26T02:32:32.449 DEBUG:teuthology.orchestra.run.trial161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-26T02:32:32.659 INFO:teuthology.orchestra.run.trial161.stderr:Generating grub configuration file ... 2026-02-26T02:32:32.728 INFO:teuthology.orchestra.run.trial161.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-26T02:32:32.734 INFO:teuthology.orchestra.run.trial161.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-26T02:32:32.988 INFO:teuthology.orchestra.run.trial161.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-26T02:32:32.995 INFO:teuthology.orchestra.run.trial161.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-26T02:32:33.030 INFO:teuthology.orchestra.run.trial161.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-26T02:32:33.036 INFO:teuthology.orchestra.run.trial161.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-26T02:32:33.068 INFO:teuthology.orchestra.run.trial161.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-26T02:32:33.074 INFO:teuthology.orchestra.run.trial161.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-26T02:32:33.097 INFO:teuthology.orchestra.run.trial161.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-26T02:32:33.103 INFO:teuthology.orchestra.run.trial161.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-26T02:32:33.191 INFO:teuthology.orchestra.run.trial161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-26T02:32:33.200 INFO:teuthology.orchestra.run.trial161.stderr:done 2026-02-26T02:32:33.202 DEBUG:teuthology.orchestra.run.trial161:> test -d /sys/firmware/efi 2026-02-26T02:32:33.217 DEBUG:teuthology.orchestra.run.trial161:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-26T02:32:33.284 INFO:teuthology.orchestra.run.trial161.stdout:/boot/efi/EFI/BOOT 2026-02-26T02:32:33.284 INFO:teuthology.orchestra.run.trial161.stdout:/boot/efi/EFI/centos 2026-02-26T02:32:33.286 DEBUG:teuthology.orchestra.run.trial161:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-26T02:32:33.351 INFO:teuthology.orchestra.run.trial161.stdout:no 2026-02-26T02:32:33.351 DEBUG:teuthology.orchestra.run.trial161:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-26T02:32:33.410 INFO:teuthology.orchestra.run.trial130.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 1.1 MB/s | 31 MB 00:29 2026-02-26T02:32:33.412 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:32:33.412 INFO:teuthology.orchestra.run.trial130.stdout:Total 2.9 MB/s | 89 MB 00:31 2026-02-26T02:32:33.415 INFO:teuthology.orchestra.run.trial161.stdout:yes 2026-02-26T02:32:33.415 DEBUG:teuthology.orchestra.run.trial161:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-26T02:32:33.479 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial161 2026-02-26T02:32:33.479 DEBUG:teuthology.orchestra.run.trial161:> sudo bash -c ' 2026-02-26T02:32:33.479 DEBUG:teuthology.orchestra.run.trial161:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-26T02:32:33.479 DEBUG:teuthology.orchestra.run.trial161:> ' 2026-02-26T02:32:33.601 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:32:33.801 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:32:33.801 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:32:34.184 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:32:34.185 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:32:35.299 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:32:35.590 INFO:teuthology.orchestra.run.trial130.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:32:35.612 INFO:teuthology.orchestra.run.trial130.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:38.182 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:38.215 INFO:teuthology.orchestra.run.trial130.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:41.463 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:41.469 INFO:teuthology.orchestra.run.trial130.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:44.515 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:32:45.098 INFO:teuthology.orchestra.run.trial093.stdout:Extra Packages for Enterprise Linux 432 kB/s | 20 MB 00:48 2026-02-26T02:32:48.287 INFO:teuthology.orchestra.run.trial093.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-26T02:32:49.297 INFO:teuthology.orchestra.run.trial093.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-26T02:32:49.297 INFO:teuthology.orchestra.run.trial093.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-26T02:32:49.317 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:32:49.318 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:32:49.318 INFO:teuthology.orchestra.run.trial093.stdout: Package Architecture Version Repository Size 2026-02-26T02:32:49.318 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:32:49.318 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout:Installing dependencies: 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout:Install 4 Packages 2026-02-26T02:32:49.319 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:32:49.320 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 89 M 2026-02-26T02:32:49.320 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 135 M 2026-02-26T02:32:49.320 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:32:49.444 INFO:teuthology.orchestra.run.trial093.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 23 MB/s | 901 kB 00:00 2026-02-26T02:32:49.579 INFO:teuthology.orchestra.run.trial093.stdout:(2/4): kernel-modules-core-5.14.0-686.el9.x86_6 229 MB/s | 31 MB 00:00 2026-02-26T02:32:49.605 INFO:teuthology.orchestra.run.trial093.stdout:(3/4): kernel-core-5.14.0-686.el9.x86_64.rpm 86 MB/s | 17 MB 00:00 2026-02-26T02:32:49.662 INFO:teuthology.orchestra.run.trial093.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 155 MB/s | 40 MB 00:00 2026-02-26T02:32:49.663 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:32:49.663 INFO:teuthology.orchestra.run.trial093.stdout:Total 258 MB/s | 89 MB 00:00 2026-02-26T02:32:49.856 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:32:50.065 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:32:50.065 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:32:50.448 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:32:50.448 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:32:51.549 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:32:51.838 INFO:teuthology.orchestra.run.trial093.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:32:51.860 INFO:teuthology.orchestra.run.trial093.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:54.409 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:32:54.444 INFO:teuthology.orchestra.run.trial093.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:57.482 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:32:57.488 INFO:teuthology.orchestra.run.trial093.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:00.609 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:01.450 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-26T02:33:01.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial192.front.sepia.ceph.com' 2026-02-26T02:33:01.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:33:01.898 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:01.920 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:02.106 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:02.107 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:33:02.107 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:33:02.107 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:33:02.164 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:02.164 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:33:02.165 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:33:02.165 INFO:teuthology.orchestra.run.trial130.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.165 INFO:teuthology.orchestra.run.trial130.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.165 INFO:teuthology.orchestra.run.trial130.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.165 INFO:teuthology.orchestra.run.trial130.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.165 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:33:02.165 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:33:02.225 DEBUG:teuthology.orchestra.run.trial130:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:33:02.254 INFO:teuthology.orchestra.run.trial130.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:33:02.255 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-26T02:33:02.255 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-26T02:33:02.255 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-26T02:33:02.255 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-26T02:33:02.255 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial130.front.sepia.ceph.com, path=None, version=distro) 2026-02-26T02:33:02.256 DEBUG:teuthology.orchestra.run.trial130:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:33:02.320 INFO:teuthology.orchestra.run.trial130.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.321 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:33:02.321 DEBUG:teuthology.orchestra.run.trial130:> sudo rpm -qi grub2-tools 2026-02-26T02:33:02.390 INFO:teuthology.orchestra.run.trial130.stdout:Name : grub2-tools 2026-02-26T02:33:02.390 INFO:teuthology.orchestra.run.trial130.stdout:Epoch : 1 2026-02-26T02:33:02.390 INFO:teuthology.orchestra.run.trial130.stdout:Version : 2.06 2026-02-26T02:33:02.390 INFO:teuthology.orchestra.run.trial130.stdout:Release : 120.el9 2026-02-26T02:33:02.390 INFO:teuthology.orchestra.run.trial130.stdout:Architecture: x86_64 2026-02-26T02:33:02.390 INFO:teuthology.orchestra.run.trial130.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Group : Unspecified 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Size : 9108611 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:License : GPLv3+ 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Packager : builder@centos.org 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Vendor : CentOS 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Summary : Support tools for GRUB. 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:Description : 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout:hardware devices. 2026-02-26T02:33:02.391 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:33:02.392 INFO:teuthology.orchestra.run.trial130.stdout:This subpackage provides tools for support of all platforms. 2026-02-26T02:33:02.392 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-26T02:33:02.392 INFO:teuthology.task.kernel:Updating grub on trial130 to boot 5.14.0-686.el9.x86_64 2026-02-26T02:33:02.393 DEBUG:teuthology.orchestra.run.trial130:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-26T02:33:02.455 INFO:teuthology.orchestra.run.trial130.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-26T02:33:02.456 DEBUG:teuthology.orchestra.run.trial130:> sudo command -v grubby && echo yes || echo no 2026-02-26T02:33:02.519 INFO:teuthology.orchestra.run.trial130.stdout:/sbin/grubby 2026-02-26T02:33:02.521 INFO:teuthology.orchestra.run.trial130.stdout:yes 2026-02-26T02:33:02.521 DEBUG:teuthology.orchestra.run.trial130:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-26T02:33:02.586 INFO:teuthology.orchestra.run.trial130.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-26T02:33:02.586 DEBUG:teuthology.orchestra.run.trial130:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.658 DEBUG:teuthology.orchestra.run.trial130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-26T02:33:02.862 INFO:teuthology.orchestra.run.trial130.stderr:Generating grub configuration file ... 2026-02-26T02:33:02.931 INFO:teuthology.orchestra.run.trial130.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-26T02:33:02.937 INFO:teuthology.orchestra.run.trial130.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-26T02:33:03.183 INFO:teuthology.orchestra.run.trial130.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-26T02:33:03.190 INFO:teuthology.orchestra.run.trial130.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-26T02:33:03.224 INFO:teuthology.orchestra.run.trial130.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-26T02:33:03.230 INFO:teuthology.orchestra.run.trial130.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-26T02:33:03.262 INFO:teuthology.orchestra.run.trial130.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-26T02:33:03.268 INFO:teuthology.orchestra.run.trial130.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-26T02:33:03.291 INFO:teuthology.orchestra.run.trial130.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-26T02:33:03.298 INFO:teuthology.orchestra.run.trial130.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-26T02:33:03.385 INFO:teuthology.orchestra.run.trial130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-26T02:33:03.393 INFO:teuthology.orchestra.run.trial130.stderr:done 2026-02-26T02:33:03.396 DEBUG:teuthology.orchestra.run.trial130:> test -d /sys/firmware/efi 2026-02-26T02:33:03.413 DEBUG:teuthology.orchestra.run.trial130:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-26T02:33:03.479 INFO:teuthology.orchestra.run.trial130.stdout:/boot/efi/EFI/BOOT 2026-02-26T02:33:03.479 INFO:teuthology.orchestra.run.trial130.stdout:/boot/efi/EFI/centos 2026-02-26T02:33:03.481 DEBUG:teuthology.orchestra.run.trial130:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-26T02:33:03.522 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-26T02:33:03.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-26T02:33:03.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:33:03.546 INFO:teuthology.orchestra.run.trial130.stdout:no 2026-02-26T02:33:03.547 DEBUG:teuthology.orchestra.run.trial130:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-26T02:33:03.611 INFO:teuthology.orchestra.run.trial130.stdout:yes 2026-02-26T02:33:03.612 DEBUG:teuthology.orchestra.run.trial130:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-26T02:33:03.677 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial130 2026-02-26T02:33:03.677 DEBUG:teuthology.orchestra.run.trial130:> sudo bash -c ' 2026-02-26T02:33:03.677 DEBUG:teuthology.orchestra.run.trial130:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-26T02:33:03.677 DEBUG:teuthology.orchestra.run.trial130:> ' 2026-02-26T02:33:17.923 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:17.945 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:18.020 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:18.021 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-26T02:33:18.021 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-26T02:33:18.021 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:33:18.078 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:33:18.139 DEBUG:teuthology.orchestra.run.trial093:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:33:18.209 INFO:teuthology.orchestra.run.trial093.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.210 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:33:18.210 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-26T02:33:18.211 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-26T02:33:18.211 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-26T02:33:18.211 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-26T02:33:18.211 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial093.front.sepia.ceph.com, path=None, version=distro) 2026-02-26T02:33:18.211 DEBUG:teuthology.orchestra.run.trial093:> rpm -q kernel | sort -rV | head -n 1 2026-02-26T02:33:18.277 INFO:teuthology.orchestra.run.trial093.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.277 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-26T02:33:18.278 DEBUG:teuthology.orchestra.run.trial093:> sudo rpm -qi grub2-tools 2026-02-26T02:33:18.345 INFO:teuthology.orchestra.run.trial093.stdout:Name : grub2-tools 2026-02-26T02:33:18.345 INFO:teuthology.orchestra.run.trial093.stdout:Epoch : 1 2026-02-26T02:33:18.345 INFO:teuthology.orchestra.run.trial093.stdout:Version : 2.06 2026-02-26T02:33:18.345 INFO:teuthology.orchestra.run.trial093.stdout:Release : 120.el9 2026-02-26T02:33:18.345 INFO:teuthology.orchestra.run.trial093.stdout:Architecture: x86_64 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Group : Unspecified 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Size : 9108611 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:License : GPLv3+ 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Packager : builder@centos.org 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Vendor : CentOS 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Summary : Support tools for GRUB. 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:Description : 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-26T02:33:18.346 INFO:teuthology.orchestra.run.trial093.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-26T02:33:18.347 INFO:teuthology.orchestra.run.trial093.stdout:hardware devices. 2026-02-26T02:33:18.347 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:33:18.347 INFO:teuthology.orchestra.run.trial093.stdout:This subpackage provides tools for support of all platforms. 2026-02-26T02:33:18.347 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-26T02:33:18.348 INFO:teuthology.task.kernel:Updating grub on trial093 to boot 5.14.0-686.el9.x86_64 2026-02-26T02:33:18.348 DEBUG:teuthology.orchestra.run.trial093:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-26T02:33:18.413 INFO:teuthology.orchestra.run.trial093.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-26T02:33:18.415 DEBUG:teuthology.orchestra.run.trial093:> sudo command -v grubby && echo yes || echo no 2026-02-26T02:33:18.477 INFO:teuthology.orchestra.run.trial093.stdout:/sbin/grubby 2026-02-26T02:33:18.479 INFO:teuthology.orchestra.run.trial093.stdout:yes 2026-02-26T02:33:18.479 DEBUG:teuthology.orchestra.run.trial093:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-26T02:33:18.542 INFO:teuthology.orchestra.run.trial093.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-26T02:33:18.542 DEBUG:teuthology.orchestra.run.trial093:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.616 DEBUG:teuthology.orchestra.run.trial093:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-26T02:33:18.827 INFO:teuthology.orchestra.run.trial093.stderr:Generating grub configuration file ... 2026-02-26T02:33:18.896 INFO:teuthology.orchestra.run.trial093.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-26T02:33:18.902 INFO:teuthology.orchestra.run.trial093.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-26T02:33:19.154 INFO:teuthology.orchestra.run.trial093.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-26T02:33:19.160 INFO:teuthology.orchestra.run.trial093.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-26T02:33:19.194 INFO:teuthology.orchestra.run.trial093.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-26T02:33:19.200 INFO:teuthology.orchestra.run.trial093.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-26T02:33:19.231 INFO:teuthology.orchestra.run.trial093.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-26T02:33:19.238 INFO:teuthology.orchestra.run.trial093.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-26T02:33:19.261 INFO:teuthology.orchestra.run.trial093.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-26T02:33:19.268 INFO:teuthology.orchestra.run.trial093.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-26T02:33:19.355 INFO:teuthology.orchestra.run.trial093.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-26T02:33:19.364 INFO:teuthology.orchestra.run.trial093.stderr:done 2026-02-26T02:33:19.366 DEBUG:teuthology.orchestra.run.trial093:> test -d /sys/firmware/efi 2026-02-26T02:33:19.382 DEBUG:teuthology.orchestra.run.trial093:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-26T02:33:19.447 INFO:teuthology.orchestra.run.trial093.stdout:/boot/efi/EFI/BOOT 2026-02-26T02:33:19.447 INFO:teuthology.orchestra.run.trial093.stdout:/boot/efi/EFI/centos 2026-02-26T02:33:19.449 DEBUG:teuthology.orchestra.run.trial093:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-26T02:33:19.514 INFO:teuthology.orchestra.run.trial093.stdout:no 2026-02-26T02:33:19.515 DEBUG:teuthology.orchestra.run.trial093:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-26T02:33:19.579 INFO:teuthology.orchestra.run.trial093.stdout:yes 2026-02-26T02:33:19.580 DEBUG:teuthology.orchestra.run.trial093:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-26T02:33:19.645 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial093 2026-02-26T02:33:19.645 DEBUG:teuthology.orchestra.run.trial093:> sudo bash -c ' 2026-02-26T02:33:19.645 DEBUG:teuthology.orchestra.run.trial093:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-26T02:33:19.645 DEBUG:teuthology.orchestra.run.trial093:> ' 2026-02-26T02:33:33.720 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-26T02:33:33.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial130.front.sepia.ceph.com' 2026-02-26T02:33:33.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:33:48.032 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.130 2026-02-26T02:33:49.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-26T02:33:49.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-26T02:33:49.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:33:57.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial130.front.sepia.ceph.com' 2026-02-26T02:33:57.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:34:01.458 DEBUG:teuthology.orchestra.remote:timed out 2026-02-26T02:34:03.532 DEBUG:teuthology.orchestra.remote:timed out 2026-02-26T02:34:03.967 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.93 2026-02-26T02:34:10.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial192.front.sepia.ceph.com' 2026-02-26T02:34:10.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:34:10.543 DEBUG:teuthology.orchestra.run.trial192:> true 2026-02-26T02:34:10.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial192.front.sepia.ceph.com' 2026-02-26T02:34:10.683 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-686.el9.x86_64"... 2026-02-26T02:34:10.683 DEBUG:teuthology.orchestra.run.trial192:> uname -r 2026-02-26T02:34:10.738 INFO:teuthology.orchestra.run.trial192.stdout:5.14.0-686.el9.x86_64 2026-02-26T02:34:10.738 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-26T02:34:10.739 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-26T02:34:10.739 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-26T02:34:11.740 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-26T02:34:11.740 DEBUG:teuthology.orchestra.run.trial192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-26T02:34:11.771 INFO:teuthology.orchestra.run.trial192.stdout:ttyS1 2026-02-26T02:34:11.800 DEBUG:teuthology.parallel:result is None 2026-02-26T02:34:12.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-26T02:34:12.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:34:12.680 DEBUG:teuthology.orchestra.run.trial161:> true 2026-02-26T02:34:12.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-26T02:34:12.839 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-686.el9.x86_64"... 2026-02-26T02:34:12.839 DEBUG:teuthology.orchestra.run.trial161:> uname -r 2026-02-26T02:34:12.895 INFO:teuthology.orchestra.run.trial161.stdout:5.14.0-686.el9.x86_64 2026-02-26T02:34:12.896 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-26T02:34:12.896 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-26T02:34:12.896 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-26T02:34:12.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-26T02:34:12.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:34:13.897 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-26T02:34:13.898 DEBUG:teuthology.orchestra.run.trial161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-26T02:34:13.929 INFO:teuthology.orchestra.run.trial161.stdout:ttyS1 2026-02-26T02:34:13.946 DEBUG:teuthology.parallel:result is None 2026-02-26T02:34:32.787 DEBUG:teuthology.orchestra.run.trial130:> true 2026-02-26T02:34:32.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial130.front.sepia.ceph.com' 2026-02-26T02:34:32.942 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-686.el9.x86_64"... 2026-02-26T02:34:32.942 DEBUG:teuthology.orchestra.run.trial130:> uname -r 2026-02-26T02:34:32.997 INFO:teuthology.orchestra.run.trial130.stdout:5.14.0-686.el9.x86_64 2026-02-26T02:34:32.997 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-26T02:34:32.997 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-26T02:34:32.997 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-26T02:34:33.998 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-26T02:34:33.998 DEBUG:teuthology.orchestra.run.trial130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-26T02:34:34.028 INFO:teuthology.orchestra.run.trial130.stdout:ttyS1 2026-02-26T02:34:34.049 DEBUG:teuthology.parallel:result is None 2026-02-26T02:34:49.188 DEBUG:teuthology.orchestra.run.trial093:> true 2026-02-26T02:34:49.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-26T02:34:49.338 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-26T02:34:49.338 DEBUG:teuthology.orchestra.run.trial093:> uname -r 2026-02-26T02:34:49.395 INFO:teuthology.orchestra.run.trial093.stdout:5.14.0-686.el9.x86_64 2026-02-26T02:34:49.395 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-26T02:34:49.395 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-26T02:34:49.395 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-26T02:34:50.396 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-26T02:34:50.396 DEBUG:teuthology.orchestra.run.trial093:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-26T02:34:50.426 INFO:teuthology.orchestra.run.trial093.stdout:ttyS1 2026-02-26T02:34:50.454 DEBUG:teuthology.parallel:result is None 2026-02-26T02:34:50.454 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-26T02:34:50.466 INFO:teuthology.task.internal:Creating test directory... 2026-02-26T02:34:50.466 DEBUG:teuthology.orchestra.run.trial093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-26T02:34:50.497 DEBUG:teuthology.orchestra.run.trial130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-26T02:34:50.500 DEBUG:teuthology.orchestra.run.trial161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-26T02:34:50.503 DEBUG:teuthology.orchestra.run.trial192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-26T02:34:50.522 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-26T02:34:50.533 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-26T02:34:50.547 INFO:teuthology.task.internal:Creating archive directory... 2026-02-26T02:34:50.547 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-26T02:34:50.553 DEBUG:teuthology.orchestra.run.trial130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-26T02:34:50.557 DEBUG:teuthology.orchestra.run.trial161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-26T02:34:50.560 DEBUG:teuthology.orchestra.run.trial192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-26T02:34:50.581 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-26T02:34:50.593 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-26T02:34:50.593 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-26T02:34:50.609 DEBUG:teuthology.orchestra.run.trial130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-26T02:34:50.613 DEBUG:teuthology.orchestra.run.trial161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-26T02:34:50.617 DEBUG:teuthology.orchestra.run.trial192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-26T02:34:50.630 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.635 INFO:teuthology.orchestra.run.trial130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.639 INFO:teuthology.orchestra.run.trial161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.639 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.642 INFO:teuthology.orchestra.run.trial192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.644 INFO:teuthology.orchestra.run.trial130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.649 INFO:teuthology.orchestra.run.trial161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.651 INFO:teuthology.orchestra.run.trial192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-26T02:34:50.653 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-26T02:34:50.663 INFO:teuthology.task.internal:Configuring sudo... 2026-02-26T02:34:50.664 DEBUG:teuthology.orchestra.run.trial093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-26T02:34:50.682 DEBUG:teuthology.orchestra.run.trial130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-26T02:34:50.689 DEBUG:teuthology.orchestra.run.trial161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-26T02:34:50.693 DEBUG:teuthology.orchestra.run.trial192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-26T02:34:50.717 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-26T02:34:50.730 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-26T02:34:50.730 DEBUG:teuthology.orchestra.run.trial093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-26T02:34:50.746 DEBUG:teuthology.orchestra.run.trial130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-26T02:34:50.752 DEBUG:teuthology.orchestra.run.trial161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-26T02:34:50.757 DEBUG:teuthology.orchestra.run.trial192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-26T02:34:50.773 DEBUG:teuthology.orchestra.run.trial093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:50.875 DEBUG:teuthology.orchestra.run.trial093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:50.899 DEBUG:teuthology.orchestra.run.trial093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:51.018 DEBUG:teuthology.orchestra.run.trial093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:51.042 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:34:51.042 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-26T02:34:51.106 DEBUG:teuthology.orchestra.run.trial130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:51.215 DEBUG:teuthology.orchestra.run.trial130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:51.240 DEBUG:teuthology.orchestra.run.trial130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:51.369 DEBUG:teuthology.orchestra.run.trial130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:51.394 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:34:51.395 DEBUG:teuthology.orchestra.run.trial130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-26T02:34:51.459 DEBUG:teuthology.orchestra.run.trial161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:51.537 DEBUG:teuthology.orchestra.run.trial161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:51.560 DEBUG:teuthology.orchestra.run.trial161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:51.678 DEBUG:teuthology.orchestra.run.trial161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:51.701 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:34:51.702 DEBUG:teuthology.orchestra.run.trial161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-26T02:34:51.765 DEBUG:teuthology.orchestra.run.trial192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:51.842 DEBUG:teuthology.orchestra.run.trial192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:34:51.866 DEBUG:teuthology.orchestra.run.trial192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:51.982 DEBUG:teuthology.orchestra.run.trial192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:34:52.005 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:34:52.005 DEBUG:teuthology.orchestra.run.trial192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-26T02:34:52.068 DEBUG:teuthology.orchestra.run.trial093:> sudo service rsyslog restart 2026-02-26T02:34:52.070 DEBUG:teuthology.orchestra.run.trial130:> sudo service rsyslog restart 2026-02-26T02:34:52.072 DEBUG:teuthology.orchestra.run.trial161:> sudo service rsyslog restart 2026-02-26T02:34:52.074 DEBUG:teuthology.orchestra.run.trial192:> sudo service rsyslog restart 2026-02-26T02:34:52.097 INFO:teuthology.orchestra.run.trial093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:34:52.099 INFO:teuthology.orchestra.run.trial130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:34:52.101 INFO:teuthology.orchestra.run.trial161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:34:52.136 INFO:teuthology.orchestra.run.trial192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:34:52.621 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-26T02:34:52.633 INFO:teuthology.task.internal:Starting timer... 2026-02-26T02:34:52.633 INFO:teuthology.run_tasks:Running task pcp... 2026-02-26T02:34:52.657 INFO:teuthology.run_tasks:Running task selinux... 2026-02-26T02:34:52.674 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-26T02:34:52.675 DEBUG:teuthology.orchestra.run.trial093:> sudo service auditd rotate 2026-02-26T02:34:52.703 INFO:teuthology.orchestra.run.trial093.stdout:Rotating logs: 2026-02-26T02:34:52.705 DEBUG:teuthology.orchestra.run.trial130:> sudo service auditd rotate 2026-02-26T02:34:52.735 INFO:teuthology.orchestra.run.trial130.stdout:Rotating logs: 2026-02-26T02:34:52.737 DEBUG:teuthology.orchestra.run.trial161:> sudo service auditd rotate 2026-02-26T02:34:52.767 INFO:teuthology.orchestra.run.trial161.stdout:Rotating logs: 2026-02-26T02:34:52.769 DEBUG:teuthology.orchestra.run.trial192:> sudo service auditd rotate 2026-02-26T02:34:52.798 INFO:teuthology.orchestra.run.trial192.stdout:Rotating logs: 2026-02-26T02:34:52.801 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-26T02:34:52.801 DEBUG:teuthology.orchestra.run.trial093:> /usr/sbin/getenforce 2026-02-26T02:34:52.819 INFO:teuthology.orchestra.run.trial093.stdout:Permissive 2026-02-26T02:34:52.819 DEBUG:teuthology.orchestra.run.trial130:> /usr/sbin/getenforce 2026-02-26T02:34:52.838 INFO:teuthology.orchestra.run.trial130.stdout:Permissive 2026-02-26T02:34:52.838 DEBUG:teuthology.orchestra.run.trial161:> /usr/sbin/getenforce 2026-02-26T02:34:52.856 INFO:teuthology.orchestra.run.trial161.stdout:Permissive 2026-02-26T02:34:52.856 DEBUG:teuthology.orchestra.run.trial192:> /usr/sbin/getenforce 2026-02-26T02:34:52.872 INFO:teuthology.orchestra.run.trial192.stdout:Permissive 2026-02-26T02:34:52.873 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial093.front.sepia.ceph.com': 'permissive', 'ubuntu@trial130.front.sepia.ceph.com': 'permissive', 'ubuntu@trial161.front.sepia.ceph.com': 'permissive', 'ubuntu@trial192.front.sepia.ceph.com': 'permissive'} 2026-02-26T02:34:52.873 DEBUG:teuthology.orchestra.run.trial093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:34:52.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:34:52.897 DEBUG:teuthology.orchestra.run.trial130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:34:52.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:34:52.925 DEBUG:teuthology.orchestra.run.trial161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:34:52.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:34:52.951 DEBUG:teuthology.orchestra.run.trial192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:34:52.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:34:52.978 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-26T02:34:52.978 DEBUG:teuthology.orchestra.run.trial093:> sudo /usr/sbin/setenforce permissive 2026-02-26T02:34:53.003 DEBUG:teuthology.orchestra.run.trial130:> sudo /usr/sbin/setenforce permissive 2026-02-26T02:34:53.028 DEBUG:teuthology.orchestra.run.trial161:> sudo /usr/sbin/setenforce permissive 2026-02-26T02:34:53.053 DEBUG:teuthology.orchestra.run.trial192:> sudo /usr/sbin/setenforce permissive 2026-02-26T02:34:53.078 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-26T02:34:53.094 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-26T02:34:53.103 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-26T02:34:53.104 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial093.front.sepia.ceph.com,trial130.front.sepia.ceph.com,trial161.front.sepia.ceph.com,trial192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-26T02:37:48.271 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial093.front.sepia.ceph.com'), Remote(name='ubuntu@trial130.front.sepia.ceph.com'), Remote(name='ubuntu@trial161.front.sepia.ceph.com'), Remote(name='ubuntu@trial192.front.sepia.ceph.com')] 2026-02-26T02:37:48.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-26T02:37:48.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:37:48.357 DEBUG:teuthology.orchestra.run.trial093:> true 2026-02-26T02:37:48.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial093.front.sepia.ceph.com' 2026-02-26T02:37:48.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial130.front.sepia.ceph.com' 2026-02-26T02:37:48.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:37:48.522 DEBUG:teuthology.orchestra.run.trial130:> true 2026-02-26T02:37:48.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial130.front.sepia.ceph.com' 2026-02-26T02:37:48.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-26T02:37:48.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:37:48.663 DEBUG:teuthology.orchestra.run.trial161:> true 2026-02-26T02:37:48.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial161.front.sepia.ceph.com' 2026-02-26T02:37:48.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial192.front.sepia.ceph.com' 2026-02-26T02:37:48.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-26T02:37:48.813 DEBUG:teuthology.orchestra.run.trial192:> true 2026-02-26T02:37:48.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial192.front.sepia.ceph.com' 2026-02-26T02:37:48.890 INFO:teuthology.run_tasks:Running task clock... 2026-02-26T02:37:48.903 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-26T02:37:48.903 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-26T02:37:48.904 DEBUG:teuthology.orchestra.run.trial093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:37:48.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-26T02:37:48.906 DEBUG:teuthology.orchestra.run.trial130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:37:48.907 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-26T02:37:48.907 DEBUG:teuthology.orchestra.run.trial161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:37:48.909 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-26T02:37:48.909 DEBUG:teuthology.orchestra.run.trial192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:37:48.932 INFO:teuthology.orchestra.run.trial093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-26T02:37:48.933 INFO:teuthology.orchestra.run.trial130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-26T02:37:48.935 INFO:teuthology.orchestra.run.trial161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-26T02:37:48.944 INFO:teuthology.orchestra.run.trial093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-26T02:37:48.946 INFO:teuthology.orchestra.run.trial130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-26T02:37:48.947 INFO:teuthology.orchestra.run.trial161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-26T02:37:48.955 INFO:teuthology.orchestra.run.trial192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-26T02:37:48.964 INFO:teuthology.orchestra.run.trial093.stderr:sudo: ntpd: command not found 2026-02-26T02:37:48.966 INFO:teuthology.orchestra.run.trial192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-26T02:37:48.967 INFO:teuthology.orchestra.run.trial161.stderr:sudo: ntpd: command not found 2026-02-26T02:37:48.967 INFO:teuthology.orchestra.run.trial130.stderr:sudo: ntpd: command not found 2026-02-26T02:37:48.973 INFO:teuthology.orchestra.run.trial093.stdout:506 Cannot talk to daemon 2026-02-26T02:37:48.977 INFO:teuthology.orchestra.run.trial130.stdout:506 Cannot talk to daemon 2026-02-26T02:37:48.978 INFO:teuthology.orchestra.run.trial161.stdout:506 Cannot talk to daemon 2026-02-26T02:37:48.985 INFO:teuthology.orchestra.run.trial093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-26T02:37:48.986 INFO:teuthology.orchestra.run.trial192.stderr:sudo: ntpd: command not found 2026-02-26T02:37:48.989 INFO:teuthology.orchestra.run.trial161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-26T02:37:48.990 INFO:teuthology.orchestra.run.trial130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-26T02:37:48.994 INFO:teuthology.orchestra.run.trial192.stdout:506 Cannot talk to daemon 2026-02-26T02:37:48.996 INFO:teuthology.orchestra.run.trial093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-26T02:37:49.001 INFO:teuthology.orchestra.run.trial161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-26T02:37:49.001 INFO:teuthology.orchestra.run.trial130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-26T02:37:49.005 INFO:teuthology.orchestra.run.trial192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-26T02:37:49.016 INFO:teuthology.orchestra.run.trial192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-26T02:37:49.041 INFO:teuthology.orchestra.run.trial093.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:37:49.049 INFO:teuthology.orchestra.run.trial161.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:37:49.052 INFO:teuthology.orchestra.run.trial161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:37:49.052 INFO:teuthology.orchestra.run.trial161.stdout:=============================================================================== 2026-02-26T02:37:49.052 INFO:teuthology.orchestra.run.trial161.stdout:^? dns-e.ns4v.icu 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.052 INFO:teuthology.orchestra.run.trial161.stdout:^? 50-203-248-23-static.hfc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.052 INFO:teuthology.orchestra.run.trial161.stdout:^? 172-104-28-175.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.052 INFO:teuthology.orchestra.run.trial161.stdout:^? 23.186.168.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.054 INFO:teuthology.orchestra.run.trial130.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:37:49.057 INFO:teuthology.orchestra.run.trial130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:37:49.057 INFO:teuthology.orchestra.run.trial130.stdout:=============================================================================== 2026-02-26T02:37:49.057 INFO:teuthology.orchestra.run.trial130.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.057 INFO:teuthology.orchestra.run.trial130.stdout:^? fairy0.mattnordhoffdns.n> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.057 INFO:teuthology.orchestra.run.trial130.stdout:^? ntp.sfo.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.058 INFO:teuthology.orchestra.run.trial130.stdout:^? 107-172-222-7-host.coloc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.060 INFO:teuthology.orchestra.run.trial093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:37:49.060 INFO:teuthology.orchestra.run.trial093.stdout:=============================================================================== 2026-02-26T02:37:49.060 INFO:teuthology.orchestra.run.trial093.stdout:^? 69-10-208-170.rainiercon> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.061 INFO:teuthology.orchestra.run.trial093.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.061 INFO:teuthology.orchestra.run.trial093.stdout:^? kc1cloud.147.72.155.23.m> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.061 INFO:teuthology.orchestra.run.trial093.stdout:^? 50.205.57.38 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.062 INFO:teuthology.orchestra.run.trial192.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:37:49.386 INFO:teuthology.orchestra.run.trial192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:37:49.386 INFO:teuthology.orchestra.run.trial192.stdout:=============================================================================== 2026-02-26T02:37:49.386 INFO:teuthology.orchestra.run.trial192.stdout:^? time.gslb.gravinoc.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.386 INFO:teuthology.orchestra.run.trial192.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.386 INFO:teuthology.orchestra.run.trial192.stdout:^? 69.9.131.124 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.386 INFO:teuthology.orchestra.run.trial192.stdout:^? ntp.nyc.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-26T02:37:49.387 INFO:teuthology.run_tasks:Running task install... 2026-02-26T02:37:49.406 DEBUG:teuthology.task.install:project ceph 2026-02-26T02:37:49.406 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5'}} 2026-02-26T02:37:49.406 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5'} 2026-02-26T02:37:49.407 INFO:teuthology.task.install:Using flavor: default 2026-02-26T02:37:49.415 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-26T02:37:49.415 INFO:teuthology.task.install:extra packages: [] 2026-02-26T02:37:49.416 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'tag': None, 'wait_for_package': False} 2026-02-26T02:37:49.417 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:37:49.420 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'tag': None, 'wait_for_package': False} 2026-02-26T02:37:49.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:37:49.422 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'tag': None, 'wait_for_package': False} 2026-02-26T02:37:49.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:37:49.424 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'tag': None, 'wait_for_package': False} 2026-02-26T02:37:49.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:37:49.683 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/ 2026-02-26T02:37:49.683 INFO:teuthology.task.install.rpm:Package version is 19.2.3-687.g8d724284 2026-02-26T02:37:49.685 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/ 2026-02-26T02:37:49.685 INFO:teuthology.task.install.rpm:Package version is 19.2.3-687.g8d724284 2026-02-26T02:37:49.687 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/ 2026-02-26T02:37:49.687 INFO:teuthology.task.install.rpm:Package version is 19.2.3-687.g8d724284 2026-02-26T02:37:49.693 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/ 2026-02-26T02:37:49.693 INFO:teuthology.task.install.rpm:Package version is 19.2.3-687.g8d724284 2026-02-26T02:37:50.075 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T02:37:50.075 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:37:50.075 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T02:37:50.076 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T02:37:50.076 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:37:50.076 DEBUG:teuthology.orchestra.run.trial130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T02:37:50.079 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T02:37:50.079 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:37:50.079 DEBUG:teuthology.orchestra.run.trial161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T02:37:50.103 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-26T02:37:50.103 DEBUG:teuthology.orchestra.run.trial093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T02:37:50.104 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-26T02:37:50.104 DEBUG:teuthology.orchestra.run.trial130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T02:37:50.105 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-26T02:37:50.105 DEBUG:teuthology.orchestra.run.trial161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T02:37:50.125 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri9-testing-2026-02-25-1600-squid/8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-26T02:37:50.125 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:37:50.125 DEBUG:teuthology.orchestra.run.trial192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-26T02:37:50.150 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-26T02:37:50.150 DEBUG:teuthology.orchestra.run.trial192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-26T02:37:50.168 DEBUG:teuthology.orchestra.run.trial093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T02:37:50.170 DEBUG:teuthology.orchestra.run.trial130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T02:37:50.171 DEBUG:teuthology.orchestra.run.trial161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T02:37:50.215 DEBUG:teuthology.orchestra.run.trial192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-26T02:37:50.241 DEBUG:teuthology.orchestra.run.trial093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T02:37:50.243 DEBUG:teuthology.orchestra.run.trial161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T02:37:50.245 DEBUG:teuthology.orchestra.run.trial130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T02:37:50.288 DEBUG:teuthology.orchestra.run.trial192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-26T02:37:50.304 INFO:teuthology.orchestra.run.trial093.stdout:check_obsoletes = 1 2026-02-26T02:37:50.305 DEBUG:teuthology.orchestra.run.trial093:> sudo yum clean all 2026-02-26T02:37:50.308 INFO:teuthology.orchestra.run.trial161.stdout:check_obsoletes = 1 2026-02-26T02:37:50.309 DEBUG:teuthology.orchestra.run.trial161:> sudo yum clean all 2026-02-26T02:37:50.309 INFO:teuthology.orchestra.run.trial130.stdout:check_obsoletes = 1 2026-02-26T02:37:50.310 DEBUG:teuthology.orchestra.run.trial130:> sudo yum clean all 2026-02-26T02:37:50.352 INFO:teuthology.orchestra.run.trial192.stdout:check_obsoletes = 1 2026-02-26T02:37:50.353 DEBUG:teuthology.orchestra.run.trial192:> sudo yum clean all 2026-02-26T02:37:50.454 INFO:teuthology.orchestra.run.trial093.stdout:41 files removed 2026-02-26T02:37:50.459 INFO:teuthology.orchestra.run.trial161.stdout:41 files removed 2026-02-26T02:37:50.460 INFO:teuthology.orchestra.run.trial130.stdout:41 files removed 2026-02-26T02:37:50.469 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-radosgw 2026-02-26T02:37:50.474 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-radosgw 2026-02-26T02:37:50.476 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-radosgw 2026-02-26T02:37:50.501 INFO:teuthology.orchestra.run.trial192.stdout:41 files removed 2026-02-26T02:37:50.514 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-radosgw 2026-02-26T02:37:50.805 INFO:teuthology.orchestra.run.trial093.stdout:ceph packages for x86_64 459 kB/s | 86 kB 00:00 2026-02-26T02:37:50.806 INFO:teuthology.orchestra.run.trial130.stdout:ceph packages for x86_64 466 kB/s | 86 kB 00:00 2026-02-26T02:37:50.808 INFO:teuthology.orchestra.run.trial161.stdout:ceph packages for x86_64 481 kB/s | 86 kB 00:00 2026-02-26T02:37:50.821 INFO:teuthology.orchestra.run.trial192.stdout:ceph packages for x86_64 535 kB/s | 86 kB 00:00 2026-02-26T02:37:50.944 INFO:teuthology.orchestra.run.trial130.stdout:ceph noarch packages 108 kB/s | 12 kB 00:00 2026-02-26T02:37:50.948 INFO:teuthology.orchestra.run.trial161.stdout:ceph noarch packages 106 kB/s | 12 kB 00:00 2026-02-26T02:37:50.960 INFO:teuthology.orchestra.run.trial192.stdout:ceph noarch packages 108 kB/s | 12 kB 00:00 2026-02-26T02:37:51.075 INFO:teuthology.orchestra.run.trial130.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-26T02:37:51.079 INFO:teuthology.orchestra.run.trial161.stdout:ceph source packages 17 kB/s | 1.9 kB 00:00 2026-02-26T02:37:51.089 INFO:teuthology.orchestra.run.trial192.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-26T02:37:52.657 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.9 MB 00:01 2026-02-26T02:37:54.880 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.9 MB 00:03 2026-02-26T02:37:55.840 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-26T02:37:57.136 INFO:teuthology.orchestra.run.trial093.stdout:ceph noarch packages 1.9 kB/s | 12 kB 00:06 2026-02-26T02:37:57.273 INFO:teuthology.orchestra.run.trial093.stdout:ceph source packages 17 kB/s | 1.9 kB 00:00 2026-02-26T02:37:58.106 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-26T02:38:00.006 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-26T02:38:01.503 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 27 MB 00:02 2026-02-26T02:38:03.620 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 27 MB 00:03 2026-02-26T02:38:04.339 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 27 MB 00:08 2026-02-26T02:38:07.364 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 8.0 MB 00:01 2026-02-26T02:38:07.398 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - CRB 889 kB/s | 8.0 MB 00:09 2026-02-26T02:38:07.904 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 8.0 MB 00:01 2026-02-26T02:38:08.514 INFO:teuthology.orchestra.run.trial161.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 20 kB 00:00 2026-02-26T02:38:08.670 INFO:teuthology.orchestra.run.trial130.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 20 kB 00:00 2026-02-26T02:38:08.908 INFO:teuthology.orchestra.run.trial161.stdout:Extra Packages for Enterprise Linux 62 MB/s | 20 MB 00:00 2026-02-26T02:38:09.069 INFO:teuthology.orchestra.run.trial130.stdout:Extra Packages for Enterprise Linux 61 MB/s | 20 MB 00:00 2026-02-26T02:38:09.894 INFO:teuthology.orchestra.run.trial192.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-26T02:38:10.712 INFO:teuthology.orchestra.run.trial192.stdout:Extra Packages for Enterprise Linux 27 MB/s | 20 MB 00:00 2026-02-26T02:38:12.106 INFO:teuthology.orchestra.run.trial161.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-26T02:38:12.343 INFO:teuthology.orchestra.run.trial130.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-26T02:38:12.974 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - CRB 900 kB/s | 8.0 MB 00:09 2026-02-26T02:38:13.338 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repository Size 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: ceph-radosgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout:Upgrading: 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: librados2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.4 M 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: librbd1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.2 M 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout:Installing dependencies: 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: ceph-base x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.5 M 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 22 M 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: ceph-selinux x86_64 2:19.2.3-687.g8d724284.el9 ceph 25 k 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: libcephfs2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 999 k 2026-02-26T02:38:13.339 INFO:teuthology.orchestra.run.trial161.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: libradosstriper1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 504 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: librgw2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.4 M 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: python3-ceph-argparse x86_64 2:19.2.3-687.g8d724284.el9 ceph 45 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: python3-ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 142 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: python3-cephfs x86_64 2:19.2.3-687.g8d724284.el9 ceph 165 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: python3-rados x86_64 2:19.2.3-687.g8d724284.el9 ceph 321 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: python3-rbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 303 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: python3-rgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 100 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout:Installing weak dependencies: 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout:Install 33 Packages 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout:Upgrade 2 Packages 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 63 M 2026-02-26T02:38:13.340 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:38:13.574 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repository Size 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout: ceph-radosgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout:Upgrading: 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout: librados2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.4 M 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout: librbd1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.2 M 2026-02-26T02:38:13.576 INFO:teuthology.orchestra.run.trial130.stdout:Installing dependencies: 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: ceph-base x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.5 M 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 22 M 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: ceph-selinux x86_64 2:19.2.3-687.g8d724284.el9 ceph 25 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: libcephfs2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 999 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-26T02:38:13.577 INFO:teuthology.orchestra.run.trial130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: libradosstriper1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 504 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: librgw2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.4 M 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: python3-ceph-argparse x86_64 2:19.2.3-687.g8d724284.el9 ceph 45 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: python3-ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 142 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: python3-cephfs x86_64 2:19.2.3-687.g8d724284.el9 ceph 165 k 2026-02-26T02:38:13.578 INFO:teuthology.orchestra.run.trial130.stdout: python3-rados x86_64 2:19.2.3-687.g8d724284.el9 ceph 321 k 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: python3-rbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 303 k 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: python3-rgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 100 k 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout:Installing weak dependencies: 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:38:13.579 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:38:13.580 INFO:teuthology.orchestra.run.trial130.stdout:Install 33 Packages 2026-02-26T02:38:13.580 INFO:teuthology.orchestra.run.trial130.stdout:Upgrade 2 Packages 2026-02-26T02:38:13.580 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:13.581 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 63 M 2026-02-26T02:38:13.581 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:38:13.931 INFO:teuthology.orchestra.run.trial192.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-26T02:38:14.170 INFO:teuthology.orchestra.run.trial093.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 20 kB 00:00 2026-02-26T02:38:14.651 INFO:teuthology.orchestra.run.trial093.stdout:Extra Packages for Enterprise Linux 49 MB/s | 20 MB 00:00 2026-02-26T02:38:15.149 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:38:15.151 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:38:15.151 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repository Size 2026-02-26T02:38:15.151 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:38:15.151 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:38:15.151 INFO:teuthology.orchestra.run.trial192.stdout: ceph-radosgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout:Upgrading: 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: librados2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.4 M 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: librbd1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.2 M 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout:Installing dependencies: 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: ceph-base x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.5 M 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 22 M 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: ceph-selinux x86_64 2:19.2.3-687.g8d724284.el9 ceph 25 k 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-26T02:38:15.152 INFO:teuthology.orchestra.run.trial192.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: libcephfs2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 999 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: libradosstriper1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 504 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: librgw2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.4 M 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-26T02:38:15.153 INFO:teuthology.orchestra.run.trial192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: python3-ceph-argparse x86_64 2:19.2.3-687.g8d724284.el9 ceph 45 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: python3-ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 142 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: python3-cephfs x86_64 2:19.2.3-687.g8d724284.el9 ceph 165 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: python3-rados x86_64 2:19.2.3-687.g8d724284.el9 ceph 321 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: python3-rbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 303 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: python3-rgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 100 k 2026-02-26T02:38:15.154 INFO:teuthology.orchestra.run.trial192.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout:Installing weak dependencies: 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:38:15.155 INFO:teuthology.orchestra.run.trial192.stdout:Install 33 Packages 2026-02-26T02:38:15.156 INFO:teuthology.orchestra.run.trial192.stdout:Upgrade 2 Packages 2026-02-26T02:38:15.156 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:15.157 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 63 M 2026-02-26T02:38:15.157 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:38:16.094 INFO:teuthology.orchestra.run.trial130.stdout:(1/35): ceph-base-19.2.3-687.g8d724284.el9.x86_ 2.8 MB/s | 5.5 MB 00:01 2026-02-26T02:38:16.161 INFO:teuthology.orchestra.run.trial130.stdout:(2/35): ceph-selinux-19.2.3-687.g8d724284.el9.x 376 kB/s | 25 kB 00:00 2026-02-26T02:38:16.226 INFO:teuthology.orchestra.run.trial130.stdout:(3/35): ceph-radosgw-19.2.3-687.g8d724284.el9.x 5.0 MB/s | 11 MB 00:02 2026-02-26T02:38:16.418 INFO:teuthology.orchestra.run.trial130.stdout:(4/35): libradosstriper1-19.2.3-687.g8d724284.e 2.6 MB/s | 504 kB 00:00 2026-02-26T02:38:16.539 INFO:teuthology.orchestra.run.trial130.stdout:(5/35): libcephfs2-19.2.3-687.g8d724284.el9.x86 2.6 MB/s | 999 kB 00:00 2026-02-26T02:38:16.598 INFO:teuthology.orchestra.run.trial130.stdout:(6/35): python3-ceph-argparse-19.2.3-687.g8d724 770 kB/s | 45 kB 00:00 2026-02-26T02:38:16.659 INFO:teuthology.orchestra.run.trial130.stdout:(7/35): python3-ceph-common-19.2.3-687.g8d72428 2.3 MB/s | 142 kB 00:00 2026-02-26T02:38:16.723 INFO:teuthology.orchestra.run.trial130.stdout:(8/35): python3-cephfs-19.2.3-687.g8d724284.el9 2.5 MB/s | 165 kB 00:00 2026-02-26T02:38:16.849 INFO:teuthology.orchestra.run.trial130.stdout:(9/35): python3-rados-19.2.3-687.g8d724284.el9. 2.5 MB/s | 321 kB 00:00 2026-02-26T02:38:16.976 INFO:teuthology.orchestra.run.trial130.stdout:(10/35): python3-rbd-19.2.3-687.g8d724284.el9.x 2.3 MB/s | 303 kB 00:00 2026-02-26T02:38:17.040 INFO:teuthology.orchestra.run.trial130.stdout:(11/35): python3-rgw-19.2.3-687.g8d724284.el9.x 1.5 MB/s | 100 kB 00:00 2026-02-26T02:38:17.054 INFO:teuthology.orchestra.run.trial130.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 2.3 MB/s | 33 kB 00:00 2026-02-26T02:38:17.074 INFO:teuthology.orchestra.run.trial130.stdout:(13/35): nvme-cli-2.16-1.el9.x86_64.rpm 60 MB/s | 1.2 MB 00:00 2026-02-26T02:38:17.079 INFO:teuthology.orchestra.run.trial130.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 18 MB/s | 93 kB 00:00 2026-02-26T02:38:17.250 INFO:teuthology.orchestra.run.trial130.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 609 kB/s | 104 kB 00:00 2026-02-26T02:38:17.289 INFO:teuthology.orchestra.run.trial130.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 4.1 MB/s | 164 kB 00:00 2026-02-26T02:38:17.293 INFO:teuthology.orchestra.run.trial161.stdout:(1/35): ceph-base-19.2.3-687.g8d724284.el9.x86_ 1.6 MB/s | 5.5 MB 00:03 2026-02-26T02:38:17.311 INFO:teuthology.orchestra.run.trial130.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 7.1 MB/s | 160 kB 00:00 2026-02-26T02:38:17.331 INFO:teuthology.orchestra.run.trial130.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.3 MB/s | 45 kB 00:00 2026-02-26T02:38:17.364 INFO:teuthology.orchestra.run.trial161.stdout:(2/35): ceph-selinux-19.2.3-687.g8d724284.el9.x 353 kB/s | 25 kB 00:00 2026-02-26T02:38:17.371 INFO:teuthology.orchestra.run.trial130.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 662 kB 00:00 2026-02-26T02:38:17.393 INFO:teuthology.orchestra.run.trial130.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 13 MB/s | 292 kB 00:00 2026-02-26T02:38:17.414 INFO:teuthology.orchestra.run.trial130.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 11 MB/s | 240 kB 00:00 2026-02-26T02:38:17.433 INFO:teuthology.orchestra.run.trial130.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.9 MB/s | 37 kB 00:00 2026-02-26T02:38:17.453 INFO:teuthology.orchestra.run.trial130.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.3 MB/s | 66 kB 00:00 2026-02-26T02:38:17.796 INFO:teuthology.orchestra.run.trial093.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-26T02:38:18.005 INFO:teuthology.orchestra.run.trial130.stdout:(24/35): librgw2-19.2.3-687.g8d724284.el9.x86_6 3.4 MB/s | 5.4 MB 00:01 2026-02-26T02:38:18.055 INFO:teuthology.orchestra.run.trial161.stdout:(3/35): libcephfs2-19.2.3-687.g8d724284.el9.x86 1.4 MB/s | 999 kB 00:00 2026-02-26T02:38:18.058 INFO:teuthology.orchestra.run.trial192.stdout:(1/35): ceph-base-19.2.3-687.g8d724284.el9.x86_ 2.3 MB/s | 5.5 MB 00:02 2026-02-26T02:38:18.112 INFO:teuthology.orchestra.run.trial192.stdout:(2/35): ceph-selinux-19.2.3-687.g8d724284.el9.x 464 kB/s | 25 kB 00:00 2026-02-26T02:38:18.388 INFO:teuthology.orchestra.run.trial161.stdout:(4/35): libradosstriper1-19.2.3-687.g8d724284.e 1.5 MB/s | 504 kB 00:00 2026-02-26T02:38:18.509 INFO:teuthology.orchestra.run.trial192.stdout:(3/35): libcephfs2-19.2.3-687.g8d724284.el9.x86 2.5 MB/s | 999 kB 00:00 2026-02-26T02:38:18.741 INFO:teuthology.orchestra.run.trial192.stdout:(4/35): libradosstriper1-19.2.3-687.g8d724284.e 2.1 MB/s | 504 kB 00:00 2026-02-26T02:38:19.018 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repository Size 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout:Upgrading: 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout: librados2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.4 M 2026-02-26T02:38:19.020 INFO:teuthology.orchestra.run.trial093.stdout: librbd1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.2 M 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout:Installing dependencies: 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.5 M 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 22 M 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: ceph-selinux x86_64 2:19.2.3-687.g8d724284.el9 ceph 25 k 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 999 k 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-26T02:38:19.021 INFO:teuthology.orchestra.run.trial093.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: libradosstriper1 x86_64 2:19.2.3-687.g8d724284.el9 ceph 504 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: librgw2 x86_64 2:19.2.3-687.g8d724284.el9 ceph 5.4 M 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-argparse x86_64 2:19.2.3-687.g8d724284.el9 ceph 45 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-common x86_64 2:19.2.3-687.g8d724284.el9 ceph 142 k 2026-02-26T02:38:19.022 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs x86_64 2:19.2.3-687.g8d724284.el9 ceph 165 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados x86_64 2:19.2.3-687.g8d724284.el9 ceph 321 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 303 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw x86_64 2:19.2.3-687.g8d724284.el9 ceph 100 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout:Installing weak dependencies: 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:19.023 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:38:19.024 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:38:19.024 INFO:teuthology.orchestra.run.trial093.stdout:Install 33 Packages 2026-02-26T02:38:19.024 INFO:teuthology.orchestra.run.trial093.stdout:Upgrade 2 Packages 2026-02-26T02:38:19.024 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:19.024 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 63 M 2026-02-26T02:38:19.025 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:38:19.180 INFO:teuthology.orchestra.run.trial130.stdout:(25/35): ceph-common-19.2.3-687.g8d724284.el9.x 4.3 MB/s | 22 MB 00:05 2026-02-26T02:38:19.479 INFO:teuthology.orchestra.run.trial130.stdout:(26/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 152 kB/s | 308 kB 00:02 2026-02-26T02:38:19.495 INFO:teuthology.orchestra.run.trial130.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 3.0 MB/s | 49 kB 00:00 2026-02-26T02:38:19.510 INFO:teuthology.orchestra.run.trial130.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 4.3 MB/s | 67 kB 00:00 2026-02-26T02:38:19.536 INFO:teuthology.orchestra.run.trial130.stdout:(29/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 32 MB/s | 838 kB 00:00 2026-02-26T02:38:19.553 INFO:teuthology.orchestra.run.trial130.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 11 MB/s | 191 kB 00:00 2026-02-26T02:38:19.580 INFO:teuthology.orchestra.run.trial130.stdout:(31/35): thrift-0.15.0-4.el9.x86_64.rpm 59 MB/s | 1.6 MB 00:00 2026-02-26T02:38:19.775 INFO:teuthology.orchestra.run.trial130.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2026-02-26T02:38:19.821 INFO:teuthology.orchestra.run.trial130.stdout:(33/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 39 kB/s | 25 kB 00:00 2026-02-26T02:38:20.358 INFO:teuthology.orchestra.run.trial161.stdout:(5/35): ceph-radosgw-19.2.3-687.g8d724284.el9.x 1.7 MB/s | 11 MB 00:06 2026-02-26T02:38:20.420 INFO:teuthology.orchestra.run.trial161.stdout:(6/35): python3-ceph-argparse-19.2.3-687.g8d724 727 kB/s | 45 kB 00:00 2026-02-26T02:38:20.546 INFO:teuthology.orchestra.run.trial161.stdout:(7/35): python3-ceph-common-19.2.3-687.g8d72428 1.1 MB/s | 142 kB 00:00 2026-02-26T02:38:20.587 INFO:teuthology.orchestra.run.trial192.stdout:(5/35): librgw2-19.2.3-687.g8d724284.el9.x86_64 2.9 MB/s | 5.4 MB 00:01 2026-02-26T02:38:20.650 INFO:teuthology.orchestra.run.trial192.stdout:(6/35): python3-ceph-argparse-19.2.3-687.g8d724 713 kB/s | 45 kB 00:00 2026-02-26T02:38:20.672 INFO:teuthology.orchestra.run.trial161.stdout:(8/35): python3-cephfs-19.2.3-687.g8d724284.el9 1.3 MB/s | 165 kB 00:00 2026-02-26T02:38:20.716 INFO:teuthology.orchestra.run.trial192.stdout:(7/35): python3-ceph-common-19.2.3-687.g8d72428 2.1 MB/s | 142 kB 00:00 2026-02-26T02:38:20.784 INFO:teuthology.orchestra.run.trial192.stdout:(8/35): python3-cephfs-19.2.3-687.g8d724284.el9 2.4 MB/s | 165 kB 00:00 2026-02-26T02:38:20.920 INFO:teuthology.orchestra.run.trial192.stdout:(9/35): python3-rados-19.2.3-687.g8d724284.el9. 2.3 MB/s | 321 kB 00:00 2026-02-26T02:38:20.939 INFO:teuthology.orchestra.run.trial161.stdout:(9/35): python3-rados-19.2.3-687.g8d724284.el9. 1.2 MB/s | 321 kB 00:00 2026-02-26T02:38:20.946 INFO:teuthology.orchestra.run.trial130.stdout:(34/35): librados2-19.2.3-687.g8d724284.el9.x86 2.5 MB/s | 3.4 MB 00:01 2026-02-26T02:38:21.064 INFO:teuthology.orchestra.run.trial192.stdout:(10/35): ceph-common-19.2.3-687.g8d724284.el9.x 4.1 MB/s | 22 MB 00:05 2026-02-26T02:38:21.065 INFO:teuthology.orchestra.run.trial192.stdout:(11/35): python3-rbd-19.2.3-687.g8d724284.el9.x 2.0 MB/s | 303 kB 00:00 2026-02-26T02:38:21.113 INFO:teuthology.orchestra.run.trial130.stdout:(35/35): librbd1-19.2.3-687.g8d724284.el9.x86_6 2.4 MB/s | 3.2 MB 00:01 2026-02-26T02:38:21.118 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:21.118 INFO:teuthology.orchestra.run.trial130.stdout:Total 8.4 MB/s | 63 MB 00:07 2026-02-26T02:38:21.127 INFO:teuthology.orchestra.run.trial192.stdout:(12/35): python3-rgw-19.2.3-687.g8d724284.el9.x 1.6 MB/s | 100 kB 00:00 2026-02-26T02:38:21.174 INFO:teuthology.orchestra.run.trial093.stdout:(1/35): ceph-base-19.2.3-687.g8d724284.el9.x86_ 3.2 MB/s | 5.5 MB 00:01 2026-02-26T02:38:21.177 INFO:teuthology.orchestra.run.trial192.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 295 kB/s | 33 kB 00:00 2026-02-26T02:38:21.183 INFO:teuthology.orchestra.run.trial161.stdout:(10/35): python3-rbd-19.2.3-687.g8d724284.el9.x 1.2 MB/s | 303 kB 00:00 2026-02-26T02:38:21.213 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:38:21.228 INFO:teuthology.orchestra.run.trial093.stdout:(2/35): ceph-selinux-19.2.3-687.g8d724284.el9.x 464 kB/s | 25 kB 00:00 2026-02-26T02:38:21.231 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:38:21.231 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:38:21.241 INFO:teuthology.orchestra.run.trial161.stdout:(11/35): python3-rgw-19.2.3-687.g8d724284.el9.x 1.7 MB/s | 100 kB 00:00 2026-02-26T02:38:21.248 INFO:teuthology.orchestra.run.trial192.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.3 MB/s | 93 kB 00:00 2026-02-26T02:38:21.336 INFO:teuthology.orchestra.run.trial192.stdout:(15/35): nvme-cli-2.16-1.el9.x86_64.rpm 5.5 MB/s | 1.2 MB 00:00 2026-02-26T02:38:21.347 INFO:teuthology.orchestra.run.trial192.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 1.0 MB/s | 104 kB 00:00 2026-02-26T02:38:21.390 INFO:teuthology.orchestra.run.trial192.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.6 MB/s | 160 kB 00:00 2026-02-26T02:38:21.411 INFO:teuthology.orchestra.run.trial192.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.1 MB/s | 45 kB 00:00 2026-02-26T02:38:21.467 INFO:teuthology.orchestra.run.trial192.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 12 MB/s | 662 kB 00:00 2026-02-26T02:38:21.471 INFO:teuthology.orchestra.run.trial093.stdout:(3/35): libcephfs2-19.2.3-687.g8d724284.el9.x86 4.0 MB/s | 999 kB 00:00 2026-02-26T02:38:21.482 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:38:21.483 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:38:21.491 INFO:teuthology.orchestra.run.trial192.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-26T02:38:21.515 INFO:teuthology.orchestra.run.trial192.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 9.9 MB/s | 240 kB 00:00 2026-02-26T02:38:21.521 INFO:teuthology.orchestra.run.trial161.stdout:(12/35): librgw2-19.2.3-687.g8d724284.el9.x86_6 1.7 MB/s | 5.4 MB 00:03 2026-02-26T02:38:21.535 INFO:teuthology.orchestra.run.trial192.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.8 MB/s | 37 kB 00:00 2026-02-26T02:38:21.542 INFO:teuthology.orchestra.run.trial192.stdout:(23/35): libnbd-1.20.3-4.el9.x86_64.rpm 798 kB/s | 164 kB 00:00 2026-02-26T02:38:21.555 INFO:teuthology.orchestra.run.trial192.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.2 MB/s | 66 kB 00:00 2026-02-26T02:38:21.595 INFO:teuthology.orchestra.run.trial093.stdout:(4/35): libradosstriper1-19.2.3-687.g8d724284.e 4.0 MB/s | 504 kB 00:00 2026-02-26T02:38:21.726 INFO:teuthology.orchestra.run.trial192.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-26T02:38:21.749 INFO:teuthology.orchestra.run.trial192.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.1 MB/s | 25 kB 00:00 2026-02-26T02:38:21.774 INFO:teuthology.orchestra.run.trial192.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-26T02:38:21.775 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:38:21.784 INFO:teuthology.orchestra.run.trial130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-26T02:38:21.786 INFO:teuthology.orchestra.run.trial130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-26T02:38:21.794 INFO:teuthology.orchestra.run.trial161.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 60 kB/s | 33 kB 00:00 2026-02-26T02:38:21.797 INFO:teuthology.orchestra.run.trial130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-26T02:38:21.798 INFO:teuthology.orchestra.run.trial192.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-26T02:38:21.819 INFO:teuthology.orchestra.run.trial192.stdout:(29/35): libarrow-9.0.0-15.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2026-02-26T02:38:21.843 INFO:teuthology.orchestra.run.trial192.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 7.8 MB/s | 191 kB 00:00 2026-02-26T02:38:21.861 INFO:teuthology.orchestra.run.trial192.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 13 MB/s | 838 kB 00:00 2026-02-26T02:38:21.873 INFO:teuthology.orchestra.run.trial192.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 52 MB/s | 1.6 MB 00:00 2026-02-26T02:38:21.943 INFO:teuthology.orchestra.run.trial093.stdout:(5/35): ceph-radosgw-19.2.3-687.g8d724284.el9.x 4.3 MB/s | 11 MB 00:02 2026-02-26T02:38:21.950 INFO:teuthology.orchestra.run.trial130.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-26T02:38:21.954 INFO:teuthology.orchestra.run.trial130.stdout: Upgrading : librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:21.984 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:22.005 INFO:teuthology.orchestra.run.trial093.stdout:(6/35): python3-ceph-argparse-19.2.3-687.g8d724 718 kB/s | 45 kB 00:00 2026-02-26T02:38:22.029 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:22.030 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:22.042 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:22.046 INFO:teuthology.orchestra.run.trial130.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-26T02:38:22.055 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 9/37 2026-02-26T02:38:22.070 INFO:teuthology.orchestra.run.trial161.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 338 kB/s | 93 kB 00:00 2026-02-26T02:38:22.072 INFO:teuthology.orchestra.run.trial093.stdout:(7/35): python3-ceph-common-19.2.3-687.g8d72428 2.1 MB/s | 142 kB 00:00 2026-02-26T02:38:22.078 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:22.079 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:22.091 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:22.123 INFO:teuthology.orchestra.run.trial130.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-26T02:38:22.127 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-26T02:38:22.134 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-26T02:38:22.136 INFO:teuthology.orchestra.run.trial130.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-26T02:38:22.139 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-26T02:38:22.141 INFO:teuthology.orchestra.run.trial093.stdout:(8/35): python3-cephfs-19.2.3-687.g8d724284.el9 2.3 MB/s | 165 kB 00:00 2026-02-26T02:38:22.144 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-26T02:38:22.151 INFO:teuthology.orchestra.run.trial161.stdout:(15/35): ceph-common-19.2.3-687.g8d724284.el9.x 2.6 MB/s | 22 MB 00:08 2026-02-26T02:38:22.209 INFO:teuthology.orchestra.run.trial093.stdout:(9/35): python3-rados-19.2.3-687.g8d724284.el9. 4.6 MB/s | 321 kB 00:00 2026-02-26T02:38:22.281 INFO:teuthology.orchestra.run.trial093.stdout:(10/35): python3-rbd-19.2.3-687.g8d724284.el9.x 4.1 MB/s | 303 kB 00:00 2026-02-26T02:38:22.287 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:22.288 INFO:teuthology.orchestra.run.trial130.stdout: Upgrading : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:22.314 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:22.316 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 20/37 2026-02-26T02:38:22.322 INFO:teuthology.orchestra.run.trial130.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-26T02:38:22.350 INFO:teuthology.orchestra.run.trial093.stdout:(11/35): python3-rgw-19.2.3-687.g8d724284.el9.x 1.4 MB/s | 100 kB 00:00 2026-02-26T02:38:22.551 INFO:teuthology.orchestra.run.trial130.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-26T02:38:22.552 INFO:teuthology.orchestra.run.trial130.stdout: Installing : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:22.568 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:22.572 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 24/37 2026-02-26T02:38:22.576 INFO:teuthology.orchestra.run.trial130.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-26T02:38:22.579 INFO:teuthology.orchestra.run.trial130.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-26T02:38:22.579 INFO:teuthology.orchestra.run.trial130.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:22.597 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:22.622 INFO:teuthology.orchestra.run.trial093.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 122 kB/s | 33 kB 00:00 2026-02-26T02:38:22.713 INFO:teuthology.orchestra.run.trial130.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-26T02:38:22.715 INFO:teuthology.orchestra.run.trial130.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:22.789 INFO:teuthology.orchestra.run.trial161.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 145 kB/s | 104 kB 00:00 2026-02-26T02:38:22.797 INFO:teuthology.orchestra.run.trial192.stdout:(33/35): librbd1-19.2.3-687.g8d724284.el9.x86_6 3.4 MB/s | 3.2 MB 00:00 2026-02-26T02:38:22.834 INFO:teuthology.orchestra.run.trial093.stdout:(13/35): librgw2-19.2.3-687.g8d724284.el9.x86_6 4.4 MB/s | 5.4 MB 00:01 2026-02-26T02:38:22.898 INFO:teuthology.orchestra.run.trial161.stdout:(17/35): libnbd-1.20.3-4.el9.x86_64.rpm 219 kB/s | 164 kB 00:00 2026-02-26T02:38:23.002 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:23.003 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-26T02:38:23.003 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:23.036 INFO:teuthology.orchestra.run.trial130.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-26T02:38:23.038 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 31/37 2026-02-26T02:38:23.107 INFO:teuthology.orchestra.run.trial093.stdout:(14/35): nvme-cli-2.16-1.el9.x86_64.rpm 2.4 MB/s | 1.2 MB 00:00 2026-02-26T02:38:23.110 INFO:teuthology.orchestra.run.trial192.stdout:(34/35): librados2-19.2.3-687.g8d724284.el9.x86 2.7 MB/s | 3.4 MB 00:01 2026-02-26T02:38:23.164 INFO:teuthology.orchestra.run.trial093.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 1.8 MB/s | 104 kB 00:00 2026-02-26T02:38:23.182 INFO:teuthology.orchestra.run.trial093.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 8.7 MB/s | 164 kB 00:00 2026-02-26T02:38:23.194 INFO:teuthology.orchestra.run.trial093.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 13 MB/s | 160 kB 00:00 2026-02-26T02:38:23.204 INFO:teuthology.orchestra.run.trial093.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.6 MB/s | 45 kB 00:00 2026-02-26T02:38:23.226 INFO:teuthology.orchestra.run.trial093.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 29 MB/s | 662 kB 00:00 2026-02-26T02:38:23.227 INFO:teuthology.orchestra.run.trial093.stdout:(20/35): pciutils-3.7.0-7.el9.x86_64.rpm 237 kB/s | 93 kB 00:00 2026-02-26T02:38:23.238 INFO:teuthology.orchestra.run.trial093.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 24 MB/s | 292 kB 00:00 2026-02-26T02:38:23.247 INFO:teuthology.orchestra.run.trial093.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 4.1 MB/s | 37 kB 00:00 2026-02-26T02:38:23.256 INFO:teuthology.orchestra.run.trial093.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 6.8 MB/s | 66 kB 00:00 2026-02-26T02:38:23.275 INFO:teuthology.orchestra.run.trial093.stdout:(24/35): qatlib-25.08.0-2.el9.x86_64.rpm 4.9 MB/s | 240 kB 00:00 2026-02-26T02:38:23.416 INFO:teuthology.orchestra.run.trial161.stdout:(18/35): nvme-cli-2.16-1.el9.x86_64.rpm 622 kB/s | 1.2 MB 00:01 2026-02-26T02:38:23.516 INFO:teuthology.orchestra.run.trial161.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2026-02-26T02:38:23.550 INFO:teuthology.orchestra.run.trial161.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 210 kB/s | 160 kB 00:00 2026-02-26T02:38:23.771 INFO:teuthology.orchestra.run.trial093.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 598 kB/s | 308 kB 00:00 2026-02-26T02:38:23.843 INFO:teuthology.orchestra.run.trial093.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 345 kB/s | 25 kB 00:00 2026-02-26T02:38:23.915 INFO:teuthology.orchestra.run.trial093.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 679 kB/s | 49 kB 00:00 2026-02-26T02:38:23.987 INFO:teuthology.orchestra.run.trial093.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 933 kB/s | 67 kB 00:00 2026-02-26T02:38:24.037 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:24.039 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:24.072 INFO:teuthology.orchestra.run.trial093.stdout:(29/35): libarrow-9.0.0-15.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2026-02-26T02:38:24.139 INFO:teuthology.orchestra.run.trial093.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.4 MB/s | 838 kB 00:00 2026-02-26T02:38:24.200 INFO:teuthology.orchestra.run.trial093.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2026-02-26T02:38:24.284 INFO:teuthology.orchestra.run.trial093.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2026-02-26T02:38:24.323 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:24.326 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:24.341 INFO:teuthology.orchestra.run.trial161.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 716 kB/s | 662 kB 00:00 2026-02-26T02:38:24.345 INFO:teuthology.orchestra.run.trial161.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 353 kB/s | 292 kB 00:00 2026-02-26T02:38:24.348 INFO:teuthology.orchestra.run.trial161.stdout:(23/35): qatlib-25.08.0-2.el9.x86_64.rpm 300 kB/s | 240 kB 00:00 2026-02-26T02:38:24.366 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:24.366 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-26T02:38:24.366 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-26T02:38:24.366 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:24.369 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:24.415 INFO:teuthology.orchestra.run.trial161.stdout:(24/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.5 MB/s | 308 kB 00:00 2026-02-26T02:38:24.557 INFO:teuthology.orchestra.run.trial093.stdout:(33/35): ceph-common-19.2.3-687.g8d724284.el9.x 4.2 MB/s | 22 MB 00:05 2026-02-26T02:38:24.661 INFO:teuthology.orchestra.run.trial161.stdout:(25/35): libarrow-9.0.0-15.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2026-02-26T02:38:24.665 INFO:teuthology.orchestra.run.trial161.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 5.7 MB/s | 25 kB 00:00 2026-02-26T02:38:24.669 INFO:teuthology.orchestra.run.trial161.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 11 MB/s | 49 kB 00:00 2026-02-26T02:38:24.674 INFO:teuthology.orchestra.run.trial161.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 16 MB/s | 67 kB 00:00 2026-02-26T02:38:24.705 INFO:teuthology.orchestra.run.trial161.stdout:(29/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 26 MB/s | 838 kB 00:00 2026-02-26T02:38:24.713 INFO:teuthology.orchestra.run.trial161.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 24 MB/s | 191 kB 00:00 2026-02-26T02:38:24.765 INFO:teuthology.orchestra.run.trial161.stdout:(31/35): thrift-0.15.0-4.el9.x86_64.rpm 30 MB/s | 1.6 MB 00:00 2026-02-26T02:38:24.929 INFO:teuthology.orchestra.run.trial161.stdout:(32/35): qatlib-service-25.08.0-2.el9.x86_64.rp 63 kB/s | 37 kB 00:00 2026-02-26T02:38:24.988 INFO:teuthology.orchestra.run.trial161.stdout:(33/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 103 kB/s | 66 kB 00:00 2026-02-26T02:38:25.057 INFO:teuthology.orchestra.run.trial093.stdout:(34/35): librbd1-19.2.3-687.g8d724284.el9.x86_6 4.1 MB/s | 3.2 MB 00:00 2026-02-26T02:38:25.233 INFO:teuthology.orchestra.run.trial093.stdout:(35/35): librados2-19.2.3-687.g8d724284.el9.x86 3.3 MB/s | 3.4 MB 00:01 2026-02-26T02:38:25.238 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:25.238 INFO:teuthology.orchestra.run.trial093.stdout:Total 10 MB/s | 63 MB 00:06 2026-02-26T02:38:25.333 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:38:25.352 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:38:25.352 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:38:25.433 INFO:teuthology.orchestra.run.trial192.stdout:(35/35): ceph-radosgw-19.2.3-687.g8d724284.el9. 1.1 MB/s | 11 MB 00:09 2026-02-26T02:38:25.436 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:25.436 INFO:teuthology.orchestra.run.trial192.stdout:Total 6.1 MB/s | 63 MB 00:10 2026-02-26T02:38:25.539 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:38:25.557 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:38:25.558 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:38:25.602 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:38:25.603 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:38:25.807 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:38:25.807 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:38:25.856 INFO:teuthology.orchestra.run.trial161.stdout:(34/35): librbd1-19.2.3-687.g8d724284.el9.x86_6 3.4 MB/s | 3.2 MB 00:00 2026-02-26T02:38:25.894 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:38:25.903 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-26T02:38:25.905 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-26T02:38:25.917 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-26T02:38:26.068 INFO:teuthology.orchestra.run.trial093.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-26T02:38:26.073 INFO:teuthology.orchestra.run.trial093.stdout: Upgrading : librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:26.097 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:38:26.103 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:26.106 INFO:teuthology.orchestra.run.trial192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-26T02:38:26.110 INFO:teuthology.orchestra.run.trial192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-26T02:38:26.121 INFO:teuthology.orchestra.run.trial192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-26T02:38:26.145 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:26.146 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:26.158 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:26.162 INFO:teuthology.orchestra.run.trial093.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-26T02:38:26.172 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 9/37 2026-02-26T02:38:26.196 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:26.197 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:26.209 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:26.239 INFO:teuthology.orchestra.run.trial093.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-26T02:38:26.243 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-26T02:38:26.249 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-26T02:38:26.251 INFO:teuthology.orchestra.run.trial093.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-26T02:38:26.254 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-26T02:38:26.259 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-26T02:38:26.272 INFO:teuthology.orchestra.run.trial192.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-26T02:38:26.277 INFO:teuthology.orchestra.run.trial192.stdout: Upgrading : librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:26.304 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:26.346 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:26.347 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:26.359 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:26.363 INFO:teuthology.orchestra.run.trial192.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-26T02:38:26.372 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 9/37 2026-02-26T02:38:26.395 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:26.395 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:26.401 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:26.402 INFO:teuthology.orchestra.run.trial093.stdout: Upgrading : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:26.410 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:26.429 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:26.432 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 20/37 2026-02-26T02:38:26.438 INFO:teuthology.orchestra.run.trial093.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-26T02:38:26.444 INFO:teuthology.orchestra.run.trial192.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-26T02:38:26.450 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-26T02:38:26.456 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-26T02:38:26.458 INFO:teuthology.orchestra.run.trial192.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-26T02:38:26.461 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-26T02:38:26.466 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-26T02:38:26.605 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:26.606 INFO:teuthology.orchestra.run.trial192.stdout: Upgrading : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:26.632 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:26.634 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 20/37 2026-02-26T02:38:26.640 INFO:teuthology.orchestra.run.trial192.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-26T02:38:26.649 INFO:teuthology.orchestra.run.trial161.stdout:(35/35): librados2-19.2.3-687.g8d724284.el9.x86 1.8 MB/s | 3.4 MB 00:01 2026-02-26T02:38:26.654 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:26.654 INFO:teuthology.orchestra.run.trial161.stdout:Total 4.7 MB/s | 63 MB 00:13 2026-02-26T02:38:26.664 INFO:teuthology.orchestra.run.trial093.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-26T02:38:26.665 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:26.682 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:26.686 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 24/37 2026-02-26T02:38:26.691 INFO:teuthology.orchestra.run.trial093.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-26T02:38:26.693 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-26T02:38:26.694 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:26.712 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:26.756 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:38:26.774 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:38:26.774 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:38:26.829 INFO:teuthology.orchestra.run.trial093.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-26T02:38:26.832 INFO:teuthology.orchestra.run.trial093.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:26.865 INFO:teuthology.orchestra.run.trial192.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-26T02:38:26.866 INFO:teuthology.orchestra.run.trial192.stdout: Installing : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:26.883 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:26.886 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 24/37 2026-02-26T02:38:26.891 INFO:teuthology.orchestra.run.trial192.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-26T02:38:26.893 INFO:teuthology.orchestra.run.trial192.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-26T02:38:26.894 INFO:teuthology.orchestra.run.trial192.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:26.913 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:27.024 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:38:27.024 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:38:27.028 INFO:teuthology.orchestra.run.trial192.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-26T02:38:27.030 INFO:teuthology.orchestra.run.trial192.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:27.112 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:27.112 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-26T02:38:27.112 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:27.149 INFO:teuthology.orchestra.run.trial093.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-26T02:38:27.151 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 31/37 2026-02-26T02:38:27.300 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:27.300 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-26T02:38:27.300 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:27.330 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:38:27.335 INFO:teuthology.orchestra.run.trial192.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-26T02:38:27.337 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 31/37 2026-02-26T02:38:27.338 INFO:teuthology.orchestra.run.trial161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-26T02:38:27.341 INFO:teuthology.orchestra.run.trial161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-26T02:38:27.353 INFO:teuthology.orchestra.run.trial161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-26T02:38:27.504 INFO:teuthology.orchestra.run.trial161.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-26T02:38:27.509 INFO:teuthology.orchestra.run.trial161.stdout: Upgrading : librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:27.539 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librados2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:27.581 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:27.582 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:27.594 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:27.598 INFO:teuthology.orchestra.run.trial161.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-26T02:38:27.607 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 9/37 2026-02-26T02:38:27.633 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:27.634 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:27.647 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:27.682 INFO:teuthology.orchestra.run.trial161.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-26T02:38:27.686 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-26T02:38:27.692 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-26T02:38:27.694 INFO:teuthology.orchestra.run.trial161.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-26T02:38:27.697 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-26T02:38:27.702 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-26T02:38:27.841 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:27.842 INFO:teuthology.orchestra.run.trial161.stdout: Upgrading : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:27.867 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 19/37 2026-02-26T02:38:27.870 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 20/37 2026-02-26T02:38:27.876 INFO:teuthology.orchestra.run.trial161.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-26T02:38:28.101 INFO:teuthology.orchestra.run.trial161.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-26T02:38:28.102 INFO:teuthology.orchestra.run.trial161.stdout: Installing : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:28.118 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 23/37 2026-02-26T02:38:28.121 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 24/37 2026-02-26T02:38:28.126 INFO:teuthology.orchestra.run.trial161.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-26T02:38:28.128 INFO:teuthology.orchestra.run.trial161.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-26T02:38:28.129 INFO:teuthology.orchestra.run.trial161.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:28.135 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:28.137 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:28.147 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-26T02:38:28.262 INFO:teuthology.orchestra.run.trial161.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-26T02:38:28.264 INFO:teuthology.orchestra.run.trial161.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:28.323 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:28.325 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:28.420 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:28.423 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:28.461 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:28.461 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-26T02:38:28.461 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-26T02:38:28.461 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:28.464 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:28.544 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-26T02:38:28.545 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-26T02:38:28.545 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:28.581 INFO:teuthology.orchestra.run.trial161.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-26T02:38:28.583 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 31/37 2026-02-26T02:38:28.608 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:28.612 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:28.654 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:28.655 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-26T02:38:28.655 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-26T02:38:28.655 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:28.658 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:28.869 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout:skipping the directory /sys 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout:skipping the directory /proc 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout:skipping the directory /mnt 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout:skipping the directory /var/tmp 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout:skipping the directory /home 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout:skipping the directory /root 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout:skipping the directory /tmp 2026-02-26T02:38:28.870 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:29.333 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:29.355 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:29.355 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:29.355 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-26T02:38:29.355 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:29.355 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:29.355 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:29.357 INFO:teuthology.orchestra.run.trial130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:29.369 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:29.369 INFO:teuthology.orchestra.run.trial130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:29.426 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:29.426 INFO:teuthology.orchestra.run.trial130.stdout:Creating group 'qat' with GID 992. 2026-02-26T02:38:29.426 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:29.565 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:29.567 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 1/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 3/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 4/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:29.719 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 8/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 9/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 12/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 13/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-26T02:38:29.720 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librados2-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-26T02:38:29.721 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 36/37 2026-02-26T02:38:29.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:29.789 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:29.789 INFO:teuthology.orchestra.run.trial130.stdout:Upgraded: 2026-02-26T02:38:29.789 INFO:teuthology.orchestra.run.trial130.stdout: librados2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.790 INFO:teuthology.orchestra.run.trial130.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: re2-1:20211101-20.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:29.791 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:38:29.832 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-test 2026-02-26T02:38:29.850 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 32/37 2026-02-26T02:38:29.853 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:29.889 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 33/37 2026-02-26T02:38:29.890 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-26T02:38:29.890 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-26T02:38:29.890 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:29.893 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:30.148 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:18 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:38:30.231 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:38:30.232 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repository Size 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout: ceph-test x86_64 2:19.2.3-687.g8d724284.el9 ceph 51 M 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout:Installing dependencies: 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout: libcephsqlite x86_64 2:19.2.3-687.g8d724284.el9 ceph 163 k 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-26T02:38:30.233 INFO:teuthology.orchestra.run.trial130.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout:Install 5 Packages 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 51 M 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 222 M 2026-02-26T02:38:30.234 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:38:30.611 INFO:teuthology.orchestra.run.trial130.stdout:(1/5): libcephsqlite-19.2.3-687.g8d724284.el9.x 556 kB/s | 163 kB 00:00 2026-02-26T02:38:31.075 INFO:teuthology.orchestra.run.trial130.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 307 kB/s | 233 kB 00:00 2026-02-26T02:38:31.177 INFO:teuthology.orchestra.run.trial130.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 627 kB/s | 64 kB 00:00 2026-02-26T02:38:31.344 INFO:teuthology.orchestra.run.trial130.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 414 kB/s | 303 kB 00:00 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /sys 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /proc 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /mnt 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /var/tmp 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /home 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /root 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout:skipping the directory /tmp 2026-02-26T02:38:32.975 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:33.149 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:33.149 INFO:teuthology.orchestra.run.trial192.stdout:skipping the directory /sys 2026-02-26T02:38:33.149 INFO:teuthology.orchestra.run.trial192.stdout:skipping the directory /proc 2026-02-26T02:38:33.149 INFO:teuthology.orchestra.run.trial192.stdout:skipping the directory /mnt 2026-02-26T02:38:33.149 INFO:teuthology.orchestra.run.trial192.stdout:skipping the directory /var/tmp 2026-02-26T02:38:33.149 INFO:teuthology.orchestra.run.trial192.stdout:skipping the directory /home 2026-02-26T02:38:33.149 INFO:teuthology.orchestra.run.trial192.stdout:skipping the directory /root 2026-02-26T02:38:33.150 INFO:teuthology.orchestra.run.trial192.stdout:skipping the directory /tmp 2026-02-26T02:38:33.150 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:33.433 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:33.456 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:33.456 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:33.457 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-26T02:38:33.457 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:33.457 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:33.457 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:33.459 INFO:teuthology.orchestra.run.trial093.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:33.471 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:33.471 INFO:teuthology.orchestra.run.trial093.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:33.527 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:33.528 INFO:teuthology.orchestra.run.trial093.stdout:Creating group 'qat' with GID 992. 2026-02-26T02:38:33.528 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:33.601 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:33.625 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:33.625 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:33.625 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-26T02:38:33.625 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:33.625 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:33.625 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:33.626 INFO:teuthology.orchestra.run.trial192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:33.639 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:33.640 INFO:teuthology.orchestra.run.trial192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:33.689 INFO:teuthology.orchestra.run.trial130.stdout:(5/5): ceph-test-19.2.3-687.g8d724284.el9.x86_6 15 MB/s | 51 MB 00:03 2026-02-26T02:38:33.691 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:33.691 INFO:teuthology.orchestra.run.trial130.stdout:Total 15 MB/s | 51 MB 00:03 2026-02-26T02:38:33.696 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:33.696 INFO:teuthology.orchestra.run.trial192.stdout:Creating group 'qat' with GID 992. 2026-02-26T02:38:33.696 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:33.718 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:38:33.727 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:38:33.727 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:38:33.799 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 1/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 3/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 4/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 8/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 9/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 12/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 13/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-26T02:38:33.800 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados2-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:33.801 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-26T02:38:33.802 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 36/37 2026-02-26T02:38:33.864 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout:Upgraded: 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: librados2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-26T02:38:33.865 INFO:teuthology.orchestra.run.trial093.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-26T02:38:33.866 INFO:teuthology.orchestra.run.trial093.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: re2-1:20211101-20.el9.x86_64 2026-02-26T02:38:33.867 INFO:teuthology.orchestra.run.trial093.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-26T02:38:33.868 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:33.868 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:38:33.906 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-test 2026-02-26T02:38:33.916 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:38:33.917 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:38:33.970 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 1/37 2026-02-26T02:38:33.970 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2/37 2026-02-26T02:38:33.970 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 3/37 2026-02-26T02:38:33.970 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 4/37 2026-02-26T02:38:33.970 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:33.970 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:33.970 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 8/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 9/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 12/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 13/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:33.971 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-26T02:38:33.972 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-26T02:38:33.973 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-26T02:38:33.973 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-26T02:38:33.973 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-26T02:38:33.973 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-26T02:38:33.973 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librados2-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:33.973 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-26T02:38:33.973 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 36/37 2026-02-26T02:38:34.036 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:34.036 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout:Upgraded: 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: librados2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.037 INFO:teuthology.orchestra.run.trial192.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.038 INFO:teuthology.orchestra.run.trial192.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.039 INFO:teuthology.orchestra.run.trial192.stdout: python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:34.040 INFO:teuthology.orchestra.run.trial192.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-26T02:38:34.040 INFO:teuthology.orchestra.run.trial192.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-26T02:38:34.040 INFO:teuthology.orchestra.run.trial192.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-26T02:38:34.040 INFO:teuthology.orchestra.run.trial192.stdout: re2-1:20211101-20.el9.x86_64 2026-02-26T02:38:34.040 INFO:teuthology.orchestra.run.trial192.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-26T02:38:34.040 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:34.040 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:38:34.079 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-test 2026-02-26T02:38:34.133 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:38:34.138 INFO:teuthology.orchestra.run.trial130.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-26T02:38:34.143 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-26T02:38:34.153 INFO:teuthology.orchestra.run.trial130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-26T02:38:34.154 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:34.222 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:17 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:38:34.305 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:38:34.306 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:38:34.306 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repository Size 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test x86_64 2:19.2.3-687.g8d724284.el9 ceph 51 M 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout:Installing dependencies: 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout: libcephsqlite x86_64 2:19.2.3-687.g8d724284.el9 ceph 163 k 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:34.307 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:38:34.308 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:38:34.308 INFO:teuthology.orchestra.run.trial093.stdout:Install 5 Packages 2026-02-26T02:38:34.308 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:34.308 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 51 M 2026-02-26T02:38:34.308 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 222 M 2026-02-26T02:38:34.308 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:38:34.384 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:34.384 INFO:teuthology.orchestra.run.trial161.stdout:skipping the directory /sys 2026-02-26T02:38:34.384 INFO:teuthology.orchestra.run.trial161.stdout:skipping the directory /proc 2026-02-26T02:38:34.384 INFO:teuthology.orchestra.run.trial161.stdout:skipping the directory /mnt 2026-02-26T02:38:34.384 INFO:teuthology.orchestra.run.trial161.stdout:skipping the directory /var/tmp 2026-02-26T02:38:34.384 INFO:teuthology.orchestra.run.trial161.stdout:skipping the directory /home 2026-02-26T02:38:34.384 INFO:teuthology.orchestra.run.trial161.stdout:skipping the directory /root 2026-02-26T02:38:34.385 INFO:teuthology.orchestra.run.trial161.stdout:skipping the directory /tmp 2026-02-26T02:38:34.385 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:34.393 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:21 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repository Size 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: ceph-test x86_64 2:19.2.3-687.g8d724284.el9 ceph 51 M 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:Installing dependencies: 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: libcephsqlite x86_64 2:19.2.3-687.g8d724284.el9 ceph 163 k 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout:Install 5 Packages 2026-02-26T02:38:34.477 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:34.478 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 51 M 2026-02-26T02:38:34.478 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 222 M 2026-02-26T02:38:34.478 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:38:34.532 INFO:teuthology.orchestra.run.trial093.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.4 MB/s | 233 kB 00:00 2026-02-26T02:38:34.604 INFO:teuthology.orchestra.run.trial093.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 4.1 MB/s | 303 kB 00:00 2026-02-26T02:38:34.638 INFO:teuthology.orchestra.run.trial093.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 64 kB 00:00 2026-02-26T02:38:34.701 INFO:teuthology.orchestra.run.trial192.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.4 MB/s | 233 kB 00:00 2026-02-26T02:38:34.721 INFO:teuthology.orchestra.run.trial093.stdout:(4/5): libcephsqlite-19.2.3-687.g8d724284.el9.x 463 kB/s | 163 kB 00:00 2026-02-26T02:38:34.754 INFO:teuthology.orchestra.run.trial192.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 5.7 MB/s | 303 kB 00:00 2026-02-26T02:38:34.780 INFO:teuthology.orchestra.run.trial192.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-26T02:38:34.833 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:34.857 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 35/37 2026-02-26T02:38:34.857 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:34.857 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-26T02:38:34.857 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:34.857 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-26T02:38:34.857 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:34.858 INFO:teuthology.orchestra.run.trial161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:34.870 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-26T02:38:34.870 INFO:teuthology.orchestra.run.trial161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:34.878 INFO:teuthology.orchestra.run.trial192.stdout:(4/5): libcephsqlite-19.2.3-687.g8d724284.el9.x 482 kB/s | 163 kB 00:00 2026-02-26T02:38:34.927 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:34.927 INFO:teuthology.orchestra.run.trial161.stdout:Creating group 'qat' with GID 992. 2026-02-26T02:38:34.927 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:35.212 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 1/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 3/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 4/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 5/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 6/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librgw2-2:19.2.3-687.g8d724284.el9.x86_64 7/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x 8/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86 9/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 10/37 2026-02-26T02:38:35.213 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 11/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 12/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 13/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-26T02:38:35.214 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librados2-2:19.2.3-687.g8d724284.el9.x86_64 34/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-26T02:38:35.215 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librbd1-2:19.2.3-687.g8d724284.el9.x86_64 36/37 2026-02-26T02:38:35.280 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout:Upgraded: 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: librados2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: librbd1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: ceph-radosgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.281 INFO:teuthology.orchestra.run.trial161.stdout: ceph-selinux-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: libradosstriper1-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: librgw2-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-26T02:38:35.282 INFO:teuthology.orchestra.run.trial161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: python3-ceph-argparse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: python3-ceph-common-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-26T02:38:35.283 INFO:teuthology.orchestra.run.trial161.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-26T02:38:35.284 INFO:teuthology.orchestra.run.trial161.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-26T02:38:35.284 INFO:teuthology.orchestra.run.trial161.stdout: re2-1:20211101-20.el9.x86_64 2026-02-26T02:38:35.284 INFO:teuthology.orchestra.run.trial161.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-26T02:38:35.284 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:35.284 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:38:35.323 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-test 2026-02-26T02:38:35.646 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:23 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:38:35.731 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:38:35.732 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:38:35.732 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repository Size 2026-02-26T02:38:35.732 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:38:35.732 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout: ceph-test x86_64 2:19.2.3-687.g8d724284.el9 ceph 51 M 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout:Installing dependencies: 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout: libcephsqlite x86_64 2:19.2.3-687.g8d724284.el9 ceph 163 k 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:38:35.733 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:38:35.734 INFO:teuthology.orchestra.run.trial161.stdout:Install 5 Packages 2026-02-26T02:38:35.734 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:35.734 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 51 M 2026-02-26T02:38:35.734 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 222 M 2026-02-26T02:38:35.734 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:38:36.375 INFO:teuthology.orchestra.run.trial161.stdout:(1/5): libcephsqlite-19.2.3-687.g8d724284.el9.x 422 kB/s | 163 kB 00:00 2026-02-26T02:38:36.465 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:36.483 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:36.722 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:36.722 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 1/5 2026-02-26T02:38:36.722 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2/5 2026-02-26T02:38:36.722 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-26T02:38:36.722 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-26T02:38:36.780 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-26T02:38:36.780 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:36.780 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:38:36.780 INFO:teuthology.orchestra.run.trial130.stdout: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:36.781 INFO:teuthology.orchestra.run.trial130.stdout: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:36.781 INFO:teuthology.orchestra.run.trial130.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-26T02:38:36.781 INFO:teuthology.orchestra.run.trial130.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-26T02:38:36.781 INFO:teuthology.orchestra.run.trial130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-26T02:38:36.781 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:36.781 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:38:36.784 INFO:teuthology.orchestra.run.trial161.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 292 kB/s | 233 kB 00:00 2026-02-26T02:38:36.815 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph 2026-02-26T02:38:36.944 INFO:teuthology.orchestra.run.trial161.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 400 kB/s | 64 kB 00:00 2026-02-26T02:38:37.124 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:25 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:38:37.212 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:38:37.214 INFO:teuthology.orchestra.run.trial130.stdout:====================================================================================== 2026-02-26T02:38:37.214 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repository Size 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout:====================================================================================== 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: ceph x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.5 k 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout:Installing dependencies: 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: ceph-grafana-dashboards noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 31 k 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mds x86_64 2:19.2.3-687.g8d724284.el9 ceph 2.4 M 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-modules-core noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 253 k 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mon x86_64 2:19.2.3-687.g8d724284.el9 ceph 4.7 M 2026-02-26T02:38:37.215 INFO:teuthology.orchestra.run.trial130.stdout: ceph-osd x86_64 2:19.2.3-687.g8d724284.el9 ceph 17 M 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: ceph-prometheus-alerts noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 17 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 769 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-26T02:38:37.216 INFO:teuthology.orchestra.run.trial130.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-26T02:38:37.217 INFO:teuthology.orchestra.run.trial130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-26T02:38:37.218 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-26T02:38:37.219 INFO:teuthology.orchestra.run.trial130.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-26T02:38:37.220 INFO:teuthology.orchestra.run.trial130.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-26T02:38:37.221 INFO:teuthology.orchestra.run.trial130.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout:Installing weak dependencies: 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 150 k 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-dashboard noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 3.8 M 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 7.4 M 2026-02-26T02:38:37.222 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 22 k 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-rook noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 49 k 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout: ceph-volume noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 299 k 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout:====================================================================================== 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout:Install 99 Packages 2026-02-26T02:38:37.223 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:37.224 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 95 M 2026-02-26T02:38:37.224 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 520 M 2026-02-26T02:38:37.224 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:38:37.257 INFO:teuthology.orchestra.run.trial161.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 344 kB/s | 303 kB 00:00 2026-02-26T02:38:37.984 INFO:teuthology.orchestra.run.trial130.stdout:(1/99): ceph-19.2.3-687.g8d724284.el9.x86_64.rp 27 kB/s | 6.5 kB 00:00 2026-02-26T02:38:38.483 INFO:teuthology.orchestra.run.trial130.stdout:(2/99): ceph-mgr-19.2.3-687.g8d724284.el9.x86_6 1.5 MB/s | 1.1 MB 00:00 2026-02-26T02:38:38.595 INFO:teuthology.orchestra.run.trial130.stdout:(3/99): ceph-mds-19.2.3-687.g8d724284.el9.x86_6 2.9 MB/s | 2.4 MB 00:00 2026-02-26T02:38:38.650 INFO:teuthology.orchestra.run.trial130.stdout:(4/99): ceph-grafana-dashboards-19.2.3-687.g8d7 560 kB/s | 31 kB 00:00 2026-02-26T02:38:38.708 INFO:teuthology.orchestra.run.trial130.stdout:(5/99): ceph-mgr-cephadm-19.2.3-687.g8d724284.e 2.5 MB/s | 150 kB 00:00 2026-02-26T02:38:39.361 INFO:teuthology.orchestra.run.trial130.stdout:(6/99): ceph-mgr-dashboard-19.2.3-687.g8d724284 5.8 MB/s | 3.8 MB 00:00 2026-02-26T02:38:40.152 INFO:teuthology.orchestra.run.trial130.stdout:(7/99): ceph-mon-19.2.3-687.g8d724284.el9.x86_6 2.2 MB/s | 4.7 MB 00:02 2026-02-26T02:38:40.200 INFO:teuthology.orchestra.run.trial130.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-687.g8d724284 471 kB/s | 22 kB 00:00 2026-02-26T02:38:40.236 INFO:teuthology.orchestra.run.trial130.stdout:(9/99): ceph-mgr-diskprediction-local-19.2.3-68 8.5 MB/s | 7.4 MB 00:00 2026-02-26T02:38:40.279 INFO:teuthology.orchestra.run.trial130.stdout:(10/99): ceph-mgr-rook-19.2.3-687.g8d724284.el9 1.1 MB/s | 49 kB 00:00 2026-02-26T02:38:40.287 INFO:teuthology.orchestra.run.trial130.stdout:(11/99): ceph-mgr-modules-core-19.2.3-687.g8d72 2.8 MB/s | 253 kB 00:00 2026-02-26T02:38:40.320 INFO:teuthology.orchestra.run.trial130.stdout:(12/99): ceph-prometheus-alerts-19.2.3-687.g8d7 404 kB/s | 17 kB 00:00 2026-02-26T02:38:40.418 INFO:teuthology.orchestra.run.trial130.stdout:(13/99): cephadm-19.2.3-687.g8d724284.el9.noarc 7.7 MB/s | 769 kB 00:00 2026-02-26T02:38:40.423 INFO:teuthology.orchestra.run.trial130.stdout:(14/99): ceph-volume-19.2.3-687.g8d724284.el9.n 2.2 MB/s | 299 kB 00:00 2026-02-26T02:38:40.605 INFO:teuthology.orchestra.run.trial192.stdout:(5/5): ceph-test-19.2.3-687.g8d724284.el9.x86_6 8.4 MB/s | 51 MB 00:06 2026-02-26T02:38:40.606 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:40.607 INFO:teuthology.orchestra.run.trial192.stdout:Total 8.4 MB/s | 51 MB 00:06 2026-02-26T02:38:40.633 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:38:40.643 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:38:40.643 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:38:40.831 INFO:teuthology.orchestra.run.trial130.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 99 kB/s | 40 kB 00:00 2026-02-26T02:38:40.833 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:38:40.833 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:38:40.993 INFO:teuthology.orchestra.run.trial130.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 445 kB/s | 72 kB 00:00 2026-02-26T02:38:41.049 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:38:41.054 INFO:teuthology.orchestra.run.trial192.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-26T02:38:41.058 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-26T02:38:41.066 INFO:teuthology.orchestra.run.trial192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-26T02:38:41.067 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:41.229 INFO:teuthology.orchestra.run.trial130.stdout:(17/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 432 kB/s | 351 kB 00:00 2026-02-26T02:38:41.469 INFO:teuthology.orchestra.run.trial130.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 770 kB/s | 184 kB 00:00 2026-02-26T02:38:41.541 INFO:teuthology.orchestra.run.trial130.stdout:(19/99): ceph-osd-19.2.3-687.g8d724284.el9.x86_ 5.6 MB/s | 17 MB 00:03 2026-02-26T02:38:41.795 INFO:teuthology.orchestra.run.trial130.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 777 kB/s | 253 kB 00:00 2026-02-26T02:38:41.941 INFO:teuthology.orchestra.run.trial130.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 838 kB/s | 794 kB 00:00 2026-02-26T02:38:41.962 INFO:teuthology.orchestra.run.trial130.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 638 kB/s | 106 kB 00:00 2026-02-26T02:38:42.104 INFO:teuthology.orchestra.run.trial130.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 829 kB/s | 135 kB 00:00 2026-02-26T02:38:42.208 INFO:teuthology.orchestra.run.trial130.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 611 kB/s | 150 kB 00:00 2026-02-26T02:38:42.267 INFO:teuthology.orchestra.run.trial130.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 777 kB/s | 126 kB 00:00 2026-02-26T02:38:42.318 INFO:teuthology.orchestra.run.trial161.stdout:(5/5): ceph-test-19.2.3-687.g8d724284.el9.x86_6 8.0 MB/s | 51 MB 00:06 2026-02-26T02:38:42.320 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:42.320 INFO:teuthology.orchestra.run.trial161.stdout:Total 7.8 MB/s | 51 MB 00:06 2026-02-26T02:38:42.349 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:38:42.358 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:38:42.358 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:38:42.508 INFO:teuthology.orchestra.run.trial130.stdout:(26/99): unzip-6.0-59.el9.x86_64.rpm 755 kB/s | 182 kB 00:00 2026-02-26T02:38:42.534 INFO:teuthology.orchestra.run.trial130.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 669 kB/s | 218 kB 00:00 2026-02-26T02:38:42.548 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:38:42.548 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:38:42.764 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:38:42.769 INFO:teuthology.orchestra.run.trial161.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-26T02:38:42.773 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-26T02:38:42.776 INFO:teuthology.orchestra.run.trial130.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 123 kB/s | 30 kB 00:00 2026-02-26T02:38:42.781 INFO:teuthology.orchestra.run.trial161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-26T02:38:42.782 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:42.828 INFO:teuthology.orchestra.run.trial130.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 830 kB/s | 266 kB 00:00 2026-02-26T02:38:42.857 INFO:teuthology.orchestra.run.trial093.stdout:(5/5): ceph-test-19.2.3-687.g8d724284.el9.x86_6 6.0 MB/s | 51 MB 00:08 2026-02-26T02:38:42.858 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:42.859 INFO:teuthology.orchestra.run.trial093.stdout:Total 6.0 MB/s | 51 MB 00:08 2026-02-26T02:38:42.885 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:38:42.894 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:38:42.895 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:38:43.064 INFO:teuthology.orchestra.run.trial130.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 63 kB/s | 15 kB 00:00 2026-02-26T02:38:43.086 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:38:43.086 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:38:43.305 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:38:43.311 INFO:teuthology.orchestra.run.trial093.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-26T02:38:43.315 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-26T02:38:43.323 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-26T02:38:43.324 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:43.341 INFO:teuthology.orchestra.run.trial130.stdout:(31/99): python3-cryptography-36.0.1-5.el9.x86_ 708 kB/s | 1.2 MB 00:01 2026-02-26T02:38:43.372 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:43.390 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:43.461 INFO:teuthology.orchestra.run.trial130.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 622 kB/s | 246 kB 00:00 2026-02-26T02:38:43.612 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:43.612 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 1/5 2026-02-26T02:38:43.613 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2/5 2026-02-26T02:38:43.613 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-26T02:38:43.613 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-26T02:38:43.622 INFO:teuthology.orchestra.run.trial130.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 262 kB/s | 42 kB 00:00 2026-02-26T02:38:43.657 INFO:teuthology.orchestra.run.trial130.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 598 kB/s | 188 kB 00:00 2026-02-26T02:38:43.670 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:43.671 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:38:43.704 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph 2026-02-26T02:38:44.020 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:31 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:38:44.107 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout:====================================================================================== 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repository Size 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout:====================================================================================== 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.5 k 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout:Installing dependencies: 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph-grafana-dashboards noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 31 k 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mds x86_64 2:19.2.3-687.g8d724284.el9 ceph 2.4 M 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-modules-core noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 253 k 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mon x86_64 2:19.2.3-687.g8d724284.el9 ceph 4.7 M 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph-osd x86_64 2:19.2.3-687.g8d724284.el9 ceph 17 M 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: ceph-prometheus-alerts noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 17 k 2026-02-26T02:38:44.110 INFO:teuthology.orchestra.run.trial192.stdout: cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 769 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-26T02:38:44.111 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-26T02:38:44.112 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout:Installing weak dependencies: 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 150 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-dashboard noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 3.8 M 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 7.4 M 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 22 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-rook noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 49 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: ceph-volume noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 299 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout:====================================================================================== 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout:Install 99 Packages 2026-02-26T02:38:44.113 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:44.114 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 95 M 2026-02-26T02:38:44.114 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 520 M 2026-02-26T02:38:44.114 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:38:44.670 INFO:teuthology.orchestra.run.trial130.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2026-02-26T02:38:44.782 INFO:teuthology.orchestra.run.trial192.stdout:(1/99): ceph-19.2.3-687.g8d724284.el9.x86_64.rp 35 kB/s | 6.5 kB 00:00 2026-02-26T02:38:44.931 INFO:teuthology.orchestra.run.trial192.stdout:(2/99): ceph-mgr-19.2.3-687.g8d724284.el9.x86_6 3.2 MB/s | 1.1 MB 00:00 2026-02-26T02:38:45.158 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:45.158 INFO:teuthology.orchestra.run.trial192.stdout:(3/99): ceph-mds-19.2.3-687.g8d724284.el9.x86_6 4.3 MB/s | 2.4 MB 00:00 2026-02-26T02:38:45.176 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:45.192 INFO:teuthology.orchestra.run.trial192.stdout:(4/99): ceph-grafana-dashboards-19.2.3-687.g8d7 925 kB/s | 31 kB 00:00 2026-02-26T02:38:45.229 INFO:teuthology.orchestra.run.trial192.stdout:(5/99): ceph-mgr-cephadm-19.2.3-687.g8d724284.e 4.0 MB/s | 150 kB 00:00 2026-02-26T02:38:45.230 INFO:teuthology.orchestra.run.trial130.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2026-02-26T02:38:45.380 INFO:teuthology.orchestra.run.trial192.stdout:(6/99): ceph-mon-19.2.3-687.g8d724284.el9.x86_6 7.9 MB/s | 4.7 MB 00:00 2026-02-26T02:38:45.389 INFO:teuthology.orchestra.run.trial130.stdout:(37/99): python3-devel-3.9.25-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-26T02:38:45.413 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:45.413 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 1/5 2026-02-26T02:38:45.413 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2/5 2026-02-26T02:38:45.413 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-26T02:38:45.413 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-26T02:38:45.473 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-26T02:38:45.473 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:45.473 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:38:45.473 INFO:teuthology.orchestra.run.trial161.stdout: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:45.473 INFO:teuthology.orchestra.run.trial161.stdout: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:45.474 INFO:teuthology.orchestra.run.trial161.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-26T02:38:45.474 INFO:teuthology.orchestra.run.trial161.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-26T02:38:45.474 INFO:teuthology.orchestra.run.trial161.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-26T02:38:45.474 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:45.474 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:38:45.505 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph 2026-02-26T02:38:45.548 INFO:teuthology.orchestra.run.trial130.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-26T02:38:45.632 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 4/5 2026-02-26T02:38:45.650 INFO:teuthology.orchestra.run.trial192.stdout:(7/99): ceph-mgr-dashboard-19.2.3-687.g8d724284 9.0 MB/s | 3.8 MB 00:00 2026-02-26T02:38:45.651 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:45.696 INFO:teuthology.orchestra.run.trial192.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-687.g8d724284 483 kB/s | 22 kB 00:00 2026-02-26T02:38:45.706 INFO:teuthology.orchestra.run.trial130.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 1.1 MB/s | 177 kB 00:00 2026-02-26T02:38:45.741 INFO:teuthology.orchestra.run.trial192.stdout:(9/99): ceph-mgr-modules-core-19.2.3-687.g8d724 5.4 MB/s | 253 kB 00:00 2026-02-26T02:38:45.784 INFO:teuthology.orchestra.run.trial192.stdout:(10/99): ceph-mgr-rook-19.2.3-687.g8d724284.el9 1.1 MB/s | 49 kB 00:00 2026-02-26T02:38:45.820 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:33 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:38:45.847 INFO:teuthology.orchestra.run.trial192.stdout:(11/99): ceph-osd-19.2.3-687.g8d724284.el9.x86_ 19 MB/s | 17 MB 00:00 2026-02-26T02:38:45.847 INFO:teuthology.orchestra.run.trial192.stdout:(12/99): ceph-prometheus-alerts-19.2.3-687.g8d7 265 kB/s | 17 kB 00:00 2026-02-26T02:38:45.878 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 5/5 2026-02-26T02:38:45.879 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 1/5 2026-02-26T02:38:45.879 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2/5 2026-02-26T02:38:45.879 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-26T02:38:45.879 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-26T02:38:45.881 INFO:teuthology.orchestra.run.trial192.stdout:(13/99): ceph-volume-19.2.3-687.g8d724284.el9.n 8.3 MB/s | 299 kB 00:00 2026-02-26T02:38:45.908 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout:====================================================================================== 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repository Size 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout:====================================================================================== 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout: ceph x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.5 k 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout:Installing dependencies: 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-26T02:38:45.911 INFO:teuthology.orchestra.run.trial161.stdout: ceph-grafana-dashboards noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 31 k 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mds x86_64 2:19.2.3-687.g8d724284.el9 ceph 2.4 M 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-modules-core noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 253 k 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mon x86_64 2:19.2.3-687.g8d724284.el9 ceph 4.7 M 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: ceph-osd x86_64 2:19.2.3-687.g8d724284.el9 ceph 17 M 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: ceph-prometheus-alerts noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 17 k 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 769 k 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-26T02:38:45.912 INFO:teuthology.orchestra.run.trial161.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-26T02:38:45.913 INFO:teuthology.orchestra.run.trial161.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-26T02:38:45.914 INFO:teuthology.orchestra.run.trial161.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-26T02:38:45.915 INFO:teuthology.orchestra.run.trial161.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-26T02:38:45.916 INFO:teuthology.orchestra.run.trial161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-26T02:38:45.917 INFO:teuthology.orchestra.run.trial161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-26T02:38:45.918 INFO:teuthology.orchestra.run.trial161.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout:Installing weak dependencies: 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 150 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-dashboard noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 3.8 M 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 7.4 M 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 22 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-rook noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 49 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: ceph-volume noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 299 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-26T02:38:45.919 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:45.920 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:38:45.920 INFO:teuthology.orchestra.run.trial161.stdout:====================================================================================== 2026-02-26T02:38:45.920 INFO:teuthology.orchestra.run.trial161.stdout:Install 99 Packages 2026-02-26T02:38:45.920 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:38:45.921 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 95 M 2026-02-26T02:38:45.921 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 520 M 2026-02-26T02:38:45.921 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:38:45.926 INFO:teuthology.orchestra.run.trial192.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-6 14 MB/s | 7.4 MB 00:00 2026-02-26T02:38:45.927 INFO:teuthology.orchestra.run.trial192.stdout:(15/99): cephadm-19.2.3-687.g8d724284.el9.noarc 9.3 MB/s | 769 kB 00:00 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout: libcephsqlite-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-26T02:38:45.937 INFO:teuthology.orchestra.run.trial093.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-26T02:38:45.938 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:45.938 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:38:45.945 INFO:teuthology.orchestra.run.trial130.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 5.1 MB/s | 1.2 MB 00:00 2026-02-26T02:38:45.971 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph 2026-02-26T02:38:46.105 INFO:teuthology.orchestra.run.trial130.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2026-02-26T02:38:46.212 INFO:teuthology.orchestra.run.trial192.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 141 kB/s | 40 kB 00:00 2026-02-26T02:38:46.266 INFO:teuthology.orchestra.run.trial130.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 216 kB/s | 35 kB 00:00 2026-02-26T02:38:46.283 INFO:teuthology.orchestra.run.trial192.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 202 kB/s | 72 kB 00:00 2026-02-26T02:38:46.285 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:29 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:38:46.333 INFO:teuthology.orchestra.run.trial130.stdout:(43/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 861 kB/s | 3.0 MB 00:03 2026-02-26T02:38:46.374 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout:====================================================================================== 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repository Size 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout:====================================================================================== 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout: ceph x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.5 k 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout:Installing dependencies: 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout: ceph-grafana-dashboards noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 31 k 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds x86_64 2:19.2.3-687.g8d724284.el9 ceph 2.4 M 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:38:46.377 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-modules-core noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 253 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon x86_64 2:19.2.3-687.g8d724284.el9 ceph 4.7 M 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd x86_64 2:19.2.3-687.g8d724284.el9 ceph 17 M 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: ceph-prometheus-alerts noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 17 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 769 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-26T02:38:46.378 INFO:teuthology.orchestra.run.trial093.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-26T02:38:46.379 INFO:teuthology.orchestra.run.trial093.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-26T02:38:46.380 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout:Installing weak dependencies: 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-cephadm noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 150 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-dashboard noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 3.8 M 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 7.4 M 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 22 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-rook noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 49 k 2026-02-26T02:38:46.381 INFO:teuthology.orchestra.run.trial093.stdout: ceph-volume noarch 2:19.2.3-687.g8d724284.el9 ceph-noarch 299 k 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout:====================================================================================== 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout:Install 99 Packages 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 95 M 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 520 M 2026-02-26T02:38:46.382 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:38:46.430 INFO:teuthology.orchestra.run.trial192.stdout:(18/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 640 kB/s | 351 kB 00:00 2026-02-26T02:38:46.492 INFO:teuthology.orchestra.run.trial130.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.7 MB/s | 442 kB 00:00 2026-02-26T02:38:46.518 INFO:teuthology.orchestra.run.trial192.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 788 kB/s | 184 kB 00:00 2026-02-26T02:38:46.548 INFO:teuthology.orchestra.run.trial192.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2026-02-26T02:38:46.585 INFO:teuthology.orchestra.run.trial161.stdout:(1/99): ceph-19.2.3-687.g8d724284.el9.x86_64.rp 84 kB/s | 6.5 kB 00:00 2026-02-26T02:38:46.642 INFO:teuthology.orchestra.run.trial192.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2026-02-26T02:38:46.651 INFO:teuthology.orchestra.run.trial130.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 485 kB/s | 77 kB 00:00 2026-02-26T02:38:46.654 INFO:teuthology.orchestra.run.trial192.stdout:(22/99): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-26T02:38:46.742 INFO:teuthology.orchestra.run.trial192.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 1.7 MB/s | 150 kB 00:00 2026-02-26T02:38:46.742 INFO:teuthology.orchestra.run.trial192.stdout:(24/99): python3-pycparser-2.20-6.el9.noarch.rp 1.3 MB/s | 135 kB 00:00 2026-02-26T02:38:46.750 INFO:teuthology.orchestra.run.trial161.stdout:(2/99): ceph-mgr-19.2.3-687.g8d724284.el9.x86_6 4.4 MB/s | 1.1 MB 00:00 2026-02-26T02:38:46.810 INFO:teuthology.orchestra.run.trial130.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 1.6 MB/s | 267 kB 00:00 2026-02-26T02:38:46.820 INFO:teuthology.orchestra.run.trial093.stdout:(1/99): ceph-19.2.3-687.g8d724284.el9.x86_64.rp 52 kB/s | 6.5 kB 00:00 2026-02-26T02:38:46.834 INFO:teuthology.orchestra.run.trial192.stdout:(25/99): python3-urllib3-1.26.5-7.el9.noarch.rp 2.3 MB/s | 218 kB 00:00 2026-02-26T02:38:46.839 INFO:teuthology.orchestra.run.trial192.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 1.3 MB/s | 126 kB 00:00 2026-02-26T02:38:46.842 INFO:teuthology.orchestra.run.trial192.stdout:(27/99): python3-cryptography-36.0.1-5.el9.x86_ 3.8 MB/s | 1.2 MB 00:00 2026-02-26T02:38:46.861 INFO:teuthology.orchestra.run.trial161.stdout:(3/99): ceph-mds-19.2.3-687.g8d724284.el9.x86_6 6.8 MB/s | 2.4 MB 00:00 2026-02-26T02:38:46.891 INFO:teuthology.orchestra.run.trial161.stdout:(4/99): ceph-grafana-dashboards-19.2.3-687.g8d7 1.0 MB/s | 31 kB 00:00 2026-02-26T02:38:46.923 INFO:teuthology.orchestra.run.trial192.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 2.0 MB/s | 182 kB 00:00 2026-02-26T02:38:46.923 INFO:teuthology.orchestra.run.trial161.stdout:(5/99): ceph-mgr-cephadm-19.2.3-687.g8d724284.e 4.5 MB/s | 150 kB 00:00 2026-02-26T02:38:46.959 INFO:teuthology.orchestra.run.trial192.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 2.2 MB/s | 266 kB 00:00 2026-02-26T02:38:46.971 INFO:teuthology.orchestra.run.trial130.stdout:(47/99): python3-pyasn1-0.4.8-7.el9.noarch.rpm 980 kB/s | 157 kB 00:00 2026-02-26T02:38:47.131 INFO:teuthology.orchestra.run.trial130.stdout:(48/99): python3-pyasn1-modules-0.4.8-7.el9.noa 1.7 MB/s | 277 kB 00:00 2026-02-26T02:38:47.137 INFO:teuthology.orchestra.run.trial093.stdout:(2/99): ceph-mgr-19.2.3-687.g8d724284.el9.x86_6 2.4 MB/s | 1.1 MB 00:00 2026-02-26T02:38:47.290 INFO:teuthology.orchestra.run.trial130.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 338 kB/s | 54 kB 00:00 2026-02-26T02:38:47.338 INFO:teuthology.orchestra.run.trial093.stdout:(3/99): ceph-mds-19.2.3-687.g8d724284.el9.x86_6 3.8 MB/s | 2.4 MB 00:00 2026-02-26T02:38:47.353 INFO:teuthology.orchestra.run.trial161.stdout:(6/99): ceph-mgr-dashboard-19.2.3-687.g8d724284 8.9 MB/s | 3.8 MB 00:00 2026-02-26T02:38:47.384 INFO:teuthology.orchestra.run.trial093.stdout:(4/99): ceph-grafana-dashboards-19.2.3-687.g8d7 674 kB/s | 31 kB 00:00 2026-02-26T02:38:47.439 INFO:teuthology.orchestra.run.trial093.stdout:(5/99): ceph-mgr-cephadm-19.2.3-687.g8d724284.e 2.6 MB/s | 150 kB 00:00 2026-02-26T02:38:47.802 INFO:teuthology.orchestra.run.trial161.stdout:(7/99): ceph-mon-19.2.3-687.g8d724284.el9.x86_6 3.9 MB/s | 4.7 MB 00:01 2026-02-26T02:38:47.869 INFO:teuthology.orchestra.run.trial161.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-687.g8d724284 332 kB/s | 22 kB 00:00 2026-02-26T02:38:48.065 INFO:teuthology.orchestra.run.trial161.stdout:(9/99): ceph-mgr-diskprediction-local-19.2.3-68 10 MB/s | 7.4 MB 00:00 2026-02-26T02:38:48.081 INFO:teuthology.orchestra.run.trial093.stdout:(6/99): ceph-mgr-dashboard-19.2.3-687.g8d724284 5.9 MB/s | 3.8 MB 00:00 2026-02-26T02:38:48.104 INFO:teuthology.orchestra.run.trial161.stdout:(10/99): ceph-mgr-rook-19.2.3-687.g8d724284.el9 1.2 MB/s | 49 kB 00:00 2026-02-26T02:38:48.106 INFO:teuthology.orchestra.run.trial093.stdout:(7/99): ceph-mon-19.2.3-687.g8d724284.el9.x86_6 3.7 MB/s | 4.7 MB 00:01 2026-02-26T02:38:48.134 INFO:teuthology.orchestra.run.trial192.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 23 kB/s | 30 kB 00:01 2026-02-26T02:38:48.145 INFO:teuthology.orchestra.run.trial161.stdout:(11/99): ceph-prometheus-alerts-19.2.3-687.g8d7 402 kB/s | 17 kB 00:00 2026-02-26T02:38:48.148 INFO:teuthology.orchestra.run.trial093.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-687.g8d724284 526 kB/s | 22 kB 00:00 2026-02-26T02:38:48.203 INFO:teuthology.orchestra.run.trial161.stdout:(12/99): ceph-osd-19.2.3-687.g8d724284.el9.x86_ 12 MB/s | 17 MB 00:01 2026-02-26T02:38:48.204 INFO:teuthology.orchestra.run.trial161.stdout:(13/99): ceph-volume-19.2.3-687.g8d724284.el9.n 5.0 MB/s | 299 kB 00:00 2026-02-26T02:38:48.211 INFO:teuthology.orchestra.run.trial192.stdout:(31/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.1 MB/s | 246 kB 00:00 2026-02-26T02:38:48.234 INFO:teuthology.orchestra.run.trial192.stdout:(32/99): flexiblas-openblas-openmp-3.0.4-9.el9. 12 kB/s | 15 kB 00:01 2026-02-26T02:38:48.238 INFO:teuthology.orchestra.run.trial093.stdout:(9/99): ceph-mgr-modules-core-19.2.3-687.g8d724 2.7 MB/s | 253 kB 00:00 2026-02-26T02:38:48.239 INFO:teuthology.orchestra.run.trial192.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 6.7 MB/s | 188 kB 00:00 2026-02-26T02:38:48.277 INFO:teuthology.orchestra.run.trial192.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 992 kB/s | 42 kB 00:00 2026-02-26T02:38:48.291 INFO:teuthology.orchestra.run.trial093.stdout:(10/99): ceph-mgr-rook-19.2.3-687.g8d724284.el9 937 kB/s | 49 kB 00:00 2026-02-26T02:38:48.295 INFO:teuthology.orchestra.run.trial161.stdout:(14/99): cephadm-19.2.3-687.g8d724284.el9.noarc 8.2 MB/s | 769 kB 00:00 2026-02-26T02:38:48.301 INFO:teuthology.orchestra.run.trial192.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.2 MB/s | 3.0 MB 00:01 2026-02-26T02:38:48.334 INFO:teuthology.orchestra.run.trial093.stdout:(11/99): ceph-prometheus-alerts-19.2.3-687.g8d7 391 kB/s | 17 kB 00:00 2026-02-26T02:38:48.348 INFO:teuthology.orchestra.run.trial192.stdout:(36/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 49 MB/s | 5.3 MB 00:00 2026-02-26T02:38:48.360 INFO:teuthology.orchestra.run.trial192.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 101 MB/s | 6.0 MB 00:00 2026-02-26T02:38:48.369 INFO:teuthology.orchestra.run.trial161.stdout:(15/99): ceph-mgr-modules-core-19.2.3-687.g8d72 505 kB/s | 253 kB 00:00 2026-02-26T02:38:48.371 INFO:teuthology.orchestra.run.trial192.stdout:(38/99): python3-devel-3.9.25-3.el9.x86_64.rpm 10 MB/s | 244 kB 00:00 2026-02-26T02:38:48.383 INFO:teuthology.orchestra.run.trial192.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 11 MB/s | 249 kB 00:00 2026-02-26T02:38:48.385 INFO:teuthology.orchestra.run.trial192.stdout:(40/99): protobuf-3.14.0-17.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2026-02-26T02:38:48.393 INFO:teuthology.orchestra.run.trial192.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.8 MB/s | 177 kB 00:00 2026-02-26T02:38:48.408 INFO:teuthology.orchestra.run.trial192.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 48 MB/s | 1.2 MB 00:00 2026-02-26T02:38:48.410 INFO:teuthology.orchestra.run.trial192.stdout:(43/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.9 MB/s | 172 kB 00:00 2026-02-26T02:38:48.414 INFO:teuthology.orchestra.run.trial192.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.7 MB/s | 35 kB 00:00 2026-02-26T02:38:48.423 INFO:teuthology.orchestra.run.trial093.stdout:(12/99): ceph-volume-19.2.3-687.g8d724284.el9.n 3.3 MB/s | 299 kB 00:00 2026-02-26T02:38:48.435 INFO:teuthology.orchestra.run.trial192.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-26T02:38:48.436 INFO:teuthology.orchestra.run.trial192.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 3.5 MB/s | 77 kB 00:00 2026-02-26T02:38:48.457 INFO:teuthology.orchestra.run.trial192.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 12 MB/s | 267 kB 00:00 2026-02-26T02:38:48.464 INFO:teuthology.orchestra.run.trial192.stdout:(48/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 110 MB/s | 6.1 MB 00:00 2026-02-26T02:38:48.464 INFO:teuthology.orchestra.run.trial192.stdout:(49/99): python3-pyasn1-0.4.8-7.el9.noarch.rpm 5.4 MB/s | 157 kB 00:00 2026-02-26T02:38:48.479 INFO:teuthology.orchestra.run.trial192.stdout:(50/99): python3-pyasn1-modules-0.4.8-7.el9.noa 12 MB/s | 277 kB 00:00 2026-02-26T02:38:48.485 INFO:teuthology.orchestra.run.trial192.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 2.5 MB/s | 54 kB 00:00 2026-02-26T02:38:48.500 INFO:teuthology.orchestra.run.trial192.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 2.0 MB/s | 42 kB 00:00 2026-02-26T02:38:48.506 INFO:teuthology.orchestra.run.trial192.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.8 MB/s | 189 kB 00:00 2026-02-26T02:38:48.521 INFO:teuthology.orchestra.run.trial192.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 4.3 MB/s | 90 kB 00:00 2026-02-26T02:38:48.613 INFO:teuthology.orchestra.run.trial093.stdout:(13/99): cephadm-19.2.3-687.g8d724284.el9.noarc 4.0 MB/s | 769 kB 00:00 2026-02-26T02:38:48.646 INFO:teuthology.orchestra.run.trial192.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 106 MB/s | 19 MB 00:00 2026-02-26T02:38:48.821 INFO:teuthology.orchestra.run.trial130.stdout:(50/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 13 MB/s | 19 MB 00:01 2026-02-26T02:38:48.980 INFO:teuthology.orchestra.run.trial130.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 263 kB/s | 42 kB 00:00 2026-02-26T02:38:49.025 INFO:teuthology.orchestra.run.trial093.stdout:(14/99): ceph-mgr-diskprediction-local-19.2.3-6 7.8 MB/s | 7.4 MB 00:00 2026-02-26T02:38:49.139 INFO:teuthology.orchestra.run.trial130.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.2 MB/s | 189 kB 00:00 2026-02-26T02:38:49.182 INFO:teuthology.orchestra.run.trial130.stdout:(53/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 2.1 MB/s | 6.1 MB 00:02 2026-02-26T02:38:49.297 INFO:teuthology.orchestra.run.trial130.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 572 kB/s | 90 kB 00:00 2026-02-26T02:38:49.506 INFO:teuthology.orchestra.run.trial093.stdout:(15/99): ceph-osd-19.2.3-687.g8d724284.el9.x86_ 7.2 MB/s | 17 MB 00:02 2026-02-26T02:38:49.762 INFO:teuthology.orchestra.run.trial130.stdout:(55/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 881 kB/s | 5.3 MB 00:06 2026-02-26T02:38:50.291 INFO:teuthology.orchestra.run.trial130.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-26T02:38:50.361 INFO:teuthology.orchestra.run.trial130.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 280 kB/s | 19 kB 00:00 2026-02-26T02:38:50.444 INFO:teuthology.orchestra.run.trial130.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2026-02-26T02:38:50.562 INFO:teuthology.orchestra.run.trial130.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 4.6 MB/s | 548 kB 00:00 2026-02-26T02:38:50.633 INFO:teuthology.orchestra.run.trial130.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 414 kB/s | 29 kB 00:00 2026-02-26T02:38:50.706 INFO:teuthology.orchestra.run.trial130.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 822 kB/s | 60 kB 00:00 2026-02-26T02:38:50.778 INFO:teuthology.orchestra.run.trial130.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 601 kB/s | 43 kB 00:00 2026-02-26T02:38:50.850 INFO:teuthology.orchestra.run.trial130.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 452 kB/s | 32 kB 00:00 2026-02-26T02:38:50.920 INFO:teuthology.orchestra.run.trial130.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 201 kB/s | 14 kB 00:00 2026-02-26T02:38:51.002 INFO:teuthology.orchestra.run.trial130.stdout:(65/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.1 MB/s | 173 kB 00:00 2026-02-26T02:38:51.098 INFO:teuthology.orchestra.run.trial130.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 3.7 MB/s | 358 kB 00:00 2026-02-26T02:38:51.185 INFO:teuthology.orchestra.run.trial130.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 2.8 MB/s | 254 kB 00:00 2026-02-26T02:38:51.397 INFO:teuthology.orchestra.run.trial130.stdout:(68/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.6 MB/s | 2.0 MB 00:00 2026-02-26T02:38:51.470 INFO:teuthology.orchestra.run.trial130.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.9 MB/s | 144 kB 00:00 2026-02-26T02:38:51.543 INFO:teuthology.orchestra.run.trial130.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.9 MB/s | 139 kB 00:00 2026-02-26T02:38:51.614 INFO:teuthology.orchestra.run.trial130.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 790 kB/s | 56 kB 00:00 2026-02-26T02:38:51.684 INFO:teuthology.orchestra.run.trial130.stdout:(72/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 153 kB/s | 11 kB 00:00 2026-02-26T02:38:51.754 INFO:teuthology.orchestra.run.trial130.stdout:(73/99): python3-jaraco-classes-3.2.1-5.el9.noa 252 kB/s | 18 kB 00:00 2026-02-26T02:38:51.824 INFO:teuthology.orchestra.run.trial130.stdout:(74/99): python3-jaraco-collections-3.0.0-8.el9 331 kB/s | 23 kB 00:00 2026-02-26T02:38:51.894 INFO:teuthology.orchestra.run.trial130.stdout:(75/99): python3-jaraco-context-6.0.1-3.el9.noa 279 kB/s | 20 kB 00:00 2026-02-26T02:38:51.964 INFO:teuthology.orchestra.run.trial130.stdout:(76/99): python3-jaraco-functools-3.5.0-2.el9.n 277 kB/s | 19 kB 00:00 2026-02-26T02:38:52.035 INFO:teuthology.orchestra.run.trial130.stdout:(77/99): python3-jaraco-text-4.0.0-2.el9.noarch 375 kB/s | 26 kB 00:00 2026-02-26T02:38:52.177 INFO:teuthology.orchestra.run.trial130.stdout:(78/99): python3-kubernetes-26.1.0-3.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2026-02-26T02:38:52.247 INFO:teuthology.orchestra.run.trial130.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 652 kB/s | 46 kB 00:00 2026-02-26T02:38:52.319 INFO:teuthology.orchestra.run.trial130.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2026-02-26T02:38:52.390 INFO:teuthology.orchestra.run.trial130.stdout:(81/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2026-02-26T02:38:52.461 INFO:teuthology.orchestra.run.trial130.stdout:(82/99): python3-natsort-7.1.1-5.el9.noarch.rpm 811 kB/s | 58 kB 00:00 2026-02-26T02:38:52.536 INFO:teuthology.orchestra.run.trial130.stdout:(83/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2026-02-26T02:38:52.607 INFO:teuthology.orchestra.run.trial130.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 233 kB/s | 16 kB 00:00 2026-02-26T02:38:52.679 INFO:teuthology.orchestra.run.trial130.stdout:(85/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2026-02-26T02:38:52.749 INFO:teuthology.orchestra.run.trial130.stdout:(86/99): python3-repoze-lru-0.7-16.el9.noarch.r 437 kB/s | 31 kB 00:00 2026-02-26T02:38:52.822 INFO:teuthology.orchestra.run.trial130.stdout:(87/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2026-02-26T02:38:52.893 INFO:teuthology.orchestra.run.trial130.stdout:(88/99): python3-rsa-4.9-2.el9.noarch.rpm 831 kB/s | 59 kB 00:00 2026-02-26T02:38:52.966 INFO:teuthology.orchestra.run.trial130.stdout:(89/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.7 MB/s | 125 kB 00:00 2026-02-26T02:38:53.037 INFO:teuthology.orchestra.run.trial130.stdout:(90/99): python3-tempora-5.0.0-2.el9.noarch.rpm 506 kB/s | 36 kB 00:00 2026-02-26T02:38:53.108 INFO:teuthology.orchestra.run.trial130.stdout:(91/99): python3-typing-extensions-4.15.0-1.el9 1.2 MB/s | 86 kB 00:00 2026-02-26T02:38:53.182 INFO:teuthology.orchestra.run.trial130.stdout:(92/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2026-02-26T02:38:53.254 INFO:teuthology.orchestra.run.trial130.stdout:(93/99): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2026-02-26T02:38:53.290 INFO:teuthology.orchestra.run.trial130.stdout:(94/99): lua-devel-5.4.4-4.el9.x86_64.rpm 5.4 kB/s | 22 kB 00:04 2026-02-26T02:38:53.302 INFO:teuthology.orchestra.run.trial161.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 8.1 kB/s | 40 kB 00:05 2026-02-26T02:38:53.327 INFO:teuthology.orchestra.run.trial161.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 15 kB/s | 72 kB 00:04 2026-02-26T02:38:53.333 INFO:teuthology.orchestra.run.trial130.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.3 MB/s | 427 kB 00:00 2026-02-26T02:38:53.383 INFO:teuthology.orchestra.run.trial161.stdout:(18/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 68 kB/s | 351 kB 00:05 2026-02-26T02:38:53.399 INFO:teuthology.orchestra.run.trial161.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 2.5 MB/s | 184 kB 00:00 2026-02-26T02:38:53.403 INFO:teuthology.orchestra.run.trial130.stdout:(96/99): python3-xmltodict-0.12.0-15.el9.noarch 314 kB/s | 22 kB 00:00 2026-02-26T02:38:53.414 INFO:teuthology.orchestra.run.trial130.stdout:(97/99): protobuf-compiler-3.14.0-17.el9.x86_64 209 kB/s | 862 kB 00:04 2026-02-26T02:38:53.419 INFO:teuthology.orchestra.run.trial161.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.8 MB/s | 253 kB 00:00 2026-02-26T02:38:53.438 INFO:teuthology.orchestra.run.trial161.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 5.7 MB/s | 794 kB 00:00 2026-02-26T02:38:53.449 INFO:teuthology.orchestra.run.trial161.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 3.5 MB/s | 106 kB 00:00 2026-02-26T02:38:53.466 INFO:teuthology.orchestra.run.trial161.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 4.8 MB/s | 135 kB 00:00 2026-02-26T02:38:53.474 INFO:teuthology.orchestra.run.trial130.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 281 kB/s | 20 kB 00:00 2026-02-26T02:38:53.481 INFO:teuthology.orchestra.run.trial161.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 4.7 MB/s | 150 kB 00:00 2026-02-26T02:38:53.493 INFO:teuthology.orchestra.run.trial161.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 4.6 MB/s | 126 kB 00:00 2026-02-26T02:38:53.499 INFO:teuthology.orchestra.run.trial161.stdout:(26/99): python3-cryptography-36.0.1-5.el9.x86_ 13 MB/s | 1.2 MB 00:00 2026-02-26T02:38:53.516 INFO:teuthology.orchestra.run.trial161.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 6.0 MB/s | 218 kB 00:00 2026-02-26T02:38:53.524 INFO:teuthology.orchestra.run.trial161.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 5.8 MB/s | 182 kB 00:00 2026-02-26T02:38:53.526 INFO:teuthology.orchestra.run.trial161.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 9.5 MB/s | 266 kB 00:00 2026-02-26T02:38:53.564 INFO:teuthology.orchestra.run.trial161.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 624 kB/s | 30 kB 00:00 2026-02-26T02:38:53.572 INFO:teuthology.orchestra.run.trial161.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 327 kB/s | 15 kB 00:00 2026-02-26T02:38:53.574 INFO:teuthology.orchestra.run.trial130.stdout:(99/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 171 kB/s | 48 kB 00:00 2026-02-26T02:38:53.579 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:53.579 INFO:teuthology.orchestra.run.trial130.stdout:Total 5.8 MB/s | 95 MB 00:16 2026-02-26T02:38:53.591 INFO:teuthology.orchestra.run.trial161.stdout:(32/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 45 MB/s | 3.0 MB 00:00 2026-02-26T02:38:53.600 INFO:teuthology.orchestra.run.trial161.stdout:(33/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 6.6 MB/s | 246 kB 00:00 2026-02-26T02:38:53.606 INFO:teuthology.orchestra.run.trial161.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 5.4 MB/s | 188 kB 00:00 2026-02-26T02:38:53.612 INFO:teuthology.orchestra.run.trial161.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-26T02:38:53.640 INFO:teuthology.orchestra.run.trial161.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 29 MB/s | 1.0 MB 00:00 2026-02-26T02:38:53.666 INFO:teuthology.orchestra.run.trial161.stdout:(37/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 80 MB/s | 5.3 MB 00:00 2026-02-26T02:38:53.667 INFO:teuthology.orchestra.run.trial161.stdout:(38/99): python3-devel-3.9.25-3.el9.x86_64.rpm 9.0 MB/s | 244 kB 00:00 2026-02-26T02:38:53.680 INFO:teuthology.orchestra.run.trial161.stdout:(39/99): python3-babel-2.9.1-2.el9.noarch.rpm 89 MB/s | 6.0 MB 00:00 2026-02-26T02:38:53.692 INFO:teuthology.orchestra.run.trial161.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.5 MB/s | 249 kB 00:00 2026-02-26T02:38:53.694 INFO:teuthology.orchestra.run.trial161.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 6.5 MB/s | 177 kB 00:00 2026-02-26T02:38:53.708 INFO:teuthology.orchestra.run.trial161.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 44 MB/s | 1.2 MB 00:00 2026-02-26T02:38:53.716 INFO:teuthology.orchestra.run.trial161.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.6 MB/s | 35 kB 00:00 2026-02-26T02:38:53.717 INFO:teuthology.orchestra.run.trial161.stdout:(44/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2026-02-26T02:38:53.736 INFO:teuthology.orchestra.run.trial192.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 108 kB/s | 551 kB 00:05 2026-02-26T02:38:53.748 INFO:teuthology.orchestra.run.trial161.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 2.5 MB/s | 77 kB 00:00 2026-02-26T02:38:53.753 INFO:teuthology.orchestra.run.trial192.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2026-02-26T02:38:53.769 INFO:teuthology.orchestra.run.trial192.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 9.1 MB/s | 151 kB 00:00 2026-02-26T02:38:53.774 INFO:teuthology.orchestra.run.trial161.stdout:(46/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 7.3 MB/s | 442 kB 00:00 2026-02-26T02:38:53.777 INFO:teuthology.orchestra.run.trial161.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 8.9 MB/s | 267 kB 00:00 2026-02-26T02:38:53.792 INFO:teuthology.orchestra.run.trial192.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 24 MB/s | 548 kB 00:00 2026-02-26T02:38:53.798 INFO:teuthology.orchestra.run.trial161.stdout:(48/99): python3-pyasn1-0.4.8-7.el9.noarch.rpm 6.6 MB/s | 157 kB 00:00 2026-02-26T02:38:53.801 INFO:teuthology.orchestra.run.trial161.stdout:(49/99): python3-pyasn1-modules-0.4.8-7.el9.noa 11 MB/s | 277 kB 00:00 2026-02-26T02:38:53.811 INFO:teuthology.orchestra.run.trial192.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 1.5 MB/s | 29 kB 00:00 2026-02-26T02:38:53.822 INFO:teuthology.orchestra.run.trial161.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 2.2 MB/s | 54 kB 00:00 2026-02-26T02:38:53.830 INFO:teuthology.orchestra.run.trial161.stdout:(51/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 50 MB/s | 6.1 MB 00:00 2026-02-26T02:38:53.831 INFO:teuthology.orchestra.run.trial192.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 2.9 MB/s | 60 kB 00:00 2026-02-26T02:38:53.851 INFO:teuthology.orchestra.run.trial192.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.2 MB/s | 43 kB 00:00 2026-02-26T02:38:53.853 INFO:teuthology.orchestra.run.trial161.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.3 MB/s | 42 kB 00:00 2026-02-26T02:38:53.867 INFO:teuthology.orchestra.run.trial161.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 5.2 MB/s | 189 kB 00:00 2026-02-26T02:38:53.870 INFO:teuthology.orchestra.run.trial192.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 1.6 MB/s | 32 kB 00:00 2026-02-26T02:38:53.881 INFO:teuthology.orchestra.run.trial161.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.2 MB/s | 90 kB 00:00 2026-02-26T02:38:53.889 INFO:teuthology.orchestra.run.trial192.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 741 kB/s | 14 kB 00:00 2026-02-26T02:38:53.909 INFO:teuthology.orchestra.run.trial192.stdout:(65/99): python3-cheroot-10.0.1-4.el9.noarch.rp 8.6 MB/s | 173 kB 00:00 2026-02-26T02:38:53.924 INFO:teuthology.orchestra.run.trial192.stdout:(66/99): lua-devel-5.4.4-4.el9.x86_64.rpm 4.1 kB/s | 22 kB 00:05 2026-02-26T02:38:53.930 INFO:teuthology.orchestra.run.trial192.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 17 MB/s | 358 kB 00:00 2026-02-26T02:38:53.945 INFO:teuthology.orchestra.run.trial192.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 12 MB/s | 254 kB 00:00 2026-02-26T02:38:53.973 INFO:teuthology.orchestra.run.trial192.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 48 MB/s | 2.0 MB 00:00 2026-02-26T02:38:53.979 INFO:teuthology.orchestra.run.trial161.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 109 MB/s | 19 MB 00:00 2026-02-26T02:38:53.993 INFO:teuthology.orchestra.run.trial192.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 6.6 MB/s | 139 kB 00:00 2026-02-26T02:38:54.004 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:38:54.005 INFO:teuthology.orchestra.run.trial192.stdout:(71/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.4 MB/s | 144 kB 00:00 2026-02-26T02:38:54.013 INFO:teuthology.orchestra.run.trial192.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 2.8 MB/s | 56 kB 00:00 2026-02-26T02:38:54.023 INFO:teuthology.orchestra.run.trial192.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 564 kB/s | 11 kB 00:00 2026-02-26T02:38:54.034 INFO:teuthology.orchestra.run.trial192.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 840 kB/s | 18 kB 00:00 2026-02-26T02:38:54.043 INFO:teuthology.orchestra.run.trial192.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 1.2 MB/s | 23 kB 00:00 2026-02-26T02:38:54.044 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:38:54.044 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:38:54.055 INFO:teuthology.orchestra.run.trial192.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 949 kB/s | 20 kB 00:00 2026-02-26T02:38:54.063 INFO:teuthology.orchestra.run.trial192.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 981 kB/s | 19 kB 00:00 2026-02-26T02:38:54.075 INFO:teuthology.orchestra.run.trial192.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 1.3 MB/s | 26 kB 00:00 2026-02-26T02:38:54.093 INFO:teuthology.orchestra.run.trial192.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 34 MB/s | 1.0 MB 00:00 2026-02-26T02:38:54.095 INFO:teuthology.orchestra.run.trial192.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 2.3 MB/s | 46 kB 00:00 2026-02-26T02:38:54.113 INFO:teuthology.orchestra.run.trial192.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 3.9 MB/s | 79 kB 00:00 2026-02-26T02:38:54.115 INFO:teuthology.orchestra.run.trial192.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 4.0 MB/s | 86 kB 00:00 2026-02-26T02:38:54.132 INFO:teuthology.orchestra.run.trial192.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 2.9 MB/s | 58 kB 00:00 2026-02-26T02:38:54.145 INFO:teuthology.orchestra.run.trial192.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 9.2 MB/s | 272 kB 00:00 2026-02-26T02:38:54.152 INFO:teuthology.orchestra.run.trial192.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 849 kB/s | 16 kB 00:00 2026-02-26T02:38:54.164 INFO:teuthology.orchestra.run.trial192.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.5 MB/s | 90 kB 00:00 2026-02-26T02:38:54.173 INFO:teuthology.orchestra.run.trial192.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-26T02:38:54.184 INFO:teuthology.orchestra.run.trial192.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 9.2 MB/s | 188 kB 00:00 2026-02-26T02:38:54.195 INFO:teuthology.orchestra.run.trial192.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 2.8 MB/s | 59 kB 00:00 2026-02-26T02:38:54.204 INFO:teuthology.orchestra.run.trial192.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 6.3 MB/s | 125 kB 00:00 2026-02-26T02:38:54.215 INFO:teuthology.orchestra.run.trial192.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.7 MB/s | 36 kB 00:00 2026-02-26T02:38:54.224 INFO:teuthology.orchestra.run.trial192.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 4.2 MB/s | 86 kB 00:00 2026-02-26T02:38:54.230 INFO:teuthology.orchestra.run.trial093.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 7.8 kB/s | 40 kB 00:05 2026-02-26T02:38:54.236 INFO:teuthology.orchestra.run.trial192.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 11 MB/s | 230 kB 00:00 2026-02-26T02:38:54.246 INFO:teuthology.orchestra.run.trial192.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 4.0 MB/s | 90 kB 00:00 2026-02-26T02:38:54.258 INFO:teuthology.orchestra.run.trial192.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 19 MB/s | 427 kB 00:00 2026-02-26T02:38:54.267 INFO:teuthology.orchestra.run.trial192.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.2 MB/s | 48 kB 00:00 2026-02-26T02:38:54.278 INFO:teuthology.orchestra.run.trial192.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 1.1 MB/s | 22 kB 00:00 2026-02-26T02:38:54.289 INFO:teuthology.orchestra.run.trial192.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 908 kB/s | 20 kB 00:00 2026-02-26T02:38:54.292 INFO:teuthology.orchestra.run.trial093.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 15 kB/s | 72 kB 00:04 2026-02-26T02:38:54.301 INFO:teuthology.orchestra.run.trial161.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.7 MB/s | 551 kB 00:00 2026-02-26T02:38:54.340 INFO:teuthology.orchestra.run.trial161.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 511 kB/s | 19 kB 00:00 2026-02-26T02:38:54.395 INFO:teuthology.orchestra.run.trial161.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 2.7 MB/s | 151 kB 00:00 2026-02-26T02:38:54.427 INFO:teuthology.orchestra.run.trial161.stdout:(59/99): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-26T02:38:54.463 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:38:54.464 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:38:54.473 INFO:teuthology.orchestra.run.trial161.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 6.9 MB/s | 548 kB 00:00 2026-02-26T02:38:54.481 INFO:teuthology.orchestra.run.trial093.stdout:(18/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 60 kB/s | 351 kB 00:05 2026-02-26T02:38:54.518 INFO:teuthology.orchestra.run.trial161.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 1.3 MB/s | 60 kB 00:00 2026-02-26T02:38:54.566 INFO:teuthology.orchestra.run.trial161.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 888 kB/s | 43 kB 00:00 2026-02-26T02:38:54.597 INFO:teuthology.orchestra.run.trial161.stdout:(63/99): python3-autocommand-2.2.2-8.el9.noarch 173 kB/s | 29 kB 00:00 2026-02-26T02:38:54.625 INFO:teuthology.orchestra.run.trial161.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 552 kB/s | 32 kB 00:00 2026-02-26T02:38:54.648 INFO:teuthology.orchestra.run.trial161.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 279 kB/s | 14 kB 00:00 2026-02-26T02:38:54.680 INFO:teuthology.orchestra.run.trial161.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 3.1 MB/s | 173 kB 00:00 2026-02-26T02:38:54.732 INFO:teuthology.orchestra.run.trial161.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 4.8 MB/s | 254 kB 00:00 2026-02-26T02:38:54.812 INFO:teuthology.orchestra.run.trial161.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 2.1 MB/s | 358 kB 00:00 2026-02-26T02:38:54.851 INFO:teuthology.orchestra.run.trial161.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 17 MB/s | 2.0 MB 00:00 2026-02-26T02:38:54.867 INFO:teuthology.orchestra.run.trial161.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.6 MB/s | 144 kB 00:00 2026-02-26T02:38:54.900 INFO:teuthology.orchestra.run.trial161.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 2.8 MB/s | 139 kB 00:00 2026-02-26T02:38:54.916 INFO:teuthology.orchestra.run.trial161.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.1 MB/s | 56 kB 00:00 2026-02-26T02:38:54.919 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:38:54.921 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-26T02:38:54.932 INFO:teuthology.orchestra.run.trial192.stdout:(99/99): protobuf-compiler-3.14.0-17.el9.x86_64 134 kB/s | 862 kB 00:06 2026-02-26T02:38:54.937 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:54.937 INFO:teuthology.orchestra.run.trial192.stdout:Total 8.8 MB/s | 95 MB 00:10 2026-02-26T02:38:54.938 INFO:teuthology.orchestra.run.trial161.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 280 kB/s | 11 kB 00:00 2026-02-26T02:38:54.952 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-26T02:38:54.956 INFO:teuthology.orchestra.run.trial161.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 449 kB/s | 18 kB 00:00 2026-02-26T02:38:54.957 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-26T02:38:54.977 INFO:teuthology.orchestra.run.trial161.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 604 kB/s | 23 kB 00:00 2026-02-26T02:38:54.978 INFO:teuthology.orchestra.run.trial130.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-26T02:38:54.984 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/99 2026-02-26T02:38:55.004 INFO:teuthology.orchestra.run.trial161.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 411 kB/s | 20 kB 00:00 2026-02-26T02:38:55.015 INFO:teuthology.orchestra.run.trial161.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 510 kB/s | 19 kB 00:00 2026-02-26T02:38:55.017 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-26T02:38:55.026 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-26T02:38:55.031 INFO:teuthology.orchestra.run.trial130.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-26T02:38:55.034 INFO:teuthology.orchestra.run.trial130.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-26T02:38:55.038 INFO:teuthology.orchestra.run.trial130.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-26T02:38:55.043 INFO:teuthology.orchestra.run.trial161.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 673 kB/s | 26 kB 00:00 2026-02-26T02:38:55.061 INFO:teuthology.orchestra.run.trial130.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-26T02:38:55.063 INFO:teuthology.orchestra.run.trial093.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 239 kB/s | 184 kB 00:00 2026-02-26T02:38:55.074 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-26T02:38:55.075 INFO:teuthology.orchestra.run.trial161.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 17 MB/s | 1.0 MB 00:00 2026-02-26T02:38:55.078 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-26T02:38:55.084 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-26T02:38:55.086 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-26T02:38:55.093 INFO:teuthology.orchestra.run.trial161.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2026-02-26T02:38:55.097 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-26T02:38:55.103 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-26T02:38:55.126 INFO:teuthology.orchestra.run.trial161.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2026-02-26T02:38:55.127 INFO:teuthology.orchestra.run.trial130.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-26T02:38:55.130 INFO:teuthology.orchestra.run.trial130.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-26T02:38:55.136 INFO:teuthology.orchestra.run.trial161.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2026-02-26T02:38:55.137 INFO:teuthology.orchestra.run.trial130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-26T02:38:55.159 INFO:teuthology.orchestra.run.trial093.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 855 kB/s | 794 kB 00:00 2026-02-26T02:38:55.161 INFO:teuthology.orchestra.run.trial130.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-26T02:38:55.164 INFO:teuthology.orchestra.run.trial161.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.5 MB/s | 58 kB 00:00 2026-02-26T02:38:55.202 INFO:teuthology.orchestra.run.trial161.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2026-02-26T02:38:55.213 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-26T02:38:55.226 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 23/99 2026-02-26T02:38:55.228 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-26T02:38:55.233 INFO:teuthology.orchestra.run.trial130.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-26T02:38:55.235 INFO:teuthology.orchestra.run.trial161.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 229 kB/s | 16 kB 00:00 2026-02-26T02:38:55.238 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-26T02:38:55.242 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-26T02:38:55.246 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-26T02:38:55.248 INFO:teuthology.orchestra.run.trial161.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.9 MB/s | 90 kB 00:00 2026-02-26T02:38:55.260 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-26T02:38:55.281 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-26T02:38:55.282 INFO:teuthology.orchestra.run.trial161.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 669 kB/s | 31 kB 00:00 2026-02-26T02:38:55.286 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-26T02:38:55.291 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-26T02:38:55.292 INFO:teuthology.orchestra.run.trial093.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 312 kB/s | 253 kB 00:00 2026-02-26T02:38:55.302 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-26T02:38:55.307 INFO:teuthology.orchestra.run.trial161.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2026-02-26T02:38:55.311 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-26T02:38:55.317 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-26T02:38:55.328 INFO:teuthology.orchestra.run.trial161.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2026-02-26T02:38:55.336 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-26T02:38:55.345 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-26T02:38:55.361 INFO:teuthology.orchestra.run.trial161.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 2.3 MB/s | 125 kB 00:00 2026-02-26T02:38:55.368 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:38:55.378 INFO:teuthology.orchestra.run.trial161.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 718 kB/s | 36 kB 00:00 2026-02-26T02:38:55.399 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-26T02:38:55.405 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:38:55.405 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:38:55.408 INFO:teuthology.orchestra.run.trial161.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 1.8 MB/s | 86 kB 00:00 2026-02-26T02:38:55.411 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-26T02:38:55.427 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-26T02:38:55.431 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-26T02:38:55.439 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-26T02:38:55.445 INFO:teuthology.orchestra.run.trial161.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2026-02-26T02:38:55.463 INFO:teuthology.orchestra.run.trial161.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 1.6 MB/s | 90 kB 00:00 2026-02-26T02:38:55.479 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-26T02:38:55.488 INFO:teuthology.orchestra.run.trial161.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 9.7 MB/s | 427 kB 00:00 2026-02-26T02:38:55.511 INFO:teuthology.orchestra.run.trial161.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.0 MB/s | 48 kB 00:00 2026-02-26T02:38:55.527 INFO:teuthology.orchestra.run.trial161.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 582 kB/s | 22 kB 00:00 2026-02-26T02:38:55.549 INFO:teuthology.orchestra.run.trial161.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 521 kB/s | 20 kB 00:00 2026-02-26T02:38:55.803 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-26T02:38:55.812 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-26T02:38:55.816 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-26T02:38:55.822 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-26T02:38:55.823 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:38:55.823 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:38:55.824 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-26T02:38:55.851 INFO:teuthology.orchestra.run.trial130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-26T02:38:55.896 INFO:teuthology.orchestra.run.trial130.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-26T02:38:55.902 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-26T02:38:55.904 INFO:teuthology.orchestra.run.trial093.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 143 kB/s | 106 kB 00:00 2026-02-26T02:38:55.905 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-26T02:38:55.911 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-26T02:38:55.915 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-26T02:38:55.923 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-26T02:38:55.926 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-26T02:38:55.954 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-26T02:38:55.964 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-26T02:38:56.000 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-26T02:38:56.017 INFO:teuthology.orchestra.run.trial093.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 186 kB/s | 135 kB 00:00 2026-02-26T02:38:56.065 INFO:teuthology.orchestra.run.trial093.stdout:(24/99): python3-cryptography-36.0.1-5.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2026-02-26T02:38:56.224 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-26T02:38:56.247 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-26T02:38:56.251 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-26T02:38:56.277 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:38:56.279 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-26T02:38:56.309 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-26T02:38:56.310 INFO:teuthology.orchestra.run.trial130.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-26T02:38:56.312 INFO:teuthology.orchestra.run.trial130.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-26T02:38:56.314 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-26T02:38:56.333 INFO:teuthology.orchestra.run.trial130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-26T02:38:56.335 INFO:teuthology.orchestra.run.trial192.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-26T02:38:56.341 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/99 2026-02-26T02:38:56.375 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-26T02:38:56.384 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-26T02:38:56.389 INFO:teuthology.orchestra.run.trial192.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-26T02:38:56.391 INFO:teuthology.orchestra.run.trial192.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-26T02:38:56.396 INFO:teuthology.orchestra.run.trial192.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-26T02:38:56.420 INFO:teuthology.orchestra.run.trial192.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-26T02:38:56.432 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-26T02:38:56.435 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-26T02:38:56.441 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-26T02:38:56.443 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-26T02:38:56.454 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-26T02:38:56.460 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-26T02:38:56.484 INFO:teuthology.orchestra.run.trial192.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-26T02:38:56.487 INFO:teuthology.orchestra.run.trial192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-26T02:38:56.494 INFO:teuthology.orchestra.run.trial192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-26T02:38:56.518 INFO:teuthology.orchestra.run.trial192.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-26T02:38:56.557 INFO:teuthology.orchestra.run.trial161.stdout:(99/99): protobuf-compiler-3.14.0-17.el9.x86_64 322 kB/s | 862 kB 00:02 2026-02-26T02:38:56.564 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:38:56.564 INFO:teuthology.orchestra.run.trial161.stdout:Total 9.0 MB/s | 95 MB 00:10 2026-02-26T02:38:56.568 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-26T02:38:56.581 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 23/99 2026-02-26T02:38:56.583 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-26T02:38:56.588 INFO:teuthology.orchestra.run.trial192.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-26T02:38:56.593 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-26T02:38:56.597 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-26T02:38:56.601 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-26T02:38:56.615 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-26T02:38:56.634 INFO:teuthology.orchestra.run.trial093.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 206 kB/s | 150 kB 00:00 2026-02-26T02:38:56.636 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-26T02:38:56.640 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-26T02:38:56.645 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-26T02:38:56.656 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-26T02:38:56.658 INFO:teuthology.orchestra.run.trial130.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-26T02:38:56.665 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-26T02:38:56.671 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-26T02:38:56.690 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-26T02:38:56.699 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-26T02:38:56.731 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-26T02:38:56.751 INFO:teuthology.orchestra.run.trial093.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 172 kB/s | 126 kB 00:00 2026-02-26T02:38:56.752 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-26T02:38:56.765 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-26T02:38:56.780 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-26T02:38:56.784 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-26T02:38:56.792 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-26T02:38:56.832 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-26T02:38:56.840 INFO:teuthology.orchestra.run.trial093.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 281 kB/s | 218 kB 00:00 2026-02-26T02:38:56.989 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:38:57.025 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:38:57.025 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:38:57.101 INFO:teuthology.orchestra.run.trial093.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 113 kB/s | 30 kB 00:00 2026-02-26T02:38:57.151 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-26T02:38:57.161 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-26T02:38:57.165 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-26T02:38:57.171 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-26T02:38:57.173 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-26T02:38:57.200 INFO:teuthology.orchestra.run.trial192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-26T02:38:57.243 INFO:teuthology.orchestra.run.trial192.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-26T02:38:57.249 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-26T02:38:57.253 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-26T02:38:57.259 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-26T02:38:57.262 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-26T02:38:57.269 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-26T02:38:57.273 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-26T02:38:57.300 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-26T02:38:57.310 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-26T02:38:57.344 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-26T02:38:57.393 INFO:teuthology.orchestra.run.trial093.stdout:(29/99): unzip-6.0-59.el9.x86_64.rpm 240 kB/s | 182 kB 00:00 2026-02-26T02:38:57.402 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-26T02:38:57.419 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-26T02:38:57.429 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-26T02:38:57.435 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-26T02:38:57.443 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:38:57.444 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:38:57.449 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-26T02:38:57.464 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-26T02:38:57.539 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-26T02:38:57.548 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-26T02:38:57.565 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-26T02:38:57.571 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-26T02:38:57.572 INFO:teuthology.orchestra.run.trial093.stdout:(30/99): zip-3.0-35.el9.x86_64.rpm 323 kB/s | 266 kB 00:00 2026-02-26T02:38:57.589 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-26T02:38:57.593 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-26T02:38:57.601 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-26T02:38:57.624 INFO:teuthology.orchestra.run.trial093.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 64 kB/s | 15 kB 00:00 2026-02-26T02:38:57.651 INFO:teuthology.orchestra.run.trial192.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-26T02:38:57.651 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-26T02:38:57.652 INFO:teuthology.orchestra.run.trial192.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-26T02:38:57.657 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-26T02:38:57.661 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-26T02:38:57.662 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-26T02:38:57.673 INFO:teuthology.orchestra.run.trial192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-26T02:38:57.680 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:38:57.680 INFO:teuthology.orchestra.run.trial130.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-26T02:38:57.680 INFO:teuthology.orchestra.run.trial130.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-26T02:38:57.680 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:57.688 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:38:57.700 INFO:teuthology.orchestra.run.trial093.stdout:(32/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 5.0 MB/s | 3.0 MB 00:00 2026-02-26T02:38:57.713 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:38:57.713 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-26T02:38:57.713 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:57.749 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-26T02:38:57.779 INFO:teuthology.orchestra.run.trial093.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 538 kB/s | 42 kB 00:00 2026-02-26T02:38:57.813 INFO:teuthology.orchestra.run.trial130.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-26T02:38:57.815 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:38:57.828 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:38:57.829 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:57.829 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-26T02:38:57.829 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:57.897 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:38:57.900 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-26T02:38:57.931 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-26T02:38:57.936 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-26T02:38:57.948 INFO:teuthology.orchestra.run.trial093.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 581 kB/s | 188 kB 00:00 2026-02-26T02:38:57.957 INFO:teuthology.orchestra.run.trial161.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-26T02:38:57.963 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/99 2026-02-26T02:38:57.984 INFO:teuthology.orchestra.run.trial093.stdout:(35/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 26 MB/s | 5.3 MB 00:00 2026-02-26T02:38:57.994 INFO:teuthology.orchestra.run.trial192.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-26T02:38:57.996 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-26T02:38:58.005 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-26T02:38:58.010 INFO:teuthology.orchestra.run.trial161.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-26T02:38:58.013 INFO:teuthology.orchestra.run.trial161.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-26T02:38:58.017 INFO:teuthology.orchestra.run.trial161.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-26T02:38:58.040 INFO:teuthology.orchestra.run.trial161.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-26T02:38:58.053 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-26T02:38:58.056 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-26T02:38:58.062 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-26T02:38:58.064 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-26T02:38:58.066 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-26T02:38:58.073 INFO:teuthology.orchestra.run.trial093.stdout:(36/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 493 kB/s | 246 kB 00:00 2026-02-26T02:38:58.075 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-26T02:38:58.081 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-26T02:38:58.105 INFO:teuthology.orchestra.run.trial161.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-26T02:38:58.108 INFO:teuthology.orchestra.run.trial161.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-26T02:38:58.115 INFO:teuthology.orchestra.run.trial161.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-26T02:38:58.140 INFO:teuthology.orchestra.run.trial161.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-26T02:38:58.175 INFO:teuthology.orchestra.run.trial093.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2026-02-26T02:38:58.191 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-26T02:38:58.204 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 23/99 2026-02-26T02:38:58.207 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-26T02:38:58.208 INFO:teuthology.orchestra.run.trial093.stdout:(38/99): python3-devel-3.9.25-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2026-02-26T02:38:58.211 INFO:teuthology.orchestra.run.trial161.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-26T02:38:58.216 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-26T02:38:58.221 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-26T02:38:58.224 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-26T02:38:58.238 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-26T02:38:58.242 INFO:teuthology.orchestra.run.trial093.stdout:(39/99): protobuf-3.14.0-17.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2026-02-26T02:38:58.256 INFO:teuthology.orchestra.run.trial093.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 3.0 MB/s | 249 kB 00:00 2026-02-26T02:38:58.260 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-26T02:38:58.264 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-26T02:38:58.269 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-26T02:38:58.281 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-26T02:38:58.290 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-26T02:38:58.296 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-26T02:38:58.315 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-26T02:38:58.319 INFO:teuthology.orchestra.run.trial093.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 1.6 MB/s | 177 kB 00:00 2026-02-26T02:38:58.324 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-26T02:38:58.336 INFO:teuthology.orchestra.run.trial093.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 172 kB 00:00 2026-02-26T02:38:58.379 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-26T02:38:58.391 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-26T02:38:58.402 INFO:teuthology.orchestra.run.trial093.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 7.7 MB/s | 1.2 MB 00:00 2026-02-26T02:38:58.404 INFO:teuthology.orchestra.run.trial093.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 411 kB/s | 35 kB 00:00 2026-02-26T02:38:58.406 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-26T02:38:58.411 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-26T02:38:58.419 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-26T02:38:58.459 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-26T02:38:58.490 INFO:teuthology.orchestra.run.trial093.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.9 MB/s | 442 kB 00:00 2026-02-26T02:38:58.496 INFO:teuthology.orchestra.run.trial093.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 834 kB/s | 77 kB 00:00 2026-02-26T02:38:58.523 INFO:teuthology.orchestra.run.trial093.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 33 MB/s | 6.1 MB 00:00 2026-02-26T02:38:58.526 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:38:58.552 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:38:58.552 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:58.552 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-26T02:38:58.552 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:38:58.552 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:38:58.552 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:58.604 INFO:teuthology.orchestra.run.trial093.stdout:(48/99): python3-pyasn1-modules-0.4.8-7.el9.noa 3.3 MB/s | 277 kB 00:00 2026-02-26T02:38:58.605 INFO:teuthology.orchestra.run.trial093.stdout:(49/99): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.4 MB/s | 157 kB 00:00 2026-02-26T02:38:58.606 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:38:58.607 INFO:teuthology.orchestra.run.trial130.stdout: Installing : cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:38:58.613 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 88/99 2026-02-26T02:38:58.632 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 89/99 2026-02-26T02:38:58.633 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:38:58.650 INFO:teuthology.orchestra.run.trial093.stdout:(50/99): python3-protobuf-3.14.0-17.el9.noarch. 1.6 MB/s | 267 kB 00:00 2026-02-26T02:38:58.683 INFO:teuthology.orchestra.run.trial093.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 676 kB/s | 54 kB 00:00 2026-02-26T02:38:58.729 INFO:teuthology.orchestra.run.trial093.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 528 kB/s | 42 kB 00:00 2026-02-26T02:38:58.730 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-26T02:38:58.747 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-26T02:38:58.757 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-26T02:38:58.763 INFO:teuthology.orchestra.run.trial093.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.3 MB/s | 189 kB 00:00 2026-02-26T02:38:58.764 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-26T02:38:58.777 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-26T02:38:58.784 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-26T02:38:58.792 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-26T02:38:58.794 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-26T02:38:58.798 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-26T02:38:58.804 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-26T02:38:58.806 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-26T02:38:58.808 INFO:teuthology.orchestra.run.trial093.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-26T02:38:58.833 INFO:teuthology.orchestra.run.trial161.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-26T02:38:58.839 INFO:teuthology.orchestra.run.trial093.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 293 kB/s | 22 kB 00:00 2026-02-26T02:38:58.866 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-26T02:38:58.875 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-26T02:38:58.876 INFO:teuthology.orchestra.run.trial161.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-26T02:38:58.883 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-26T02:38:58.887 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-26T02:38:58.892 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-26T02:38:58.896 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-26T02:38:58.898 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-26T02:38:58.903 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-26T02:38:58.907 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-26T02:38:58.927 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-26T02:38:58.935 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-26T02:38:58.946 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-26T02:38:58.977 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-26T02:38:58.981 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-26T02:38:58.983 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-26T02:38:58.986 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-26T02:38:58.987 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-26T02:38:59.006 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:38:59.006 INFO:teuthology.orchestra.run.trial192.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-26T02:38:59.006 INFO:teuthology.orchestra.run.trial192.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-26T02:38:59.007 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:59.009 INFO:teuthology.orchestra.run.trial093.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 4.2 MB/s | 862 kB 00:00 2026-02-26T02:38:59.014 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:38:59.040 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:38:59.040 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-26T02:38:59.040 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:59.077 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-26T02:38:59.110 INFO:teuthology.orchestra.run.trial093.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 192 kB/s | 19 kB 00:00 2026-02-26T02:38:59.128 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:38:59.131 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:38:59.140 INFO:teuthology.orchestra.run.trial192.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-26T02:38:59.142 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:38:59.157 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:38:59.157 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:59.157 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-26T02:38:59.157 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:59.168 INFO:teuthology.orchestra.run.trial093.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2026-02-26T02:38:59.206 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-26T02:38:59.230 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-26T02:38:59.234 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-26T02:38:59.280 INFO:teuthology.orchestra.run.trial093.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.2 MB/s | 551 kB 00:00 2026-02-26T02:38:59.283 INFO:teuthology.orchestra.run.trial093.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 4.6 MB/s | 548 kB 00:00 2026-02-26T02:38:59.292 INFO:teuthology.orchestra.run.trial161.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-26T02:38:59.294 INFO:teuthology.orchestra.run.trial161.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-26T02:38:59.301 INFO:teuthology.orchestra.run.trial093.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 1.4 MB/s | 29 kB 00:00 2026-02-26T02:38:59.303 INFO:teuthology.orchestra.run.trial093.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 2.9 MB/s | 60 kB 00:00 2026-02-26T02:38:59.315 INFO:teuthology.orchestra.run.trial161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-26T02:38:59.323 INFO:teuthology.orchestra.run.trial093.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 1.6 MB/s | 32 kB 00:00 2026-02-26T02:38:59.339 INFO:teuthology.orchestra.run.trial093.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-26T02:38:59.343 INFO:teuthology.orchestra.run.trial093.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 716 kB/s | 14 kB 00:00 2026-02-26T02:38:59.421 INFO:teuthology.orchestra.run.trial093.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.5 MB/s | 358 kB 00:00 2026-02-26T02:38:59.435 INFO:teuthology.orchestra.run.trial093.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 1.8 MB/s | 173 kB 00:00 2026-02-26T02:38:59.471 INFO:teuthology.orchestra.run.trial093.stdout:(68/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 22 MB/s | 19 MB 00:00 2026-02-26T02:38:59.510 INFO:teuthology.orchestra.run.trial093.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 2.8 MB/s | 254 kB 00:00 2026-02-26T02:38:59.549 INFO:teuthology.orchestra.run.trial093.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 3.5 MB/s | 139 kB 00:00 2026-02-26T02:38:59.569 INFO:teuthology.orchestra.run.trial093.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 2.7 MB/s | 56 kB 00:00 2026-02-26T02:38:59.590 INFO:teuthology.orchestra.run.trial093.stdout:(72/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 532 kB/s | 11 kB 00:00 2026-02-26T02:38:59.592 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:38:59.593 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:38:59.606 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:38:59.606 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:38:59.610 INFO:teuthology.orchestra.run.trial093.stdout:(73/99): python3-jaraco-classes-3.2.1-5.el9.noa 883 kB/s | 18 kB 00:00 2026-02-26T02:38:59.611 INFO:teuthology.orchestra.run.trial093.stdout:(74/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.0 MB/s | 144 kB 00:00 2026-02-26T02:38:59.630 INFO:teuthology.orchestra.run.trial093.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-26T02:38:59.631 INFO:teuthology.orchestra.run.trial093.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 995 kB/s | 20 kB 00:00 2026-02-26T02:38:59.643 INFO:teuthology.orchestra.run.trial161.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-26T02:38:59.650 INFO:teuthology.orchestra.run.trial093.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 985 kB/s | 19 kB 00:00 2026-02-26T02:38:59.651 INFO:teuthology.orchestra.run.trial093.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 1.3 MB/s | 26 kB 00:00 2026-02-26T02:38:59.662 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:38:59.671 INFO:teuthology.orchestra.run.trial093.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 2.3 MB/s | 46 kB 00:00 2026-02-26T02:38:59.710 INFO:teuthology.orchestra.run.trial093.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 2.0 MB/s | 79 kB 00:00 2026-02-26T02:38:59.711 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 94/99 2026-02-26T02:38:59.712 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:38:59.717 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-26T02:38:59.734 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:38:59.734 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:59.734 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-26T02:38:59.734 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:38:59.734 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:38:59.734 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:38:59.745 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:38:59.748 INFO:teuthology.orchestra.run.trial093.stdout:(81/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-26T02:38:59.768 INFO:teuthology.orchestra.run.trial093.stdout:(82/99): python3-natsort-7.1.1-5.el9.noarch.rpm 2.8 MB/s | 58 kB 00:00 2026-02-26T02:38:59.846 INFO:teuthology.orchestra.run.trial093.stdout:(83/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2026-02-26T02:38:59.854 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:38:59.866 INFO:teuthology.orchestra.run.trial093.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 828 kB/s | 16 kB 00:00 2026-02-26T02:38:59.880 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:38:59.880 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:59.880 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-26T02:38:59.880 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:38:59.880 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:38:59.880 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:38:59.881 INFO:teuthology.orchestra.run.trial093.stdout:(85/99): python3-kubernetes-26.1.0-3.el9.noarch 4.4 MB/s | 1.0 MB 00:00 2026-02-26T02:38:59.900 INFO:teuthology.orchestra.run.trial093.stdout:(86/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-26T02:38:59.904 INFO:teuthology.orchestra.run.trial093.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.3 MB/s | 90 kB 00:00 2026-02-26T02:38:59.924 INFO:teuthology.orchestra.run.trial093.stdout:(88/99): python3-rsa-4.9-2.el9.noarch.rpm 2.9 MB/s | 59 kB 00:00 2026-02-26T02:38:59.937 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:38:59.939 INFO:teuthology.orchestra.run.trial192.stdout: Installing : cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:38:59.944 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 88/99 2026-02-26T02:38:59.958 INFO:teuthology.orchestra.run.trial093.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 3.2 MB/s | 188 kB 00:00 2026-02-26T02:38:59.959 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:38:59.961 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:38:59.963 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 89/99 2026-02-26T02:38:59.964 INFO:teuthology.orchestra.run.trial093.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 3.1 MB/s | 125 kB 00:00 2026-02-26T02:38:59.965 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:38:59.977 INFO:teuthology.orchestra.run.trial093.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.8 MB/s | 36 kB 00:00 2026-02-26T02:38:59.982 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:38:59.982 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:38:59.982 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-26T02:38:59.982 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:38:59.982 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:38:59.983 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:00.003 INFO:teuthology.orchestra.run.trial093.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 2.2 MB/s | 86 kB 00:00 2026-02-26T02:39:00.036 INFO:teuthology.orchestra.run.trial093.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2026-02-26T02:39:00.041 INFO:teuthology.orchestra.run.trial093.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2026-02-26T02:39:00.062 INFO:teuthology.orchestra.run.trial093.stdout:(95/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.4 MB/s | 48 kB 00:00 2026-02-26T02:39:00.082 INFO:teuthology.orchestra.run.trial093.stdout:(96/99): python3-xmltodict-0.12.0-15.el9.noarch 1.1 MB/s | 22 kB 00:00 2026-02-26T02:39:00.083 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:00.100 INFO:teuthology.orchestra.run.trial093.stdout:(97/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.1 MB/s | 2.0 MB 00:00 2026-02-26T02:39:00.102 INFO:teuthology.orchestra.run.trial093.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 981 kB/s | 20 kB 00:00 2026-02-26T02:39:00.104 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:00.104 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:00.104 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-26T02:39:00.104 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:00.104 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:00.104 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:00.123 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:00.152 INFO:teuthology.orchestra.run.trial093.stdout:(99/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2026-02-26T02:39:00.156 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:00.156 INFO:teuthology.orchestra.run.trial093.stdout:Total 6.9 MB/s | 95 MB 00:13 2026-02-26T02:39:00.393 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-26T02:39:00.409 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-26T02:39:00.419 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-26T02:39:00.426 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-26T02:39:00.439 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-26T02:39:00.453 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:39:00.455 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-26T02:39:00.456 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:39:00.531 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-26T02:39:00.540 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-26T02:39:00.563 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-26T02:39:00.593 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-26T02:39:00.596 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:00.636 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:00.636 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:00.644 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-26T02:39:00.650 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-26T02:39:00.653 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-26T02:39:00.655 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-26T02:39:00.673 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:39:00.673 INFO:teuthology.orchestra.run.trial161.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-26T02:39:00.674 INFO:teuthology.orchestra.run.trial161.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-26T02:39:00.674 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:00.682 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:39:00.707 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:39:00.707 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-26T02:39:00.707 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:00.744 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-26T02:39:00.783 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:00.783 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-2:19.2.3-687.g8d724284.el9.x86_64 1/99 2026-02-26T02:39:00.783 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2/99 2026-02-26T02:39:00.783 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 3/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 4/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 5/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 6/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 7/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 8/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 9/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 10/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 11/99 2026-02-26T02:39:00.784 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 12/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 13/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 14/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : cephadm-2:19.2.3-687.g8d724284.el9.noarch 15/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-26T02:39:00.785 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-26T02:39:00.786 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/99 2026-02-26T02:39:00.787 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-26T02:39:00.788 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-26T02:39:00.789 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-26T02:39:00.790 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-26T02:39:00.791 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-26T02:39:00.807 INFO:teuthology.orchestra.run.trial161.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-26T02:39:00.809 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:39:00.824 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:39:00.824 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:00.824 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-26T02:39:00.824 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:00.852 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: ceph-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.853 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-26T02:39:00.854 INFO:teuthology.orchestra.run.trial130.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: lua-5.4.4-4.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-26T02:39:00.855 INFO:teuthology.orchestra.run.trial130.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-26T02:39:00.856 INFO:teuthology.orchestra.run.trial130.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-26T02:39:00.857 INFO:teuthology.orchestra.run.trial130.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-26T02:39:00.858 INFO:teuthology.orchestra.run.trial130.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-ply-3.11-14.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-26T02:39:00.859 INFO:teuthology.orchestra.run.trial130.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-26T02:39:00.860 INFO:teuthology.orchestra.run.trial130.stdout: unzip-6.0-59.el9.x86_64 2026-02-26T02:39:00.861 INFO:teuthology.orchestra.run.trial130.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-26T02:39:00.861 INFO:teuthology.orchestra.run.trial130.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-26T02:39:00.861 INFO:teuthology.orchestra.run.trial130.stdout: zip-3.0-35.el9.x86_64 2026-02-26T02:39:00.861 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:00.861 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:00.910 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-base 2026-02-26T02:39:00.913 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:39:00.914 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:39:00.928 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:39:00.928 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:39:00.984 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:39:01.033 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 94/99 2026-02-26T02:39:01.034 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:39:01.055 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:39:01.056 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:01.056 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-26T02:39:01.056 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:39:01.056 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:39:01.056 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:01.058 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:01.058 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:01.067 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:39:01.229 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:49 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:01.283 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:39:01.285 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:39:01.294 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:01.306 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:39:01.306 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:01.306 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-26T02:39:01.307 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:39:01.307 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:39:01.307 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:01.313 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:01.313 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:01.313 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:01.335 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install cephadm 2026-02-26T02:39:01.407 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:01.429 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:01.429 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:01.430 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-26T02:39:01.430 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:01.430 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:01.430 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:01.448 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:01.519 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:01.521 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-26T02:39:01.552 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-26T02:39:01.554 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:39:01.557 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-26T02:39:01.578 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-26T02:39:01.579 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:39:01.579 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:01.580 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-26T02:39:01.580 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:39:01.580 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:39:01.580 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:01.584 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 5/99 2026-02-26T02:39:01.617 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-26T02:39:01.627 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-26T02:39:01.632 INFO:teuthology.orchestra.run.trial093.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-26T02:39:01.634 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-26T02:39:01.636 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:39:01.638 INFO:teuthology.orchestra.run.trial161.stdout: Installing : cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:39:01.639 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-26T02:39:01.643 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 88/99 2026-02-26T02:39:01.652 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:49 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:01.662 INFO:teuthology.orchestra.run.trial093.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-26T02:39:01.663 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 89/99 2026-02-26T02:39:01.664 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:39:01.675 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-26T02:39:01.678 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-26T02:39:01.684 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-26T02:39:01.686 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-26T02:39:01.697 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-26T02:39:01.703 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-26T02:39:01.718 INFO:teuthology.orchestra.run.trial130.stdout:Package cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:01.727 INFO:teuthology.orchestra.run.trial093.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-26T02:39:01.730 INFO:teuthology.orchestra.run.trial093.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-26T02:39:01.737 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:01.737 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:01.737 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:01.738 INFO:teuthology.orchestra.run.trial093.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-26T02:39:01.760 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T02:39:01.762 INFO:teuthology.orchestra.run.trial093.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-26T02:39:01.814 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-26T02:39:01.827 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 23/99 2026-02-26T02:39:01.829 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-26T02:39:01.833 INFO:teuthology.orchestra.run.trial093.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-26T02:39:01.839 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-26T02:39:01.843 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-26T02:39:01.847 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-26T02:39:01.861 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-26T02:39:01.882 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-26T02:39:01.887 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-26T02:39:01.892 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-26T02:39:01.903 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-26T02:39:01.912 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-26T02:39:01.919 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-26T02:39:01.938 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-26T02:39:01.947 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-26T02:39:02.002 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-26T02:39:02.014 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-26T02:39:02.030 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-26T02:39:02.034 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-26T02:39:02.042 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-26T02:39:02.076 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:50 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:02.082 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-26T02:39:02.138 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:02.139 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-2:19.2.3-687.g8d724284.el9.x86_64 1/99 2026-02-26T02:39:02.139 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2/99 2026-02-26T02:39:02.139 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 3/99 2026-02-26T02:39:02.139 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 4/99 2026-02-26T02:39:02.139 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 5/99 2026-02-26T02:39:02.139 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 6/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 7/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 8/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 9/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 10/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 11/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 12/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 13/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 14/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : cephadm-2:19.2.3-687.g8d724284.el9.noarch 15/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-26T02:39:02.140 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-26T02:39:02.141 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-26T02:39:02.142 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-26T02:39:02.143 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-26T02:39:02.144 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-26T02:39:02.145 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-26T02:39:02.146 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-26T02:39:02.147 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-26T02:39:02.147 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-26T02:39:02.147 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-26T02:39:02.147 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-26T02:39:02.147 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-26T02:39:02.155 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:39:02.158 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:39:02.162 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-687.g8d724284.el9 ceph 145 k 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 145 k 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 431 k 2026-02-26T02:39:02.163 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:02.205 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-26T02:39:02.205 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: lua-5.4.4-4.el9.x86_64 2026-02-26T02:39:02.206 INFO:teuthology.orchestra.run.trial192.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-26T02:39:02.207 INFO:teuthology.orchestra.run.trial192.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-ply-3.11-14.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-26T02:39:02.208 INFO:teuthology.orchestra.run.trial192.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: unzip-6.0-59.el9.x86_64 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: zip-3.0-35.el9.x86_64 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:02.209 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:02.262 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-base 2026-02-26T02:39:02.410 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-26T02:39:02.419 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-26T02:39:02.423 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-26T02:39:02.429 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-26T02:39:02.431 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-26T02:39:02.458 INFO:teuthology.orchestra.run.trial093.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-26T02:39:02.503 INFO:teuthology.orchestra.run.trial093.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-26T02:39:02.509 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-26T02:39:02.512 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-26T02:39:02.518 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-26T02:39:02.522 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-26T02:39:02.529 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-26T02:39:02.533 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-26T02:39:02.561 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-26T02:39:02.571 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-26T02:39:02.571 INFO:teuthology.orchestra.run.trial130.stdout:ceph-immutable-object-cache-19.2.3-687.g8d72428 357 kB/s | 145 kB 00:00 2026-02-26T02:39:02.572 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:02.572 INFO:teuthology.orchestra.run.trial130.stdout:Total 356 kB/s | 145 kB 00:00 2026-02-26T02:39:02.572 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:02.575 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:02.576 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:02.580 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:49 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:02.606 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-26T02:39:02.608 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:02.608 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:02.626 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:39:02.627 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:39:02.638 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:39:02.639 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:39:02.646 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:02.664 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:02.665 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:02.665 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:02.666 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:02.666 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:02.686 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install cephadm 2026-02-26T02:39:02.687 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:02.687 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:02.687 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-26T02:39:02.687 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:02.696 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:39:02.746 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 94/99 2026-02-26T02:39:02.747 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:39:02.769 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:39:02.769 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:02.769 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-26T02:39:02.770 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:39:02.770 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:39:02.770 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:02.782 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:39:02.832 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-26T02:39:02.856 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-26T02:39:02.860 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-26T02:39:02.919 INFO:teuthology.orchestra.run.trial093.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-26T02:39:02.921 INFO:teuthology.orchestra.run.trial093.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-26T02:39:02.942 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-26T02:39:03.004 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:50 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:03.010 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:39:03.011 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:39:03.024 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:03.024 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:03.024 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:03.024 INFO:teuthology.orchestra.run.trial130.stdout: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:03.024 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:03.024 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:03.033 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:39:03.033 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:03.034 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-26T02:39:03.034 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:39:03.034 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:39:03.034 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:03.052 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mgr 2026-02-26T02:39:03.070 INFO:teuthology.orchestra.run.trial192.stdout:Package cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:03.089 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:03.090 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:03.090 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:03.110 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T02:39:03.141 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:03.162 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:03.162 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:03.162 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-26T02:39:03.162 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:03.162 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:03.162 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:03.181 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:03.271 INFO:teuthology.orchestra.run.trial093.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-26T02:39:03.344 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-26T02:39:03.373 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:51 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:03.423 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:50 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:03.438 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:03.458 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:03.458 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:03.458 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:03.480 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T02:39:03.508 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:03.508 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:03.508 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:39:03.508 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:03.508 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:03.508 INFO:teuthology.orchestra.run.trial192.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-687.g8d724284.el9 ceph 145 k 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 145 k 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 431 k 2026-02-26T02:39:03.509 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:03.800 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:51 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:03.838 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-2:19.2.3-687.g8d724284.el9.x86_64 1/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 3/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 4/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 5/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 6/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 7/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 8/99 2026-02-26T02:39:03.839 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 9/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 10/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 11/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 12/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 13/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 14/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : cephadm-2:19.2.3-687.g8d724284.el9.noarch 15/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-26T02:39:03.840 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-26T02:39:03.841 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-26T02:39:03.842 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-26T02:39:03.843 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-26T02:39:03.844 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-26T02:39:03.845 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-26T02:39:03.846 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-26T02:39:03.867 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:03.885 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:03.886 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:03.886 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:03.906 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: ceph-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.907 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-26T02:39:03.908 INFO:teuthology.orchestra.run.trial161.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: lua-5.4.4-4.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-26T02:39:03.909 INFO:teuthology.orchestra.run.trial161.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-26T02:39:03.910 INFO:teuthology.orchestra.run.trial161.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-26T02:39:03.911 INFO:teuthology.orchestra.run.trial161.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-ply-3.11-14.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-26T02:39:03.912 INFO:teuthology.orchestra.run.trial161.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: unzip-6.0-59.el9.x86_64 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: zip-3.0-35.el9.x86_64 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:03.913 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:03.914 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T02:39:03.963 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-base 2026-02-26T02:39:03.965 INFO:teuthology.orchestra.run.trial192.stdout:ceph-immutable-object-cache-19.2.3-687.g8d72428 318 kB/s | 145 kB 00:00 2026-02-26T02:39:03.966 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:03.966 INFO:teuthology.orchestra.run.trial192.stdout:Total 317 kB/s | 145 kB 00:00 2026-02-26T02:39:03.966 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:03.970 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:03.970 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:04.002 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:04.003 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:04.021 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-26T02:39:04.039 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-26T02:39:04.049 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-26T02:39:04.055 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-26T02:39:04.058 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:04.059 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:04.069 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-26T02:39:04.081 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:04.081 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:04.081 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-26T02:39:04.081 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:04.085 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-26T02:39:04.161 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-26T02:39:04.170 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-26T02:39:04.193 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-26T02:39:04.223 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-26T02:39:04.226 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:04.274 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-26T02:39:04.280 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:04.280 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-26T02:39:04.283 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-26T02:39:04.284 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-26T02:39:04.291 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:04.304 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:39:04.304 INFO:teuthology.orchestra.run.trial093.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-26T02:39:04.304 INFO:teuthology.orchestra.run.trial093.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-26T02:39:04.304 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:04.310 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:04.310 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:04.310 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:04.311 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:39:04.332 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mgr-rook 2026-02-26T02:39:04.339 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-26T02:39:04.339 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-26T02:39:04.339 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:04.345 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:04.364 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:04.364 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:04.365 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:04.378 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-26T02:39:04.385 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install cephadm 2026-02-26T02:39:04.404 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:04.404 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:04.404 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:04.404 INFO:teuthology.orchestra.run.trial192.stdout: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:04.405 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:04.405 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:04.432 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mgr 2026-02-26T02:39:04.442 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-26T02:39:04.445 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:39:04.460 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 85/99 2026-02-26T02:39:04.460 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:04.460 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-26T02:39:04.460 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:04.650 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:04.700 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:04.716 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:04.735 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:04.736 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:04.736 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:04.748 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:51 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:04.757 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T02:39:04.766 INFO:teuthology.orchestra.run.trial161.stdout:Package cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:04.785 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:04.785 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:04.785 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:04.807 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T02:39:04.814 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:04.833 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:04.835 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:04.835 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:04.854 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T02:39:05.071 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:05.121 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:05.136 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:05.154 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:05.155 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:05.155 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:05.160 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:39:05.176 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:05.177 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-fuse 2026-02-26T02:39:05.186 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 86/99 2026-02-26T02:39:05.186 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:05.186 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-26T02:39:05.186 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:39:05.186 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-26T02:39:05.186 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-687.g8d724284.el9 ceph 145 k 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:05.207 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 145 k 2026-02-26T02:39:05.208 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 431 k 2026-02-26T02:39:05.208 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:05.243 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:05.244 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:39:05.246 INFO:teuthology.orchestra.run.trial093.stdout: Installing : cephadm-2:19.2.3-687.g8d724284.el9.noarch 87/99 2026-02-26T02:39:05.251 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 88/99 2026-02-26T02:39:05.261 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:05.262 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:05.262 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:05.271 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 89/99 2026-02-26T02:39:05.272 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:39:05.284 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T02:39:05.488 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:05.504 INFO:teuthology.orchestra.run.trial161.stdout:ceph-immutable-object-cache-19.2.3-687.g8d72428 492 kB/s | 145 kB 00:00 2026-02-26T02:39:05.504 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:05.505 INFO:teuthology.orchestra.run.trial161.stdout:Total 490 kB/s | 145 kB 00:00 2026-02-26T02:39:05.505 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:05.509 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:05.509 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:05.541 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:05.541 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:05.572 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:05.573 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:05.573 INFO:teuthology.orchestra.run.trial130.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:05.573 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout: ceph-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.2 M 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 1.2 M 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 3.6 M 2026-02-26T02:39:05.574 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:05.597 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:05.598 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:05.602 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:05.621 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:05.622 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:05.622 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-26T02:39:05.622 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:05.668 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:05.686 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:05.687 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:05.687 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:05.708 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mgr-rook 2026-02-26T02:39:05.765 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 90/99 2026-02-26T02:39:05.768 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:39:05.927 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:05.927 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:05.927 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:05.927 INFO:teuthology.orchestra.run.trial161.stdout: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:05.927 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:05.927 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:05.956 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mgr 2026-02-26T02:39:06.009 INFO:teuthology.orchestra.run.trial130.stdout:ceph-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 2.6 MB/s | 1.2 MB 00:00 2026-02-26T02:39:06.010 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:06.010 INFO:teuthology.orchestra.run.trial130.stdout:Total 2.6 MB/s | 1.2 MB 00:00 2026-02-26T02:39:06.010 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:06.014 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:06.014 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:06.026 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:06.048 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:06.049 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:06.092 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:06.111 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:06.111 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:06.112 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:06.133 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T02:39:06.151 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:06.169 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:06.222 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 91/99 2026-02-26T02:39:06.223 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:39:06.236 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 92/99 2026-02-26T02:39:06.237 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:39:06.279 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:54 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:06.294 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 93/99 2026-02-26T02:39:06.343 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 94/99 2026-02-26T02:39:06.344 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:39:06.344 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:06.363 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:06.363 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:06.363 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:06.366 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 95/99 2026-02-26T02:39:06.366 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:06.366 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-26T02:39:06.366 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:39:06.366 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-26T02:39:06.367 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:06.380 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:39:06.386 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T02:39:06.416 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:06.448 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:06.484 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:06.485 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:06.485 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:06.485 INFO:teuthology.orchestra.run.trial130.stdout: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:06.485 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:06.485 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:06.512 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-volume 2026-02-26T02:39:06.514 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:06.531 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:06.531 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:06.531 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:06.553 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-fuse 2026-02-26T02:39:06.599 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 96/99 2026-02-26T02:39:06.600 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:39:06.621 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 97/99 2026-02-26T02:39:06.622 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:06.622 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-26T02:39:06.622 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:39:06.622 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-26T02:39:06.622 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:06.705 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:54 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:06.724 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:06.747 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 98/99 2026-02-26T02:39:06.747 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:06.747 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-26T02:39:06.748 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:06.748 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-26T02:39:06.748 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:06.768 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:06.771 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:06.790 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:06.791 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:06.791 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:06.812 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T02:39:06.831 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:54 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:06.869 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:06.897 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-volume-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:06.915 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:06.916 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:06.916 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:06.938 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install librados-devel 2026-02-26T02:39:06.952 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:06.953 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:06.953 INFO:teuthology.orchestra.run.trial192.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:06.953 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout: ceph-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.2 M 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 1.2 M 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 3.6 M 2026-02-26T02:39:06.954 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:07.134 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:07.199 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:07.217 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:07.218 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:07.218 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:07.240 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mgr-rook 2026-02-26T02:39:07.261 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout: librados-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 126 k 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:07.347 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:07.348 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:07.348 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:07.348 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:07.348 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 126 k 2026-02-26T02:39:07.348 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 456 k 2026-02-26T02:39:07.348 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:07.429 INFO:teuthology.orchestra.run.trial192.stdout:ceph-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 2.4 MB/s | 1.2 MB 00:00 2026-02-26T02:39:07.429 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:07.430 INFO:teuthology.orchestra.run.trial192.stdout:Total 2.4 MB/s | 1.2 MB 00:00 2026-02-26T02:39:07.430 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:07.434 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:07.434 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:07.468 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:07.468 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:07.486 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-2:19.2.3-687.g8d724284.el9.x86_64 99/99 2026-02-26T02:39:07.486 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-2:19.2.3-687.g8d724284.el9.x86_64 1/99 2026-02-26T02:39:07.486 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2/99 2026-02-26T02:39:07.486 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 3/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 4/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 5/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9 6/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 7/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noar 8/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-687.g8d7242 9/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noar 10/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.n 11/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 12/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9. 13/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 14/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cephadm-2:19.2.3-687.g8d724284.el9.noarch 15/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-26T02:39:07.487 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-26T02:39:07.488 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-26T02:39:07.489 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-26T02:39:07.555 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:07.560 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-26T02:39:07.560 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:07.560 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:07.560 INFO:teuthology.orchestra.run.trial093.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-grafana-dashboards-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-k8sevents-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-modules-core-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.561 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: ceph-prometheus-alerts-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: ceph-volume-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: cephadm-2:19.2.3-687.g8d724284.el9.noarch 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-26T02:39:07.562 INFO:teuthology.orchestra.run.trial093.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: lua-5.4.4-4.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-26T02:39:07.563 INFO:teuthology.orchestra.run.trial093.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-26T02:39:07.564 INFO:teuthology.orchestra.run.trial093.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-26T02:39:07.565 INFO:teuthology.orchestra.run.trial093.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-ply-3.11-14.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-26T02:39:07.566 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-26T02:39:07.567 INFO:teuthology.orchestra.run.trial093.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: unzip-6.0-59.el9.x86_64 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: zip-3.0-35.el9.x86_64 2026-02-26T02:39:07.568 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:07.569 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:07.569 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:07.586 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:07.616 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-base 2026-02-26T02:39:07.619 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:07.638 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:07.639 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:07.639 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:07.656 INFO:teuthology.orchestra.run.trial130.stdout:librados-devel-19.2.3-687.g8d724284.el9.x86_64. 409 kB/s | 126 kB 00:00 2026-02-26T02:39:07.656 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:07.656 INFO:teuthology.orchestra.run.trial130.stdout:Total 408 kB/s | 126 kB 00:00 2026-02-26T02:39:07.656 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:07.660 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T02:39:07.661 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:07.661 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:07.690 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:07.691 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:07.746 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:07.764 INFO:teuthology.orchestra.run.trial130.stdout: Installing : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:07.828 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:07.849 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:07.891 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:07.891 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:07.891 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:07.891 INFO:teuthology.orchestra.run.trial192.stdout: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:07.891 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:07.891 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:07.910 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:07.910 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:07.910 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:07.910 INFO:teuthology.orchestra.run.trial130.stdout: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:07.910 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:07.910 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:07.918 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-volume 2026-02-26T02:39:07.935 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:50 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:07.938 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install libcephfs2 2026-02-26T02:39:07.975 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:08.002 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-base-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:08.020 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:08.021 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:08.021 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:08.041 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:08.043 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install cephadm 2026-02-26T02:39:08.060 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:08.060 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:08.060 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:08.082 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-fuse 2026-02-26T02:39:08.241 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:08.258 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:08.306 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-volume-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:08.324 INFO:teuthology.orchestra.run.trial130.stdout:Package libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:08.326 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:08.326 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:08.326 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:08.342 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:08.343 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:08.343 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:08.349 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install librados-devel 2026-02-26T02:39:08.361 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:51 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:08.365 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install libcephfs-devel 2026-02-26T02:39:08.396 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:08.427 INFO:teuthology.orchestra.run.trial093.stdout:Package cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:08.446 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:08.446 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:08.446 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:08.468 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-immutable-object-cache 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout: ceph-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.2 M 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:08.480 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:08.481 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 1.2 M 2026-02-26T02:39:08.481 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 3.6 M 2026-02-26T02:39:08.481 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:08.670 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:08.678 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:08.754 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:08.754 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:08.754 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:39:08.754 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:08.754 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout: librados-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 126 k 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 126 k 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 456 k 2026-02-26T02:39:08.755 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:08.763 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout: libcephfs-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 34 k 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:08.764 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:08.765 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 34 k 2026-02-26T02:39:08.765 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 153 k 2026-02-26T02:39:08.765 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:08.783 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:51 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-687.g8d724284.el9 ceph 145 k 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:08.869 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:08.870 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 145 k 2026-02-26T02:39:08.870 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 431 k 2026-02-26T02:39:08.870 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:08.925 INFO:teuthology.orchestra.run.trial161.stdout:ceph-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 2.6 MB/s | 1.2 MB 00:00 2026-02-26T02:39:08.926 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:08.926 INFO:teuthology.orchestra.run.trial161.stdout:Total 2.6 MB/s | 1.2 MB 00:00 2026-02-26T02:39:08.926 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:08.929 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:08.929 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:08.962 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:08.963 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:09.000 INFO:teuthology.orchestra.run.trial130.stdout:libcephfs-devel-19.2.3-687.g8d724284.el9.x86_64 142 kB/s | 34 kB 00:00 2026-02-26T02:39:09.001 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:09.002 INFO:teuthology.orchestra.run.trial130.stdout:Total 141 kB/s | 34 kB 00:00 2026-02-26T02:39:09.003 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:09.004 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:09.004 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:09.007 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:09.007 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:09.028 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:09.045 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.063 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:09.074 INFO:teuthology.orchestra.run.trial192.stdout:librados-devel-19.2.3-687.g8d724284.el9.x86_64. 396 kB/s | 126 kB 00:00 2026-02-26T02:39:09.074 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:09.074 INFO:teuthology.orchestra.run.trial192.stdout:Total 394 kB/s | 126 kB 00:00 2026-02-26T02:39:09.074 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:09.077 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:09.077 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:09.081 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.106 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.109 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:09.109 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:09.165 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:09.168 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.168 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:09.168 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:09.168 INFO:teuthology.orchestra.run.trial130.stdout: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:09.168 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:09.168 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:09.181 INFO:teuthology.orchestra.run.trial093.stdout:ceph-immutable-object-cache-19.2.3-687.g8d72428 466 kB/s | 145 kB 00:00 2026-02-26T02:39:09.182 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:09.182 INFO:teuthology.orchestra.run.trial093.stdout:Total 465 kB/s | 145 kB 00:00 2026-02-26T02:39:09.182 INFO:teuthology.orchestra.run.trial192.stdout: Installing : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.182 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:09.186 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:09.186 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:09.196 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install librados2 2026-02-26T02:39:09.219 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:09.219 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:09.268 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.274 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:09.276 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:09.299 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:09.299 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:09.299 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-26T02:39:09.299 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:09.311 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.331 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.331 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:09.331 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:09.331 INFO:teuthology.orchestra.run.trial192.stdout: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:09.331 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:09.332 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:09.360 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install libcephfs2 2026-02-26T02:39:09.373 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:09.374 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:09.374 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:09.374 INFO:teuthology.orchestra.run.trial161.stdout: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:09.374 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:09.375 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:09.401 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-volume 2026-02-26T02:39:09.511 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:57 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:09.577 INFO:teuthology.orchestra.run.trial130.stdout:Package librados2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:09.595 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:09.596 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:09.596 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:09.618 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install librbd1 2026-02-26T02:39:09.633 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-687.g8d724284.e 1/1 2026-02-26T02:39:09.634 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:09.634 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:09.634 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:09.634 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:09.634 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:09.662 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mgr 2026-02-26T02:39:09.676 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:09.718 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:57 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:09.741 INFO:teuthology.orchestra.run.trial192.stdout:Package libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:09.759 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:09.760 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:09.760 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:09.781 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install libcephfs-devel 2026-02-26T02:39:09.783 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-volume-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:09.801 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:09.802 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:09.802 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:09.823 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install librados-devel 2026-02-26T02:39:09.934 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:57 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:09.985 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:52 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:10.001 INFO:teuthology.orchestra.run.trial130.stdout:Package librbd1-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:10.020 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:10.021 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:10.021 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:10.043 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-rados 2026-02-26T02:39:10.049 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-mgr-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:10.068 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:10.069 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:10.069 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:10.091 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mgr-dashboard 2026-02-26T02:39:10.101 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:57 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:10.142 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:58 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout: libcephfs-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 34 k 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:10.186 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:10.187 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:10.187 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:10.187 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 34 k 2026-02-26T02:39:10.187 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 153 k 2026-02-26T02:39:10.187 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:10.226 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout: librados-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 126 k 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 126 k 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 456 k 2026-02-26T02:39:10.227 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:10.364 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:58 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:10.408 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:10.430 INFO:teuthology.orchestra.run.trial130.stdout:Package python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:10.449 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:10.449 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:10.450 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:10.472 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-rgw 2026-02-26T02:39:10.474 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-mgr-dashboard-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:10.492 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:10.493 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:10.493 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:10.504 INFO:teuthology.orchestra.run.trial192.stdout:libcephfs-devel-19.2.3-687.g8d724284.el9.x86_64 105 kB/s | 34 kB 00:00 2026-02-26T02:39:10.505 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:10.505 INFO:teuthology.orchestra.run.trial192.stdout:Total 105 kB/s | 34 kB 00:00 2026-02-26T02:39:10.505 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:10.507 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:10.507 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:10.510 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:10.510 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:10.513 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-26T02:39:10.531 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:10.549 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:10.614 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:10.678 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:10.678 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:10.678 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:10.678 INFO:teuthology.orchestra.run.trial192.stdout: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:10.678 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:10.678 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:10.688 INFO:teuthology.orchestra.run.trial161.stdout:librados-devel-19.2.3-687.g8d724284.el9.x86_64. 275 kB/s | 126 kB 00:00 2026-02-26T02:39:10.689 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:10.690 INFO:teuthology.orchestra.run.trial161.stdout:Total 273 kB/s | 126 kB 00:00 2026-02-26T02:39:10.690 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:10.693 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:10.693 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:10.705 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install librados2 2026-02-26T02:39:10.725 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:10.725 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:10.780 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:10.793 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:58 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:10.798 INFO:teuthology.orchestra.run.trial161.stdout: Installing : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:10.832 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:53 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:10.859 INFO:teuthology.orchestra.run.trial130.stdout:Package python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:10.877 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:10.878 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:10.878 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:10.884 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:10.898 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:10.900 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-cephfs 2026-02-26T02:39:10.917 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:10.918 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:10.918 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:10.939 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mgr-rook 2026-02-26T02:39:10.948 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:10.948 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:10.948 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:10.948 INFO:teuthology.orchestra.run.trial161.stdout: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:10.948 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:10.948 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:10.974 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install libcephfs2 2026-02-26T02:39:11.017 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:58 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:11.082 INFO:teuthology.orchestra.run.trial192.stdout:Package librados2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:11.100 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:11.101 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:11.101 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:11.121 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install librbd1 2026-02-26T02:39:11.215 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:11.254 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:54 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:11.281 INFO:teuthology.orchestra.run.trial130.stdout:Package python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:11.296 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:11.299 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:11.300 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:11.300 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:11.320 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-mgr-rook-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:11.322 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-rbd 2026-02-26T02:39:11.339 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:11.340 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:11.340 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:11.360 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mgr-cephadm 2026-02-26T02:39:11.361 INFO:teuthology.orchestra.run.trial161.stdout:Package libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:11.380 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:11.380 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:11.380 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:11.401 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install libcephfs-devel 2026-02-26T02:39:11.438 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:58 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:11.503 INFO:teuthology.orchestra.run.trial192.stdout:Package librbd1-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:11.522 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:11.523 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:11.523 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:11.544 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-rados 2026-02-26T02:39:11.640 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:11.672 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:54 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:11.705 INFO:teuthology.orchestra.run.trial130.stdout:Package python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:11.715 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:11.724 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:11.724 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:39:11.724 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:11.737 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-mgr-cephadm-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:11.746 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install rbd-fuse 2026-02-26T02:39:11.756 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:11.757 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:11.757 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:11.777 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-fuse 2026-02-26T02:39:11.799 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:11.800 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:11.800 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:39:11.800 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:11.800 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:11.800 INFO:teuthology.orchestra.run.trial161.stdout: libcephfs-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 34 k 2026-02-26T02:39:11.800 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:11.801 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:11.801 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:11.801 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:11.801 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:11.801 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 34 k 2026-02-26T02:39:11.801 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 153 k 2026-02-26T02:39:11.801 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:11.859 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:58 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:11.924 INFO:teuthology.orchestra.run.trial192.stdout:Package python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:11.943 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:11.943 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:11.943 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:11.965 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-rgw 2026-02-26T02:39:11.994 INFO:teuthology.orchestra.run.trial161.stdout:libcephfs-devel-19.2.3-687.g8d724284.el9.x86_64 173 kB/s | 34 kB 00:00 2026-02-26T02:39:11.994 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:11.995 INFO:teuthology.orchestra.run.trial161.stdout:Total 171 kB/s | 34 kB 00:00 2026-02-26T02:39:11.995 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:11.997 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:11.998 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:12.000 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:12.000 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:12.023 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:12.040 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.062 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:12.093 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:55 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:12.100 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.147 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout: rbd-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 85 k 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:12.148 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:12.149 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:12.149 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 85 k 2026-02-26T02:39:12.149 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 227 k 2026-02-26T02:39:12.149 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:12.164 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.164 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:12.164 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:12.164 INFO:teuthology.orchestra.run.trial161.stdout: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:12.164 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:12.165 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:12.177 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.2 M 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:12.178 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:12.179 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 1.2 M 2026-02-26T02:39:12.179 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 3.6 M 2026-02-26T02:39:12.179 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:12.189 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install librados2 2026-02-26T02:39:12.281 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:12.347 INFO:teuthology.orchestra.run.trial192.stdout:Package python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:12.365 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:12.366 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:12.366 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:12.378 INFO:teuthology.orchestra.run.trial130.stdout:rbd-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 370 kB/s | 85 kB 00:00 2026-02-26T02:39:12.378 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:12.378 INFO:teuthology.orchestra.run.trial130.stdout:Total 368 kB/s | 85 kB 00:00 2026-02-26T02:39:12.378 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:12.382 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:12.382 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:12.387 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-cephfs 2026-02-26T02:39:12.413 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:12.413 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:12.465 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:12.484 INFO:teuthology.orchestra.run.trial130.stdout: Installing : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.505 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:12.571 INFO:teuthology.orchestra.run.trial161.stdout:Package librados2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:12.577 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.578 INFO:teuthology.orchestra.run.trial093.stdout:ceph-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 2.9 MB/s | 1.2 MB 00:00 2026-02-26T02:39:12.578 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:12.578 INFO:teuthology.orchestra.run.trial093.stdout:Total 2.9 MB/s | 1.2 MB 00:00 2026-02-26T02:39:12.579 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:12.582 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:12.582 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:12.589 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:12.590 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:12.590 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:12.611 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install librbd1 2026-02-26T02:39:12.616 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:12.616 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:12.641 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.641 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:12.641 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:12.641 INFO:teuthology.orchestra.run.trial130.stdout: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:12.641 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:12.641 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:12.671 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install rbd-mirror 2026-02-26T02:39:12.709 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:12.718 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:12.736 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.775 INFO:teuthology.orchestra.run.trial192.stdout:Package python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:12.794 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:12.794 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:12.795 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:12.817 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-rbd 2026-02-26T02:39:12.928 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:12.956 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:12.989 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:12.992 INFO:teuthology.orchestra.run.trial161.stdout:Package librbd1-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:13.011 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:13.012 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:13.012 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:13.018 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:13.018 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:13.018 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:13.018 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:13.018 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:13.018 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:13.034 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-rados 2026-02-26T02:39:13.047 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-volume 2026-02-26T02:39:13.075 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:13.075 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:13.075 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:39:13.075 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:13.075 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:13.075 INFO:teuthology.orchestra.run.trial130.stdout: rbd-mirror x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.1 M 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 3.1 M 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 13 M 2026-02-26T02:39:13.076 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:13.134 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:13.199 INFO:teuthology.orchestra.run.trial192.stdout:Package python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:13.218 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:13.219 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:39:13.219 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:13.240 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install rbd-fuse 2026-02-26T02:39:13.357 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:01 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:13.364 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:13.424 INFO:teuthology.orchestra.run.trial161.stdout:Package python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:13.430 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-volume-2:19.2.3-687.g8d724284.el9.noarch is already installed. 2026-02-26T02:39:13.443 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:13.443 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:13.443 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:13.448 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:13.449 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:13.449 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:13.465 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-rgw 2026-02-26T02:39:13.470 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install librados-devel 2026-02-26T02:39:13.554 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:13.639 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:13.639 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:13.639 INFO:teuthology.orchestra.run.trial192.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:13.639 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:13.639 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout: rbd-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 85 k 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 85 k 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 227 k 2026-02-26T02:39:13.640 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:13.719 INFO:teuthology.orchestra.run.trial130.stdout:rbd-mirror-19.2.3-687.g8d724284.el9.x86_64.rpm 4.8 MB/s | 3.1 MB 00:00 2026-02-26T02:39:13.719 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:13.719 INFO:teuthology.orchestra.run.trial130.stdout:Total 4.8 MB/s | 3.1 MB 00:00 2026-02-26T02:39:13.719 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:13.723 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:13.723 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:13.763 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:13.764 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:13.785 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:01 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:13.792 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:56 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:13.850 INFO:teuthology.orchestra.run.trial161.stdout:Package python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:13.868 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:13.869 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:13.869 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:13.877 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 126 k 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 126 k 2026-02-26T02:39:13.878 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 456 k 2026-02-26T02:39:13.879 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:13.890 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-cephfs 2026-02-26T02:39:13.902 INFO:teuthology.orchestra.run.trial192.stdout:rbd-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 324 kB/s | 85 kB 00:00 2026-02-26T02:39:13.902 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:13.902 INFO:teuthology.orchestra.run.trial192.stdout:Total 323 kB/s | 85 kB 00:00 2026-02-26T02:39:13.902 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:13.906 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:13.906 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:13.937 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:13.937 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:13.958 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:13.959 INFO:teuthology.orchestra.run.trial130.stdout: Installing : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:13.981 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:13.982 INFO:teuthology.orchestra.run.trial130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:13.982 INFO:teuthology.orchestra.run.trial130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-26T02:39:13.982 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:13.982 INFO:teuthology.orchestra.run.trial130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:13.982 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:13.988 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:14.006 INFO:teuthology.orchestra.run.trial192.stdout: Installing : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:14.093 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:14.155 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:14.155 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:14.155 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:14.155 INFO:teuthology.orchestra.run.trial192.stdout: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:14.156 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:14.156 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:14.183 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install rbd-mirror 2026-02-26T02:39:14.188 INFO:teuthology.orchestra.run.trial093.stdout:librados-devel-19.2.3-687.g8d724284.el9.x86_64. 410 kB/s | 126 kB 00:00 2026-02-26T02:39:14.188 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:14.188 INFO:teuthology.orchestra.run.trial093.stdout:Total 408 kB/s | 126 kB 00:00 2026-02-26T02:39:14.189 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:14.191 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:14.192 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:14.206 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:02 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:14.223 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:14.223 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:14.272 INFO:teuthology.orchestra.run.trial161.stdout:Package python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:14.277 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:14.290 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:14.291 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:14.291 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:14.295 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:14.303 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:14.303 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:14.304 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:14.304 INFO:teuthology.orchestra.run.trial130.stdout: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:14.304 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:14.304 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:14.313 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-rbd 2026-02-26T02:39:14.331 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install rbd-nbd 2026-02-26T02:39:14.381 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:14.442 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:14.442 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:14.442 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:14.442 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:14.442 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:14.442 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:14.472 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install libcephfs2 2026-02-26T02:39:14.501 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:01:01 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:14.586 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:14.586 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:14.586 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:39:14.586 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:14.586 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:14.586 INFO:teuthology.orchestra.run.trial192.stdout: rbd-mirror x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.1 M 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 3.1 M 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 13 M 2026-02-26T02:39:14.587 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:14.629 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:02 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:14.650 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:01:02 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:14.695 INFO:teuthology.orchestra.run.trial161.stdout:Package python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:14.714 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:14.715 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:39:14.715 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:14.733 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:14.734 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:14.734 INFO:teuthology.orchestra.run.trial130.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:14.734 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:14.734 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout: rbd-nbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 170 k 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 170 k 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 490 k 2026-02-26T02:39:14.735 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:14.736 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install rbd-fuse 2026-02-26T02:39:14.787 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:57 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:14.852 INFO:teuthology.orchestra.run.trial093.stdout:Package libcephfs2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:14.871 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:14.871 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:14.871 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:14.893 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install libcephfs-devel 2026-02-26T02:39:15.051 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:03 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:15.136 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout: rbd-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 85 k 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:15.137 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:15.138 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 85 k 2026-02-26T02:39:15.138 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 227 k 2026-02-26T02:39:15.138 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:15.199 INFO:teuthology.orchestra.run.trial130.stdout:rbd-nbd-19.2.3-687.g8d724284.el9.x86_64.rpm 368 kB/s | 170 kB 00:00 2026-02-26T02:39:15.199 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:15.199 INFO:teuthology.orchestra.run.trial130.stdout:Total 367 kB/s | 170 kB 00:00 2026-02-26T02:39:15.199 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:15.203 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:15.203 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:15.215 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:58 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:15.234 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:15.234 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:15.290 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:15.299 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:15.299 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:15.299 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:39:15.299 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-devel x86_64 2:19.2.3-687.g8d724284.el9 ceph 34 k 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 34 k 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 153 k 2026-02-26T02:39:15.300 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:15.307 INFO:teuthology.orchestra.run.trial130.stdout: Installing : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.399 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.461 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.461 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:15.462 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:15.462 INFO:teuthology.orchestra.run.trial130.stdout: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:15.462 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:15.462 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:15.470 INFO:teuthology.orchestra.run.trial161.stdout:rbd-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 256 kB/s | 85 kB 00:00 2026-02-26T02:39:15.470 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:15.470 INFO:teuthology.orchestra.run.trial161.stdout:Total 255 kB/s | 85 kB 00:00 2026-02-26T02:39:15.470 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:15.473 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:15.473 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:15.491 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:39:15.505 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:15.505 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:15.557 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:15.575 INFO:teuthology.orchestra.run.trial161.stdout: Installing : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.583 INFO:teuthology.orchestra.run.trial093.stdout:libcephfs-devel-19.2.3-687.g8d724284.el9.x86_64 119 kB/s | 34 kB 00:00 2026-02-26T02:39:15.584 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:15.584 INFO:teuthology.orchestra.run.trial093.stdout:Total 118 kB/s | 34 kB 00:00 2026-02-26T02:39:15.584 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:15.586 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:15.586 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:15.588 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:15.588 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:15.609 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:15.626 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.667 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.688 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.731 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.731 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:15.731 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:15.731 INFO:teuthology.orchestra.run.trial161.stdout: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:15.731 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:15.731 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:15.751 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:15.751 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:15.751 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:15.751 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs-devel-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:15.751 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:15.751 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:15.759 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install rbd-mirror 2026-02-26T02:39:15.779 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install librados2 2026-02-26T02:39:15.809 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:01:03 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:15.893 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:15.894 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:15.894 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:39:15.894 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:15.894 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:15.894 INFO:teuthology.orchestra.run.trial130.stdout: ceph-base-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 72 M 2026-02-26T02:39:15.894 INFO:teuthology.orchestra.run.trial130.stdout:Installing dependencies: 2026-02-26T02:39:15.894 INFO:teuthology.orchestra.run.trial130.stdout: ceph-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 24 M 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout:Installing weak dependencies: 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout: ceph-debugsource x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout:Install 3 Packages 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 107 M 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 654 M 2026-02-26T02:39:15.895 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:16.077 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:04 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:16.097 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:16.162 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:16.162 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:16.162 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:39:16.162 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout: rbd-mirror x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.1 M 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 3.1 M 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 13 M 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:16.163 INFO:teuthology.orchestra.run.trial093.stdout:Package librados2-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:16.182 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:16.182 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:16.183 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:16.188 INFO:teuthology.orchestra.run.trial192.stdout:rbd-mirror-19.2.3-687.g8d724284.el9.x86_64.rpm 1.9 MB/s | 3.1 MB 00:01 2026-02-26T02:39:16.189 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:16.189 INFO:teuthology.orchestra.run.trial192.stdout:Total 1.9 MB/s | 3.1 MB 00:01 2026-02-26T02:39:16.189 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:16.193 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:16.193 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:16.204 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install librbd1 2026-02-26T02:39:16.233 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:16.233 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:16.425 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:16.427 INFO:teuthology.orchestra.run.trial192.stdout: Installing : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:16.450 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:16.451 INFO:teuthology.orchestra.run.trial192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:16.451 INFO:teuthology.orchestra.run.trial192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-26T02:39:16.451 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:16.451 INFO:teuthology.orchestra.run.trial192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:16.451 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:16.519 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:16.586 INFO:teuthology.orchestra.run.trial093.stdout:Package librbd1-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:16.605 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:16.606 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:16.606 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:16.628 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-rados 2026-02-26T02:39:16.748 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:16.748 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:16.748 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:16.748 INFO:teuthology.orchestra.run.trial192.stdout: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:16.749 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:16.749 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:16.776 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install rbd-nbd 2026-02-26T02:39:16.944 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:00:59 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:17.009 INFO:teuthology.orchestra.run.trial093.stdout:Package python3-rados-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:17.028 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:17.028 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:17.028 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:17.050 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-rgw 2026-02-26T02:39:17.070 INFO:teuthology.orchestra.run.trial161.stdout:rbd-mirror-19.2.3-687.g8d724284.el9.x86_64.rpm 3.4 MB/s | 3.1 MB 00:00 2026-02-26T02:39:17.071 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:17.071 INFO:teuthology.orchestra.run.trial161.stdout:Total 3.4 MB/s | 3.1 MB 00:00 2026-02-26T02:39:17.071 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:17.075 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:17.075 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:17.091 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:01:04 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:17.116 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:17.116 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout: rbd-nbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 170 k 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:17.174 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:17.175 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 170 k 2026-02-26T02:39:17.175 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 490 k 2026-02-26T02:39:17.175 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:17.312 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:17.313 INFO:teuthology.orchestra.run.trial161.stdout: Installing : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:17.337 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:17.337 INFO:teuthology.orchestra.run.trial161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:17.338 INFO:teuthology.orchestra.run.trial161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-26T02:39:17.338 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:17.338 INFO:teuthology.orchestra.run.trial161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:17.338 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:17.367 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:17.434 INFO:teuthology.orchestra.run.trial093.stdout:Package python3-rgw-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:17.452 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:17.453 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:17.453 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:17.460 INFO:teuthology.orchestra.run.trial192.stdout:rbd-nbd-19.2.3-687.g8d724284.el9.x86_64.rpm 598 kB/s | 170 kB 00:00 2026-02-26T02:39:17.461 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:17.461 INFO:teuthology.orchestra.run.trial192.stdout:Total 596 kB/s | 170 kB 00:00 2026-02-26T02:39:17.461 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:17.465 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:17.465 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:17.475 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-cephfs 2026-02-26T02:39:17.496 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:17.497 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:17.552 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:17.570 INFO:teuthology.orchestra.run.trial192.stdout: Installing : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:17.652 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:17.663 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:17.663 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:17.663 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:17.663 INFO:teuthology.orchestra.run.trial161.stdout: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:17.663 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:17.663 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:17.691 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install rbd-nbd 2026-02-26T02:39:17.716 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:17.716 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:17.716 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:17.716 INFO:teuthology.orchestra.run.trial192.stdout: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:17.716 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:17.716 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:17.747 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:39:17.792 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:00 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:17.858 INFO:teuthology.orchestra.run.trial093.stdout:Package python3-cephfs-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:17.877 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:17.877 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:17.878 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:17.899 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-rbd 2026-02-26T02:39:18.009 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:06 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:18.068 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:01:05 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:18.092 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout: rbd-nbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 170 k 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 170 k 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 490 k 2026-02-26T02:39:18.093 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:18.152 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:18.152 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout: ceph-base-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 72 M 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout:Installing dependencies: 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout: ceph-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 24 M 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout:Installing weak dependencies: 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout: ceph-debugsource x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:18.153 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:18.154 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:18.154 INFO:teuthology.orchestra.run.trial192.stdout:Install 3 Packages 2026-02-26T02:39:18.154 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:18.154 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 107 M 2026-02-26T02:39:18.155 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 654 M 2026-02-26T02:39:18.155 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:18.215 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:01 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:18.281 INFO:teuthology.orchestra.run.trial093.stdout:Package python3-rbd-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:39:18.300 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:18.300 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:39:18.300 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:18.322 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install rbd-fuse 2026-02-26T02:39:18.405 INFO:teuthology.orchestra.run.trial161.stdout:rbd-nbd-19.2.3-687.g8d724284.el9.x86_64.rpm 547 kB/s | 170 kB 00:00 2026-02-26T02:39:18.406 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:18.407 INFO:teuthology.orchestra.run.trial161.stdout:Total 545 kB/s | 170 kB 00:00 2026-02-26T02:39:18.407 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:18.410 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:18.410 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:18.441 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:18.441 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:18.498 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:18.516 INFO:teuthology.orchestra.run.trial161.stdout: Installing : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:18.605 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:18.637 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:01 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:18.667 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:18.667 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:18.667 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:18.667 INFO:teuthology.orchestra.run.trial161.stdout: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:18.667 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:18.667 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:18.685 INFO:teuthology.orchestra.run.trial130.stdout:(1/3): ceph-debugsource-19.2.3-687.g8d724284.el 3.9 MB/s | 11 MB 00:02 2026-02-26T02:39:18.695 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:39:18.722 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse x86_64 2:19.2.3-687.g8d724284.el9 ceph 85 k 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 85 k 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 227 k 2026-02-26T02:39:18.723 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:19.018 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:07 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:19.079 INFO:teuthology.orchestra.run.trial093.stdout:rbd-fuse-19.2.3-687.g8d724284.el9.x86_64.rpm 239 kB/s | 85 kB 00:00 2026-02-26T02:39:19.079 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:19.079 INFO:teuthology.orchestra.run.trial093.stdout:Total 239 kB/s | 85 kB 00:00 2026-02-26T02:39:19.079 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:19.083 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:19.083 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout: ceph-base-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 72 M 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:Installing dependencies: 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout: ceph-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 24 M 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:Installing weak dependencies: 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout: ceph-debugsource x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout:Install 3 Packages 2026-02-26T02:39:19.102 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:19.103 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 107 M 2026-02-26T02:39:19.103 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 654 M 2026-02-26T02:39:19.103 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:19.114 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:19.114 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:19.166 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:19.184 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:19.267 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:19.331 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:19.331 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:19.331 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:19.331 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:19.331 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:19.331 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:19.359 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install rbd-mirror 2026-02-26T02:39:19.556 INFO:teuthology.orchestra.run.trial130.stdout:(2/3): ceph-debuginfo-19.2.3-687.g8d724284.el9. 6.7 MB/s | 24 MB 00:03 2026-02-26T02:39:19.679 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:02 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror x86_64 2:19.2.3-687.g8d724284.el9 ceph 3.1 M 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 3.1 M 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 13 M 2026-02-26T02:39:19.763 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:20.099 INFO:teuthology.orchestra.run.trial192.stdout:(1/3): ceph-debugsource-19.2.3-687.g8d724284.el 5.6 MB/s | 11 MB 00:01 2026-02-26T02:39:20.585 INFO:teuthology.orchestra.run.trial093.stdout:rbd-mirror-19.2.3-687.g8d724284.el9.x86_64.rpm 3.8 MB/s | 3.1 MB 00:00 2026-02-26T02:39:20.585 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:20.585 INFO:teuthology.orchestra.run.trial093.stdout:Total 3.8 MB/s | 3.1 MB 00:00 2026-02-26T02:39:20.585 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:20.589 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:20.589 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:20.628 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:20.628 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:20.825 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:20.826 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:20.849 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:20.849 INFO:teuthology.orchestra.run.trial093.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-26T02:39:20.849 INFO:teuthology.orchestra.run.trial093.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-26T02:39:20.850 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:20.850 INFO:teuthology.orchestra.run.trial093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-26T02:39:20.850 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:20.852 INFO:teuthology.orchestra.run.trial161.stdout:(1/3): ceph-debugsource-19.2.3-687.g8d724284.el 6.2 MB/s | 11 MB 00:01 2026-02-26T02:39:21.161 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:21.161 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:21.161 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:21.162 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:21.162 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:21.162 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:21.189 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install rbd-nbd 2026-02-26T02:39:21.506 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:04 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:21.592 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:21.592 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:21.592 INFO:teuthology.orchestra.run.trial093.stdout: Package Architecture Version Repository Size 2026-02-26T02:39:21.592 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd x86_64 2:19.2.3-687.g8d724284.el9 ceph 170 k 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 170 k 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 490 k 2026-02-26T02:39:21.593 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:21.644 INFO:teuthology.orchestra.run.trial192.stdout:(2/3): ceph-debuginfo-19.2.3-687.g8d724284.el9. 7.0 MB/s | 24 MB 00:03 2026-02-26T02:39:21.995 INFO:teuthology.orchestra.run.trial093.stdout:rbd-nbd-19.2.3-687.g8d724284.el9.x86_64.rpm 425 kB/s | 170 kB 00:00 2026-02-26T02:39:21.996 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:21.996 INFO:teuthology.orchestra.run.trial093.stdout:Total 423 kB/s | 170 kB 00:00 2026-02-26T02:39:21.996 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:21.999 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:21.999 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:22.031 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:22.031 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:22.087 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:22.104 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:22.190 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:22.252 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:39:22.252 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:22.252 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:22.252 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:22.252 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:22.252 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:22.281 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:39:22.583 INFO:teuthology.orchestra.run.trial161.stdout:(2/3): ceph-debuginfo-19.2.3-687.g8d724284.el9. 7.0 MB/s | 24 MB 00:03 2026-02-26T02:39:22.604 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:05 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:22.691 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:22.691 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 72 M 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout:Installing dependencies: 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout: ceph-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 24 M 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout:Installing weak dependencies: 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout: ceph-debugsource x86_64 2:19.2.3-687.g8d724284.el9 ceph 11 M 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:22.692 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:22.693 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:22.693 INFO:teuthology.orchestra.run.trial093.stdout:Install 3 Packages 2026-02-26T02:39:22.693 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:22.693 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 107 M 2026-02-26T02:39:22.693 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 654 M 2026-02-26T02:39:22.693 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:24.357 INFO:teuthology.orchestra.run.trial093.stdout:(1/3): ceph-debugsource-19.2.3-687.g8d724284.el 6.5 MB/s | 11 MB 00:01 2026-02-26T02:39:25.245 INFO:teuthology.orchestra.run.trial093.stdout:(2/3): ceph-debuginfo-19.2.3-687.g8d724284.el9. 9.6 MB/s | 24 MB 00:02 2026-02-26T02:39:26.525 INFO:teuthology.orchestra.run.trial192.stdout:(3/3): ceph-base-debuginfo-19.2.3-687.g8d724284 8.6 MB/s | 72 MB 00:08 2026-02-26T02:39:26.527 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:26.527 INFO:teuthology.orchestra.run.trial192.stdout:Total 13 MB/s | 107 MB 00:08 2026-02-26T02:39:26.527 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:26.532 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:26.532 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:26.889 INFO:teuthology.orchestra.run.trial130.stdout:(3/3): ceph-base-debuginfo-19.2.3-687.g8d724284 6.5 MB/s | 72 MB 00:10 2026-02-26T02:39:26.890 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:26.891 INFO:teuthology.orchestra.run.trial130.stdout:Total 9.7 MB/s | 107 MB 00:10 2026-02-26T02:39:26.891 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:39:26.896 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:39:26.896 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:39:26.911 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:26.911 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:39:27.079 INFO:teuthology.orchestra.run.trial093.stdout:(3/3): ceph-base-debuginfo-19.2.3-687.g8d724284 16 MB/s | 72 MB 00:04 2026-02-26T02:39:27.081 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:27.081 INFO:teuthology.orchestra.run.trial093.stdout:Total 24 MB/s | 107 MB 00:04 2026-02-26T02:39:27.081 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:39:27.086 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:39:27.087 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:39:27.275 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:39:27.276 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:39:27.470 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:39:27.471 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:39:29.362 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:39:29.755 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:39:29.947 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:39:30.625 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 1/3 2026-02-26T02:39:31.020 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 1/3 2026-02-26T02:39:31.211 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 1/3 2026-02-26T02:39:31.304 INFO:teuthology.orchestra.run.trial161.stdout:(3/3): ceph-base-debuginfo-19.2.3-687.g8d724284 5.9 MB/s | 72 MB 00:12 2026-02-26T02:39:31.306 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:31.306 INFO:teuthology.orchestra.run.trial161.stdout:Total 8.8 MB/s | 107 MB 00:12 2026-02-26T02:39:31.306 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:39:31.311 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:39:31.311 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:39:31.692 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:39:31.692 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:39:34.135 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:39:34.313 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:34.333 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:34.707 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:34.727 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:34.884 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:34.884 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/3 2026-02-26T02:39:34.884 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:34.889 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:34.909 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:34.948 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 3/3 2026-02-26T02:39:34.948 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:34.949 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:39:34.949 INFO:teuthology.orchestra.run.trial192.stdout: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:34.949 INFO:teuthology.orchestra.run.trial192.stdout: ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:34.949 INFO:teuthology.orchestra.run.trial192.stdout: ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:34.949 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:34.949 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:39:34.988 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-common-debuginfo 2026-02-26T02:39:35.255 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:35.255 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/3 2026-02-26T02:39:35.255 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:35.303 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:01:22 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 3/3 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout: ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout: ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:35.318 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:39:35.359 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-common-debuginfo 2026-02-26T02:39:35.388 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:39:35.388 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:35.389 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:39:35.389 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:35.389 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:39:35.389 INFO:teuthology.orchestra.run.trial192.stdout: ceph-common-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 474 M 2026-02-26T02:39:35.389 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:35.389 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:39:35.389 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:39:35.390 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:39:35.390 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:39:35.390 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 474 M 2026-02-26T02:39:35.390 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 2.0 G 2026-02-26T02:39:35.390 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:39:35.403 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 1/3 2026-02-26T02:39:35.452 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:35.452 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/3 2026-02-26T02:39:35.452 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 3/3 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout: ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout: ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:35.517 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:39:35.559 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-common-debuginfo 2026-02-26T02:39:35.678 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:01:23 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout: ceph-common-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 474 M 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:39:35.762 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:39:35.763 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:39:35.763 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:39:35.763 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 474 M 2026-02-26T02:39:35.763 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 2.0 G 2026-02-26T02:39:35.763 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:39:35.883 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:01:18 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:39:35.968 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:39:35.968 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:35.968 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 474 M 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 474 M 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 2.0 G 2026-02-26T02:39:35.969 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:39:39.084 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:39.104 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:39.653 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 3/3 2026-02-26T02:39:39.653 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/3 2026-02-26T02:39:39.653 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2/3 2026-02-26T02:39:39.717 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 3/3 2026-02-26T02:39:39.718 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:39.718 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:39:39.718 INFO:teuthology.orchestra.run.trial161.stdout: ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:39.718 INFO:teuthology.orchestra.run.trial161.stdout: ceph-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:39.718 INFO:teuthology.orchestra.run.trial161.stdout: ceph-debugsource-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:39:39.718 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:39.718 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:39:39.760 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-common-debuginfo 2026-02-26T02:39:40.088 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:01:28 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:39:40.173 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout: ceph-common-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 474 M 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:39:40.174 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:39:40.175 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 474 M 2026-02-26T02:39:40.175 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 2.0 G 2026-02-26T02:39:40.175 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:39:54.333 INFO:teuthology.orchestra.run.trial192.stdout:ceph-common-debuginfo-19.2.3-687.g8d724284.el9. 25 MB/s | 474 MB 00:18 2026-02-26T02:39:54.334 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:39:54.334 INFO:teuthology.orchestra.run.trial192.stdout:Total 25 MB/s | 474 MB 00:18 2026-02-26T02:39:54.334 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:39:54.336 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:39:54.336 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:39:55.753 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:39:55.754 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:40:19.394 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:40:19.413 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:20.425 INFO:teuthology.orchestra.run.trial161.stdout:ceph-common-debuginfo-19.2.3-687.g8d724284.el9. 12 MB/s | 474 MB 00:40 2026-02-26T02:40:20.426 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:40:20.426 INFO:teuthology.orchestra.run.trial161.stdout:Total 12 MB/s | 474 MB 00:40 2026-02-26T02:40:20.426 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:40:20.429 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:40:20.429 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:40:20.905 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:20.969 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:20.969 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:20.969 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:40:20.969 INFO:teuthology.orchestra.run.trial192.stdout: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:40:20.969 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:20.969 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:40:21.038 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-26T02:40:21.359 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:02:08 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:40:21.442 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:40:21.442 INFO:teuthology.orchestra.run.trial192.stdout:======================================================================================= 2026-02-26T02:40:21.442 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:======================================================================================= 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.5 M 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:======================================================================================= 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 1.5 M 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 7.6 M 2026-02-26T02:40:21.443 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:40:21.695 INFO:teuthology.orchestra.run.trial192.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-68 6.1 MB/s | 1.5 MB 00:00 2026-02-26T02:40:21.695 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:40:21.695 INFO:teuthology.orchestra.run.trial192.stdout:Total 6.1 MB/s | 1.5 MB 00:00 2026-02-26T02:40:21.695 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:40:21.697 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:40:21.697 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:40:21.719 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:40:21.719 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:40:21.833 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:40:21.843 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:40:21.843 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:40:21.850 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:21.917 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:21.981 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:21.981 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:21.981 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:40:21.981 INFO:teuthology.orchestra.run.trial192.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:40:21.982 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:21.982 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:40:22.009 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-26T02:40:22.333 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:02:09 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:40:22.416 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 200 M 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:40:22.417 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:40:22.418 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:40:22.418 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:22.418 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 200 M 2026-02-26T02:40:22.418 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 893 M 2026-02-26T02:40:22.418 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:40:26.491 INFO:teuthology.orchestra.run.trial130.stdout:ceph-common-debuginfo-19.2.3-687.g8d724284.el9. 9.3 MB/s | 474 MB 00:50 2026-02-26T02:40:26.492 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:40:26.492 INFO:teuthology.orchestra.run.trial130.stdout:Total 9.3 MB/s | 474 MB 00:50 2026-02-26T02:40:26.492 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:40:26.494 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:40:26.494 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:40:27.908 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:40:27.908 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:40:31.153 INFO:teuthology.orchestra.run.trial192.stdout:ceph-radosgw-debuginfo-19.2.3-687.g8d724284.el9 23 MB/s | 200 MB 00:08 2026-02-26T02:40:31.154 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:40:31.154 INFO:teuthology.orchestra.run.trial192.stdout:Total 23 MB/s | 200 MB 00:08 2026-02-26T02:40:31.154 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:40:31.156 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:40:31.156 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:40:31.762 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:40:31.762 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:40:37.455 INFO:teuthology.orchestra.run.trial093.stdout:ceph-common-debuginfo-19.2.3-687.g8d724284.el9. 7.7 MB/s | 474 MB 01:01 2026-02-26T02:40:37.455 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:40:37.456 INFO:teuthology.orchestra.run.trial093.stdout:Total 7.7 MB/s | 474 MB 01:01 2026-02-26T02:40:37.456 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:40:37.458 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:40:37.458 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:40:38.872 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:40:38.872 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:40:42.137 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:40:42.156 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:40:42.850 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:40:42.913 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:40:42.914 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:42.914 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:40:42.914 INFO:teuthology.orchestra.run.trial192.stdout: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:40:42.914 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:42.914 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:40:42.960 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-test-debuginfo 2026-02-26T02:40:43.281 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:02:30 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:40:43.365 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:40:43.365 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:40:43.366 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:40:43.366 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:40:43.366 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:40:43.366 INFO:teuthology.orchestra.run.trial192.stdout: ceph-test-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 778 M 2026-02-26T02:40:43.366 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:43.366 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:40:43.367 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:40:43.367 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:40:43.367 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:40:43.367 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 778 M 2026-02-26T02:40:43.367 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 3.8 G 2026-02-26T02:40:43.368 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:40:45.396 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:40:45.415 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:46.839 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:46.903 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:46.903 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:46.904 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:40:46.904 INFO:teuthology.orchestra.run.trial161.stdout: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:40:46.904 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:46.904 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:40:46.972 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-26T02:40:47.291 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:02:35 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:40:47.376 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:40:47.376 INFO:teuthology.orchestra.run.trial161.stdout:======================================================================================= 2026-02-26T02:40:47.376 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:40:47.376 INFO:teuthology.orchestra.run.trial161.stdout:======================================================================================= 2026-02-26T02:40:47.376 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:40:47.376 INFO:teuthology.orchestra.run.trial161.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.5 M 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout:======================================================================================= 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 1.5 M 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 7.6 M 2026-02-26T02:40:47.377 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:40:48.179 INFO:teuthology.orchestra.run.trial161.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-68 1.9 MB/s | 1.5 MB 00:00 2026-02-26T02:40:48.180 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:40:48.180 INFO:teuthology.orchestra.run.trial161.stdout:Total 1.9 MB/s | 1.5 MB 00:00 2026-02-26T02:40:48.180 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:40:48.182 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:40:48.182 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:40:48.205 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:40:48.205 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:40:48.318 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:40:48.336 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:48.402 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:48.465 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:48.465 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:48.465 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:40:48.465 INFO:teuthology.orchestra.run.trial161.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:40:48.465 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:48.465 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:40:48.492 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-26T02:40:48.809 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:02:36 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 200 M 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 200 M 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 893 M 2026-02-26T02:40:48.894 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:40:51.434 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:40:51.453 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:52.982 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:53.046 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:40:53.046 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:53.046 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:40:53.046 INFO:teuthology.orchestra.run.trial130.stdout: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:40:53.046 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:53.046 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:40:53.117 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-26T02:40:53.435 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:02:41 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout:======================================================================================= 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout:======================================================================================= 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.5 M 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout:======================================================================================= 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:40:53.519 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:53.520 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 1.5 M 2026-02-26T02:40:53.520 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 7.6 M 2026-02-26T02:40:53.520 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:40:54.075 INFO:teuthology.orchestra.run.trial130.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-68 2.8 MB/s | 1.5 MB 00:00 2026-02-26T02:40:54.076 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:40:54.076 INFO:teuthology.orchestra.run.trial130.stdout:Total 2.8 MB/s | 1.5 MB 00:00 2026-02-26T02:40:54.076 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:40:54.077 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:40:54.077 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:40:54.099 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:40:54.099 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:40:54.216 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:40:54.234 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:54.300 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:54.363 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:40:54.363 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:54.363 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:40:54.363 INFO:teuthology.orchestra.run.trial130.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:40:54.363 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:54.363 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:40:54.390 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-26T02:40:54.711 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:02:42 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:40:54.796 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 200 M 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:40:54.797 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:40:54.798 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:40:54.798 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:40:54.798 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 200 M 2026-02-26T02:40:54.798 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 893 M 2026-02-26T02:40:54.798 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:41:02.359 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:41:02.378 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:41:03.899 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:41:03.963 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:41:03.963 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:03.963 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:41:03.963 INFO:teuthology.orchestra.run.trial093.stdout: ceph-common-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:41:03.963 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:03.963 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:41:04.035 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-26T02:41:04.355 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:02:47 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:======================================================================================= 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:======================================================================================= 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.5 M 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:======================================================================================= 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 1.5 M 2026-02-26T02:41:04.439 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 7.6 M 2026-02-26T02:41:04.440 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:41:04.916 INFO:teuthology.orchestra.run.trial093.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-68 3.2 MB/s | 1.5 MB 00:00 2026-02-26T02:41:04.916 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:41:04.916 INFO:teuthology.orchestra.run.trial093.stdout:Total 3.2 MB/s | 1.5 MB 00:00 2026-02-26T02:41:04.916 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:41:04.918 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:41:04.918 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:41:04.941 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:41:04.941 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:41:05.055 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:41:05.073 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:41:05.139 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:41:05.201 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g 1/1 2026-02-26T02:41:05.201 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:05.202 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:41:05.202 INFO:teuthology.orchestra.run.trial093.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:41:05.202 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:05.202 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:41:05.230 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-26T02:41:05.556 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:02:48 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:41:05.642 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 200 M 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:41:05.643 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:41:05.644 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:05.644 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 200 M 2026-02-26T02:41:05.644 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 893 M 2026-02-26T02:41:05.644 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:41:06.383 INFO:teuthology.orchestra.run.trial130.stdout:ceph-radosgw-debuginfo-19.2.3-687.g8d724284.el9 17 MB/s | 200 MB 00:11 2026-02-26T02:41:06.384 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:41:06.384 INFO:teuthology.orchestra.run.trial130.stdout:Total 17 MB/s | 200 MB 00:11 2026-02-26T02:41:06.384 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:41:06.386 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:41:06.386 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:41:06.994 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:41:06.995 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:41:11.720 INFO:teuthology.orchestra.run.trial093.stdout:ceph-radosgw-debuginfo-19.2.3-687.g8d724284.el9 33 MB/s | 200 MB 00:06 2026-02-26T02:41:11.721 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:41:11.721 INFO:teuthology.orchestra.run.trial093.stdout:Total 33 MB/s | 200 MB 00:06 2026-02-26T02:41:11.722 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:41:11.723 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:41:11.724 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:41:12.328 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:41:12.329 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:41:12.910 INFO:teuthology.orchestra.run.trial161.stdout:ceph-radosgw-debuginfo-19.2.3-687.g8d724284.el9 8.3 MB/s | 200 MB 00:24 2026-02-26T02:41:12.911 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:41:12.912 INFO:teuthology.orchestra.run.trial161.stdout:Total 8.3 MB/s | 200 MB 00:24 2026-02-26T02:41:12.912 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:41:12.913 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:41:12.914 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:41:13.523 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:41:13.523 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:41:17.215 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:41:17.233 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:17.937 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:18.000 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:18.000 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:41:18.001 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:41:18.001 INFO:teuthology.orchestra.run.trial130.stdout: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:41:18.001 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:41:18.001 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:41:18.045 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-test-debuginfo 2026-02-26T02:41:18.361 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:03:06 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:41:18.444 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout: ceph-test-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 778 M 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 778 M 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 3.8 G 2026-02-26T02:41:18.445 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:41:22.402 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:41:22.420 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:23.125 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:23.188 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:23.188 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:23.188 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:41:23.188 INFO:teuthology.orchestra.run.trial093.stdout: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:41:23.188 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:23.188 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:41:23.232 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-test-debuginfo 2026-02-26T02:41:23.545 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:03:06 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:41:23.560 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:41:23.579 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:23.631 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:41:23.631 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:41:23.631 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:41:23.632 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:41:23.632 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:41:23.632 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 778 M 2026-02-26T02:41:23.632 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:23.632 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:41:23.632 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:41:23.633 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:41:23.633 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:41:23.633 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 778 M 2026-02-26T02:41:23.633 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 3.8 G 2026-02-26T02:41:23.633 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:41:24.247 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:24.310 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x8 1/1 2026-02-26T02:41:24.311 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:41:24.311 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:41:24.311 INFO:teuthology.orchestra.run.trial161.stdout: ceph-radosgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:41:24.311 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:41:24.311 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:41:24.357 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-test-debuginfo 2026-02-26T02:41:24.687 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:03:12 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:41:24.771 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:41:24.771 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:41:24.771 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout: ceph-test-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 778 M 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 778 M 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 3.8 G 2026-02-26T02:41:24.772 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:41:57.957 INFO:teuthology.orchestra.run.trial192.stdout:ceph-test-debuginfo-19.2.3-687.g8d724284.el9.x8 10 MB/s | 778 MB 01:14 2026-02-26T02:41:57.958 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:41:57.958 INFO:teuthology.orchestra.run.trial192.stdout:Total 10 MB/s | 778 MB 01:14 2026-02-26T02:41:57.958 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:41:57.961 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:41:57.962 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:42:00.267 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:42:00.267 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:42:18.303 INFO:teuthology.orchestra.run.trial161.stdout:ceph-test-debuginfo-19.2.3-687.g8d724284.el9.x8 15 MB/s | 778 MB 00:53 2026-02-26T02:42:18.304 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:42:18.305 INFO:teuthology.orchestra.run.trial161.stdout:Total 15 MB/s | 778 MB 00:53 2026-02-26T02:42:18.305 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:42:18.307 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:42:18.307 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:42:20.604 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:42:20.604 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:42:23.887 INFO:teuthology.orchestra.run.trial093.stdout:ceph-test-debuginfo-19.2.3-687.g8d724284.el9.x8 13 MB/s | 778 MB 01:00 2026-02-26T02:42:23.888 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:42:23.889 INFO:teuthology.orchestra.run.trial093.stdout:Total 13 MB/s | 778 MB 01:00 2026-02-26T02:42:23.889 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:42:23.891 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:42:23.892 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:42:24.502 INFO:teuthology.orchestra.run.trial130.stdout:ceph-test-debuginfo-19.2.3-687.g8d724284.el9.x8 12 MB/s | 778 MB 01:06 2026-02-26T02:42:24.503 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:42:24.503 INFO:teuthology.orchestra.run.trial130.stdout:Total 12 MB/s | 778 MB 01:06 2026-02-26T02:42:24.503 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:42:24.506 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:42:24.506 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:42:26.186 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:42:26.186 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:42:26.813 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:42:26.813 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:42:41.824 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:42:41.846 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:42:43.344 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:42:43.407 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:42:43.407 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:43.407 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:42:43.407 INFO:teuthology.orchestra.run.trial192.stdout: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:42:43.407 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:43.407 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:42:43.508 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:42:43.839 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:04:30 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:42:43.904 INFO:teuthology.orchestra.run.trial192.stdout:Package ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:42:43.923 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:42:43.923 INFO:teuthology.orchestra.run.trial192.stdout:Nothing to do. 2026-02-26T02:42:43.923 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:42:43.945 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mgr-debuginfo 2026-02-26T02:42:44.269 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:04:31 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:42:44.352 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 18 M 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:44.353 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:42:44.354 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:44.354 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 18 M 2026-02-26T02:42:44.354 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 110 M 2026-02-26T02:42:44.354 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:42:44.807 INFO:teuthology.orchestra.run.trial192.stdout:ceph-mgr-debuginfo-19.2.3-687.g8d724284.el9.x86 40 MB/s | 18 MB 00:00 2026-02-26T02:42:44.808 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:42:44.808 INFO:teuthology.orchestra.run.trial192.stdout:Total 40 MB/s | 18 MB 00:00 2026-02-26T02:42:44.808 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:42:44.810 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:42:44.810 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:42:44.880 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:42:44.880 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:42:45.914 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:42:45.933 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:46.068 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:46.132 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:46.132 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:46.132 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:42:46.133 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:42:46.133 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:46.133 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:42:46.161 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mds-debuginfo 2026-02-26T02:42:46.483 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:04:33 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:42:46.566 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:42:46.566 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:46.566 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:42:46.566 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:46.566 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 55 M 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 55 M 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 211 M 2026-02-26T02:42:46.567 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:42:47.680 INFO:teuthology.orchestra.run.trial192.stdout:ceph-mds-debuginfo-19.2.3-687.g8d724284.el9.x86 50 MB/s | 55 MB 00:01 2026-02-26T02:42:47.681 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:42:47.682 INFO:teuthology.orchestra.run.trial192.stdout:Total 50 MB/s | 55 MB 00:01 2026-02-26T02:42:47.682 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:42:47.683 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:42:47.683 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:42:47.863 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:42:47.863 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:42:50.533 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:42:50.552 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:50.748 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:50.811 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:50.812 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:50.812 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:42:50.812 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:42:50.812 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:50.812 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:42:50.845 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-mon-debuginfo 2026-02-26T02:42:51.166 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:04:38 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 102 M 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 102 M 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 497 M 2026-02-26T02:42:51.250 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:42:53.233 INFO:teuthology.orchestra.run.trial192.stdout:ceph-mon-debuginfo-19.2.3-687.g8d724284.el9.x86 51 MB/s | 102 MB 00:01 2026-02-26T02:42:53.234 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:42:53.234 INFO:teuthology.orchestra.run.trial192.stdout:Total 51 MB/s | 102 MB 00:01 2026-02-26T02:42:53.234 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:42:53.236 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:42:53.236 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:42:53.554 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:42:53.554 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:42:58.857 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:42:58.875 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:59.293 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:59.356 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:42:59.356 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:59.356 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:42:59.356 INFO:teuthology.orchestra.run.trial192.stdout: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:42:59.356 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:59.356 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:42:59.392 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-osd-debuginfo 2026-02-26T02:42:59.706 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:04:46 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:42:59.790 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:42:59.790 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:59.791 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:42:59.791 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:59.791 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:42:59.791 INFO:teuthology.orchestra.run.trial192.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 298 M 2026-02-26T02:42:59.791 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:59.791 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:42:59.792 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:42:59.792 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:42:59.792 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:42:59.792 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 298 M 2026-02-26T02:42:59.792 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 1.4 G 2026-02-26T02:42:59.792 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:00.750 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:00.771 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:01.446 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:01.510 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:01.510 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:01.510 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:01.510 INFO:teuthology.orchestra.run.trial161.stdout: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:01.510 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:01.510 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:01.614 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:43:01.939 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:04:49 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:02.004 INFO:teuthology.orchestra.run.trial161.stdout:Package ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:43:02.022 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:02.023 INFO:teuthology.orchestra.run.trial161.stdout:Nothing to do. 2026-02-26T02:43:02.023 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:02.044 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mgr-debuginfo 2026-02-26T02:43:02.367 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:04:50 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:02.449 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 18 M 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 18 M 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 110 M 2026-02-26T02:43:02.450 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:05.247 INFO:teuthology.orchestra.run.trial161.stdout:ceph-mgr-debuginfo-19.2.3-687.g8d724284.el9.x86 6.4 MB/s | 18 MB 00:02 2026-02-26T02:43:05.248 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:05.248 INFO:teuthology.orchestra.run.trial161.stdout:Total 6.4 MB/s | 18 MB 00:02 2026-02-26T02:43:05.248 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:05.250 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:05.250 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:05.321 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:05.321 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:05.727 INFO:teuthology.orchestra.run.trial192.stdout:ceph-osd-debuginfo-19.2.3-687.g8d724284.el9.x86 50 MB/s | 298 MB 00:05 2026-02-26T02:43:05.728 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:05.728 INFO:teuthology.orchestra.run.trial192.stdout:Total 50 MB/s | 298 MB 00:05 2026-02-26T02:43:05.728 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:05.730 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:05.730 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:06.339 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:06.357 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:06.493 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:06.556 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:06.557 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:06.557 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:06.557 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:06.557 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:06.557 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:06.584 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mds-debuginfo 2026-02-26T02:43:06.620 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:06.620 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:06.904 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:04:54 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:06.961 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:06.982 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:06.986 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:06.987 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:06.987 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 55 M 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 55 M 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 211 M 2026-02-26T02:43:06.988 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:07.232 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:07.253 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:07.641 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:07.705 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:07.705 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:07.705 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:07.705 INFO:teuthology.orchestra.run.trial130.stdout: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:07.705 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:07.706 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:07.806 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:43:08.103 INFO:teuthology.orchestra.run.trial161.stdout:ceph-mds-debuginfo-19.2.3-687.g8d724284.el9.x86 49 MB/s | 55 MB 00:01 2026-02-26T02:43:08.104 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:08.104 INFO:teuthology.orchestra.run.trial161.stdout:Total 49 MB/s | 55 MB 00:01 2026-02-26T02:43:08.104 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:08.106 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:08.106 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:08.124 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:04:56 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:08.190 INFO:teuthology.orchestra.run.trial130.stdout:Package ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:43:08.208 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:08.209 INFO:teuthology.orchestra.run.trial130.stdout:Nothing to do. 2026-02-26T02:43:08.209 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:08.230 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mgr-debuginfo 2026-02-26T02:43:08.286 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:08.286 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:08.549 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:04:56 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:08.633 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:08.633 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:08.633 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 18 M 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 18 M 2026-02-26T02:43:08.634 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 110 M 2026-02-26T02:43:08.635 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:09.069 INFO:teuthology.orchestra.run.trial130.stdout:ceph-mgr-debuginfo-19.2.3-687.g8d724284.el9.x86 41 MB/s | 18 MB 00:00 2026-02-26T02:43:09.069 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:09.069 INFO:teuthology.orchestra.run.trial130.stdout:Total 41 MB/s | 18 MB 00:00 2026-02-26T02:43:09.069 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:09.071 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:09.071 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:09.142 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:09.142 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:09.536 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:09.600 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:09.600 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:09.600 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:09.601 INFO:teuthology.orchestra.run.trial093.stdout: ceph-test-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:09.601 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:09.601 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:09.704 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-base-debuginfo 2026-02-26T02:43:10.032 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:04:53 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:10.100 INFO:teuthology.orchestra.run.trial093.stdout:Package ceph-base-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 is already installed. 2026-02-26T02:43:10.118 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:10.118 INFO:teuthology.orchestra.run.trial093.stdout:Nothing to do. 2026-02-26T02:43:10.118 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:10.140 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mgr-debuginfo 2026-02-26T02:43:10.188 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:10.206 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:10.343 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:10.406 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:10.407 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:10.407 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:10.407 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:10.407 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:10.407 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:10.435 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mds-debuginfo 2026-02-26T02:43:10.461 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:04:53 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:10.546 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:10.546 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:10.546 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:10.546 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:10.547 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:10.547 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 18 M 2026-02-26T02:43:10.547 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:10.547 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:10.547 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:10.547 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:10.547 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:10.548 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 18 M 2026-02-26T02:43:10.548 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 110 M 2026-02-26T02:43:10.548 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:10.758 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:04:58 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:10.843 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:10.843 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:10.843 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:10.843 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 55 M 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:10.844 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 55 M 2026-02-26T02:43:10.845 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 211 M 2026-02-26T02:43:10.845 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:10.958 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:10.977 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:10.985 INFO:teuthology.orchestra.run.trial093.stdout:ceph-mgr-debuginfo-19.2.3-687.g8d724284.el9.x86 41 MB/s | 18 MB 00:00 2026-02-26T02:43:10.986 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:10.986 INFO:teuthology.orchestra.run.trial093.stdout:Total 41 MB/s | 18 MB 00:00 2026-02-26T02:43:10.986 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:10.988 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:10.988 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:11.058 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:11.058 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:11.184 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:11.248 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:11.248 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:11.248 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:11.249 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:11.249 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:11.249 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:11.279 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-mon-debuginfo 2026-02-26T02:43:11.602 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:04:59 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:11.687 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:11.687 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:11.688 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:11.688 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:11.688 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:11.688 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 102 M 2026-02-26T02:43:11.688 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:11.688 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:11.689 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:11.689 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:11.689 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:11.689 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 102 M 2026-02-26T02:43:11.689 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 497 M 2026-02-26T02:43:11.689 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:12.043 INFO:teuthology.orchestra.run.trial130.stdout:ceph-mds-debuginfo-19.2.3-687.g8d724284.el9.x86 46 MB/s | 55 MB 00:01 2026-02-26T02:43:12.043 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:12.043 INFO:teuthology.orchestra.run.trial130.stdout:Total 46 MB/s | 55 MB 00:01 2026-02-26T02:43:12.043 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:12.045 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:12.045 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:12.071 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:12.090 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:12.224 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:12.225 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:12.225 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:12.288 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:12.288 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:12.288 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:12.288 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mgr-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:12.288 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:12.288 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:12.319 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mds-debuginfo 2026-02-26T02:43:12.642 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:04:55 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:12.728 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:12.728 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:12.728 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:12.728 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 55 M 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 55 M 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 211 M 2026-02-26T02:43:12.729 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:13.908 INFO:teuthology.orchestra.run.trial161.stdout:ceph-mon-debuginfo-19.2.3-687.g8d724284.el9.x86 46 MB/s | 102 MB 00:02 2026-02-26T02:43:13.909 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:13.909 INFO:teuthology.orchestra.run.trial161.stdout:Total 46 MB/s | 102 MB 00:02 2026-02-26T02:43:13.909 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:13.911 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:13.911 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:14.229 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:14.229 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:14.917 INFO:teuthology.orchestra.run.trial093.stdout:ceph-mds-debuginfo-19.2.3-687.g8d724284.el9.x86 25 MB/s | 55 MB 00:02 2026-02-26T02:43:14.918 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:14.918 INFO:teuthology.orchestra.run.trial093.stdout:Total 25 MB/s | 55 MB 00:02 2026-02-26T02:43:14.918 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:14.920 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:14.920 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:14.993 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:15.012 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:15.100 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:15.100 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:15.233 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:15.299 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:15.299 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:15.299 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:15.300 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:15.300 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:15.300 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:15.330 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-mon-debuginfo 2026-02-26T02:43:15.644 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:03 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 102 M 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:15.729 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:15.730 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:15.730 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:15.730 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:15.730 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 102 M 2026-02-26T02:43:15.730 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 497 M 2026-02-26T02:43:15.730 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:17.720 INFO:teuthology.orchestra.run.trial130.stdout:ceph-mon-debuginfo-19.2.3-687.g8d724284.el9.x86 51 MB/s | 102 MB 00:01 2026-02-26T02:43:17.720 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:17.720 INFO:teuthology.orchestra.run.trial130.stdout:Total 51 MB/s | 102 MB 00:01 2026-02-26T02:43:17.720 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:17.722 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:17.722 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:17.780 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:17.798 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:17.997 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:18.039 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:18.039 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:18.061 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:18.061 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:18.061 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:18.061 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mds-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:18.061 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:18.061 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:18.094 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-mon-debuginfo 2026-02-26T02:43:18.410 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:01 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:18.497 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:18.497 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:18.497 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:18.497 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:18.497 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:18.497 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 102 M 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 102 M 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 497 M 2026-02-26T02:43:18.498 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:19.636 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:19.654 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:20.077 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:20.141 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:20.141 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:20.142 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:20.142 INFO:teuthology.orchestra.run.trial161.stdout: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:20.142 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:20.142 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:20.177 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-osd-debuginfo 2026-02-26T02:43:20.483 INFO:teuthology.orchestra.run.trial093.stdout:ceph-mon-debuginfo-19.2.3-687.g8d724284.el9.x86 51 MB/s | 102 MB 00:01 2026-02-26T02:43:20.483 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:20.484 INFO:teuthology.orchestra.run.trial093.stdout:Total 51 MB/s | 102 MB 00:01 2026-02-26T02:43:20.484 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:20.485 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:20.486 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:20.493 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:08 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 298 M 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:20.577 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:20.578 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:20.578 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:20.578 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:20.578 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 298 M 2026-02-26T02:43:20.578 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 1.4 G 2026-02-26T02:43:20.578 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:20.802 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:20.803 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:21.598 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:21.617 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:22.629 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:22.694 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:22.694 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:22.694 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:22.694 INFO:teuthology.orchestra.run.trial192.stdout: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:22.694 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:22.694 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:22.748 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install ceph-fuse-debuginfo 2026-02-26T02:43:23.063 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:10 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:23.147 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:23.147 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:23.147 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:23.147 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:23.147 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.8 M 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 6.8 M 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 36 M 2026-02-26T02:43:23.148 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:23.248 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:23.267 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:23.670 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:23.733 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:23.734 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:23.734 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:23.734 INFO:teuthology.orchestra.run.trial130.stdout: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:23.734 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:23.734 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:23.771 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-osd-debuginfo 2026-02-26T02:43:24.092 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:12 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:24.177 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 298 M 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:24.178 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:24.179 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 298 M 2026-02-26T02:43:24.179 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 1.4 G 2026-02-26T02:43:24.179 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:24.209 INFO:teuthology.orchestra.run.trial192.stdout:ceph-fuse-debuginfo-19.2.3-687.g8d724284.el9.x8 6.4 MB/s | 6.8 MB 00:01 2026-02-26T02:43:24.209 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:24.209 INFO:teuthology.orchestra.run.trial192.stdout:Total 6.4 MB/s | 6.8 MB 00:01 2026-02-26T02:43:24.209 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:24.211 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:24.211 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:24.250 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:24.250 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:24.642 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:24.661 INFO:teuthology.orchestra.run.trial192.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:24.755 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:24.819 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:24.820 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:24.820 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:24.820 INFO:teuthology.orchestra.run.trial192.stdout: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:24.820 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:24.821 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:24.847 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install librados-devel-debuginfo 2026-02-26T02:43:25.162 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:12 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:25.246 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:25.246 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:25.246 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:25.246 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:25.246 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout: librados-devel-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 112 k 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 112 k 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 493 k 2026-02-26T02:43:25.247 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:25.652 INFO:teuthology.orchestra.run.trial192.stdout:librados-devel-debuginfo-19.2.3-687.g8d724284.e 276 kB/s | 112 kB 00:00 2026-02-26T02:43:25.653 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:25.653 INFO:teuthology.orchestra.run.trial192.stdout:Total 276 kB/s | 112 kB 00:00 2026-02-26T02:43:25.653 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:25.655 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:25.655 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:25.674 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:25.674 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:25.713 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:25.732 INFO:teuthology.orchestra.run.trial192.stdout: Installing : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:25.791 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:25.853 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:25.854 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:25.854 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:25.854 INFO:teuthology.orchestra.run.trial192.stdout: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:25.854 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:25.854 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:25.879 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install libcephfs2-debuginfo 2026-02-26T02:43:26.014 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:26.032 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:26.194 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:13 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:26.277 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.0 M 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:26.278 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:26.279 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:26.279 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 6.0 M 2026-02-26T02:43:26.279 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 31 M 2026-02-26T02:43:26.279 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:26.456 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:26.519 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:26.519 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:26.519 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:26.520 INFO:teuthology.orchestra.run.trial093.stdout: ceph-mon-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:26.520 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:26.520 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:26.556 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-osd-debuginfo 2026-02-26T02:43:26.831 INFO:teuthology.orchestra.run.trial161.stdout:ceph-osd-debuginfo-19.2.3-687.g8d724284.el9.x86 48 MB/s | 298 MB 00:06 2026-02-26T02:43:26.832 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:26.832 INFO:teuthology.orchestra.run.trial161.stdout:Total 48 MB/s | 298 MB 00:06 2026-02-26T02:43:26.832 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:26.834 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:26.834 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:26.880 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:09 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 298 M 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 298 M 2026-02-26T02:43:26.967 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 1.4 G 2026-02-26T02:43:26.968 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:27.727 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:27.727 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:28.052 INFO:teuthology.orchestra.run.trial192.stdout:libcephfs2-debuginfo-19.2.3-687.g8d724284.el9.x 3.4 MB/s | 6.0 MB 00:01 2026-02-26T02:43:28.053 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:28.053 INFO:teuthology.orchestra.run.trial192.stdout:Total 3.4 MB/s | 6.0 MB 00:01 2026-02-26T02:43:28.053 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:28.054 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:28.054 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:28.091 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:28.091 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:28.436 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:28.455 INFO:teuthology.orchestra.run.trial192.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:28.538 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:28.601 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:28.602 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:28.602 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:28.602 INFO:teuthology.orchestra.run.trial192.stdout: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:28.602 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:28.602 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:28.629 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install librados2-debuginfo 2026-02-26T02:43:28.951 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:15 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:29.036 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:29.036 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:29.036 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:29.036 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:29.036 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:29.036 INFO:teuthology.orchestra.run.trial192.stdout: librados2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 47 M 2026-02-26T02:43:29.036 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:29.037 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:29.037 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:29.037 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:29.037 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:29.037 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 47 M 2026-02-26T02:43:29.037 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 302 M 2026-02-26T02:43:29.037 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:34.017 INFO:teuthology.orchestra.run.trial130.stdout:ceph-osd-debuginfo-19.2.3-687.g8d724284.el9.x86 30 MB/s | 298 MB 00:09 2026-02-26T02:43:34.018 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:34.018 INFO:teuthology.orchestra.run.trial130.stdout:Total 30 MB/s | 298 MB 00:09 2026-02-26T02:43:34.018 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:34.019 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:34.019 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:34.479 INFO:teuthology.orchestra.run.trial192.stdout:librados2-debuginfo-19.2.3-687.g8d724284.el9.x8 8.7 MB/s | 47 MB 00:05 2026-02-26T02:43:34.480 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:34.480 INFO:teuthology.orchestra.run.trial192.stdout:Total 8.7 MB/s | 47 MB 00:05 2026-02-26T02:43:34.480 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:34.482 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:34.482 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:34.641 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:34.641 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:34.913 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:34.913 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:37.338 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:37.357 INFO:teuthology.orchestra.run.trial192.stdout: Installing : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:37.461 INFO:teuthology.orchestra.run.trial093.stdout:ceph-osd-debuginfo-19.2.3-687.g8d724284.el9.x86 28 MB/s | 298 MB 00:10 2026-02-26T02:43:37.462 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:37.462 INFO:teuthology.orchestra.run.trial093.stdout:Total 28 MB/s | 298 MB 00:10 2026-02-26T02:43:37.462 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:37.464 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:37.464 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:37.644 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:37.707 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:37.708 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:37.708 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:37.708 INFO:teuthology.orchestra.run.trial192.stdout: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:37.708 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:37.708 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:37.739 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install librbd1-debuginfo 2026-02-26T02:43:38.057 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:25 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:38.142 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:38.142 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:38.142 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:38.142 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout: librbd1-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 54 M 2026-02-26T02:43:38.143 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 374 M 2026-02-26T02:43:38.144 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:38.356 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:38.356 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:39.247 INFO:teuthology.orchestra.run.trial192.stdout:librbd1-debuginfo-19.2.3-687.g8d724284.el9.x86_ 49 MB/s | 54 MB 00:01 2026-02-26T02:43:39.248 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:39.248 INFO:teuthology.orchestra.run.trial192.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-26T02:43:39.248 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:39.250 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:39.250 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:39.430 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:39.430 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:42.632 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:42.651 INFO:teuthology.orchestra.run.trial192.stdout: Installing : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:42.971 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:43.035 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:43.035 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:43.035 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:43.035 INFO:teuthology.orchestra.run.trial192.stdout: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:43.035 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:43.035 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:43.067 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-cephfs-debuginfo 2026-02-26T02:43:43.378 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:43.383 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:30 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:43.397 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:43.467 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:43.467 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:43.467 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 628 k 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:43.468 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:43.469 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 628 k 2026-02-26T02:43:43.469 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 2.1 M 2026-02-26T02:43:43.469 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:43.576 INFO:teuthology.orchestra.run.trial192.stdout:python3-cephfs-debuginfo-19.2.3-687.g8d724284.e 5.7 MB/s | 628 kB 00:00 2026-02-26T02:43:43.576 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:43.576 INFO:teuthology.orchestra.run.trial192.stdout:Total 5.6 MB/s | 628 kB 00:00 2026-02-26T02:43:43.576 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:43.578 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:43.578 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:43.597 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:43.598 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:43.661 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:43.679 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:43.745 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:43.809 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:43.809 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:43.809 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:43.810 INFO:teuthology.orchestra.run.trial192.stdout: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:43.810 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:43.810 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:43.836 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-rados-debuginfo 2026-02-26T02:43:44.156 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:31 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:44.241 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:44.241 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:44.241 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:44.241 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:44.241 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:44.241 INFO:teuthology.orchestra.run.trial192.stdout: python3-rados-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 779 k 2026-02-26T02:43:44.241 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:44.242 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:44.242 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:44.242 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:44.242 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:44.242 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 779 k 2026-02-26T02:43:44.242 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 2.8 M 2026-02-26T02:43:44.242 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:44.350 INFO:teuthology.orchestra.run.trial192.stdout:python3-rados-debuginfo-19.2.3-687.g8d724284.el 7.0 MB/s | 779 kB 00:00 2026-02-26T02:43:44.350 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:44.350 INFO:teuthology.orchestra.run.trial192.stdout:Total 7.0 MB/s | 779 kB 00:00 2026-02-26T02:43:44.350 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:44.352 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:44.352 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:44.371 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:44.372 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:44.443 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:44.461 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:43:44.467 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:44.528 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:43:44.530 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:44.530 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:44.530 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:44.530 INFO:teuthology.orchestra.run.trial161.stdout: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:44.530 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:44.530 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:44.586 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install ceph-fuse-debuginfo 2026-02-26T02:43:44.592 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:43:44.592 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:44.592 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:44.592 INFO:teuthology.orchestra.run.trial192.stdout: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:44.592 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:44.592 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:44.621 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-rbd-debuginfo 2026-02-26T02:43:44.903 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:32 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:44.939 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:31 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:44.989 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:44.989 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:44.989 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:44.989 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:44.989 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:44.989 INFO:teuthology.orchestra.run.trial161.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.8 M 2026-02-26T02:43:44.989 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:44.990 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:44.990 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:44.990 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:44.990 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:44.990 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 6.8 M 2026-02-26T02:43:44.990 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 36 M 2026-02-26T02:43:44.990 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:45.022 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 1.1 M 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 4.3 M 2026-02-26T02:43:45.023 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:45.215 INFO:teuthology.orchestra.run.trial161.stdout:ceph-fuse-debuginfo-19.2.3-687.g8d724284.el9.x8 30 MB/s | 6.8 MB 00:00 2026-02-26T02:43:45.216 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:45.216 INFO:teuthology.orchestra.run.trial161.stdout:Total 30 MB/s | 6.8 MB 00:00 2026-02-26T02:43:45.216 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:45.218 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:45.218 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:45.243 INFO:teuthology.orchestra.run.trial192.stdout:python3-rbd-debuginfo-19.2.3-687.g8d724284.el9. 5.2 MB/s | 1.1 MB 00:00 2026-02-26T02:43:45.243 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:45.244 INFO:teuthology.orchestra.run.trial192.stdout:Total 5.2 MB/s | 1.1 MB 00:00 2026-02-26T02:43:45.244 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:45.245 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:45.245 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:45.257 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:45.257 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:45.268 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:45.268 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:45.357 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:45.375 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:43:45.444 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:43:45.510 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:43:45.510 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:45.510 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:45.510 INFO:teuthology.orchestra.run.trial192.stdout: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:45.510 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:45.510 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:45.539 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install python3-rgw-debuginfo 2026-02-26T02:43:45.648 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:45.667 INFO:teuthology.orchestra.run.trial161.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:45.761 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:45.825 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:45.825 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:45.826 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:45.826 INFO:teuthology.orchestra.run.trial161.stdout: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:45.826 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:45.826 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:45.853 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install librados-devel-debuginfo 2026-02-26T02:43:45.862 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:32 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:45.945 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:45.946 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 339 k 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:45.947 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 339 k 2026-02-26T02:43:45.948 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 1.0 M 2026-02-26T02:43:45.948 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:46.045 INFO:teuthology.orchestra.run.trial192.stdout:python3-rgw-debuginfo-19.2.3-687.g8d724284.el9. 3.4 MB/s | 339 kB 00:00 2026-02-26T02:43:46.045 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:46.045 INFO:teuthology.orchestra.run.trial192.stdout:Total 3.4 MB/s | 339 kB 00:00 2026-02-26T02:43:46.045 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:46.046 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:46.047 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:46.065 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:46.066 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:46.116 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:46.135 INFO:teuthology.orchestra.run.trial192.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:43:46.172 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:34 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:46.198 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:43:46.254 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:46.255 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:46.255 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout: librados-devel-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 112 k 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 112 k 2026-02-26T02:43:46.256 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 493 k 2026-02-26T02:43:46.257 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:46.261 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:43:46.261 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:46.261 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:46.261 INFO:teuthology.orchestra.run.trial192.stdout: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:46.262 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:46.262 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:46.288 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install rbd-fuse-debuginfo 2026-02-26T02:43:46.343 INFO:teuthology.orchestra.run.trial161.stdout:librados-devel-debuginfo-19.2.3-687.g8d724284.e 1.3 MB/s | 112 kB 00:00 2026-02-26T02:43:46.343 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:46.344 INFO:teuthology.orchestra.run.trial161.stdout:Total 1.2 MB/s | 112 kB 00:00 2026-02-26T02:43:46.344 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:46.345 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:46.345 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:46.364 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:46.364 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:46.404 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:46.422 INFO:teuthology.orchestra.run.trial161.stdout: Installing : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:46.483 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:46.547 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:46.547 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:46.547 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:46.547 INFO:teuthology.orchestra.run.trial161.stdout: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:46.547 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:46.547 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:46.573 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install libcephfs2-debuginfo 2026-02-26T02:43:46.600 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:33 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:46.683 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 547 k 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 547 k 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 3.0 M 2026-02-26T02:43:46.684 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:46.794 INFO:teuthology.orchestra.run.trial192.stdout:rbd-fuse-debuginfo-19.2.3-687.g8d724284.el9.x86 4.9 MB/s | 547 kB 00:00 2026-02-26T02:43:46.794 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:46.795 INFO:teuthology.orchestra.run.trial192.stdout:Total 4.9 MB/s | 547 kB 00:00 2026-02-26T02:43:46.795 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:46.796 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:46.796 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:46.816 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:46.817 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:46.879 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:46.891 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:34 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:46.897 INFO:teuthology.orchestra.run.trial192.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:46.962 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:46.974 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.0 M 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:46.975 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:46.976 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:46.976 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:46.976 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 6.0 M 2026-02-26T02:43:46.976 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 31 M 2026-02-26T02:43:46.976 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:47.026 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:47.027 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:47.027 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:47.027 INFO:teuthology.orchestra.run.trial192.stdout: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:47.027 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:47.027 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:47.054 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install rbd-mirror-debuginfo 2026-02-26T02:43:47.181 INFO:teuthology.orchestra.run.trial161.stdout:libcephfs2-debuginfo-19.2.3-687.g8d724284.el9.x 29 MB/s | 6.0 MB 00:00 2026-02-26T02:43:47.181 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:47.181 INFO:teuthology.orchestra.run.trial161.stdout:Total 29 MB/s | 6.0 MB 00:00 2026-02-26T02:43:47.181 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:47.183 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:47.183 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:47.220 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:47.220 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:47.377 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:34 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:47.461 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:47.461 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:47.462 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 54 M 2026-02-26T02:43:47.463 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 353 M 2026-02-26T02:43:47.463 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:47.574 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:47.593 INFO:teuthology.orchestra.run.trial161.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:47.677 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:47.741 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:47.741 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:47.741 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:47.742 INFO:teuthology.orchestra.run.trial161.stdout: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:47.742 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:47.742 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:47.768 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install librados2-debuginfo 2026-02-26T02:43:48.089 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:36 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:48.174 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout: librados2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 47 M 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:48.175 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:48.176 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 47 M 2026-02-26T02:43:48.176 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 302 M 2026-02-26T02:43:48.176 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:48.588 INFO:teuthology.orchestra.run.trial192.stdout:rbd-mirror-debuginfo-19.2.3-687.g8d724284.el9.x 48 MB/s | 54 MB 00:01 2026-02-26T02:43:48.588 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:48.589 INFO:teuthology.orchestra.run.trial192.stdout:Total 48 MB/s | 54 MB 00:01 2026-02-26T02:43:48.589 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:48.590 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:48.591 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:48.765 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:48.765 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:49.405 INFO:teuthology.orchestra.run.trial161.stdout:librados2-debuginfo-19.2.3-687.g8d724284.el9.x8 38 MB/s | 47 MB 00:01 2026-02-26T02:43:49.405 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:49.405 INFO:teuthology.orchestra.run.trial161.stdout:Total 38 MB/s | 47 MB 00:01 2026-02-26T02:43:49.406 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:49.408 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:49.408 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:49.568 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:49.568 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:49.928 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:49.947 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:50.989 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:51.053 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:51.053 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:51.053 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:51.054 INFO:teuthology.orchestra.run.trial130.stdout: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:51.054 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:51.054 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:51.108 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install ceph-fuse-debuginfo 2026-02-26T02:43:51.433 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:39 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:51.517 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:51.518 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:51.518 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.8 M 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 6.8 M 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 36 M 2026-02-26T02:43:51.519 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:51.744 INFO:teuthology.orchestra.run.trial130.stdout:ceph-fuse-debuginfo-19.2.3-687.g8d724284.el9.x8 30 MB/s | 6.8 MB 00:00 2026-02-26T02:43:51.745 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:51.745 INFO:teuthology.orchestra.run.trial130.stdout:Total 30 MB/s | 6.8 MB 00:00 2026-02-26T02:43:51.745 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:51.747 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:51.747 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:51.785 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:51.786 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:51.809 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:51.828 INFO:teuthology.orchestra.run.trial192.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:52.156 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:52.178 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:52.197 INFO:teuthology.orchestra.run.trial130.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:52.221 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:52.221 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:52.221 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:52.222 INFO:teuthology.orchestra.run.trial192.stdout: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:52.222 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:52.222 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:52.252 DEBUG:teuthology.orchestra.run.trial192:> sudo yum -y install rbd-nbd-debuginfo 2026-02-26T02:43:52.260 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:52.278 INFO:teuthology.orchestra.run.trial161.stdout: Installing : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:52.284 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:52.347 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:52.348 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:52.348 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:52.348 INFO:teuthology.orchestra.run.trial130.stdout: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:52.348 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:52.348 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:52.375 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install librados-devel-debuginfo 2026-02-26T02:43:52.557 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:52.570 INFO:teuthology.orchestra.run.trial192.stdout:Last metadata expiration check: 0:05:39 ago on Thu 26 Feb 2026 02:38:13 AM UTC. 2026-02-26T02:43:52.621 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:52.621 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:52.621 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:52.621 INFO:teuthology.orchestra.run.trial161.stdout: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:52.621 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:52.621 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:52.651 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install librbd1-debuginfo 2026-02-26T02:43:52.653 INFO:teuthology.orchestra.run.trial192.stdout:Dependencies resolved. 2026-02-26T02:43:52.655 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:52.655 INFO:teuthology.orchestra.run.trial192.stdout: Package Arch Version Repo Size 2026-02-26T02:43:52.655 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:52.655 INFO:teuthology.orchestra.run.trial192.stdout:Installing: 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.4 M 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout:Transaction Summary 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout:================================================================================ 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout:Install 1 Package 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout:Total download size: 1.4 M 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout:Installed size: 6.6 M 2026-02-26T02:43:52.656 INFO:teuthology.orchestra.run.trial192.stdout:Downloading Packages: 2026-02-26T02:43:52.693 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:40 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:52.777 INFO:teuthology.orchestra.run.trial192.stdout:rbd-nbd-debuginfo-19.2.3-687.g8d724284.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-26T02:43:52.778 INFO:teuthology.orchestra.run.trial192.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:52.778 INFO:teuthology.orchestra.run.trial192.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-26T02:43:52.778 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction check 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout: librados-devel-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 112 k 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:52.779 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:52.780 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:52.780 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:52.780 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 112 k 2026-02-26T02:43:52.780 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 493 k 2026-02-26T02:43:52.780 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:52.781 INFO:teuthology.orchestra.run.trial192.stdout:Transaction check succeeded. 2026-02-26T02:43:52.781 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction test 2026-02-26T02:43:52.801 INFO:teuthology.orchestra.run.trial192.stdout:Transaction test succeeded. 2026-02-26T02:43:52.801 INFO:teuthology.orchestra.run.trial192.stdout:Running transaction 2026-02-26T02:43:52.864 INFO:teuthology.orchestra.run.trial130.stdout:librados-devel-debuginfo-19.2.3-687.g8d724284.e 1.3 MB/s | 112 kB 00:00 2026-02-26T02:43:52.865 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:52.865 INFO:teuthology.orchestra.run.trial130.stdout:Total 1.3 MB/s | 112 kB 00:00 2026-02-26T02:43:52.865 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:52.866 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:52.866 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:52.885 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:52.885 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:52.905 INFO:teuthology.orchestra.run.trial192.stdout: Preparing : 1/1 2026-02-26T02:43:52.924 INFO:teuthology.orchestra.run.trial192.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:52.924 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:52.942 INFO:teuthology.orchestra.run.trial130.stdout: Installing : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:52.969 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:40 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:52.988 INFO:teuthology.orchestra.run.trial192.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:53.002 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:53.051 INFO:teuthology.orchestra.run.trial192.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:53.051 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:53.051 INFO:teuthology.orchestra.run.trial192.stdout:Installed: 2026-02-26T02:43:53.051 INFO:teuthology.orchestra.run.trial192.stdout: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:53.051 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:43:53.051 INFO:teuthology.orchestra.run.trial192.stdout:Complete! 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout: librbd1-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:53.053 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:53.054 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 54 M 2026-02-26T02:43:53.054 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 374 M 2026-02-26T02:43:53.054 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:53.064 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:53.064 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:53.065 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:53.065 INFO:teuthology.orchestra.run.trial130.stdout: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:53.065 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:53.065 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:53.082 DEBUG:teuthology.parallel:result is None 2026-02-26T02:43:53.091 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install libcephfs2-debuginfo 2026-02-26T02:43:53.354 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:53.374 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:53.407 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:41 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:53.492 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:53.492 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:53.493 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:53.493 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:53.493 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:53.493 INFO:teuthology.orchestra.run.trial130.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.0 M 2026-02-26T02:43:53.493 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:53.493 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:53.493 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:53.494 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:53.494 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:53.494 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 6.0 M 2026-02-26T02:43:53.494 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 31 M 2026-02-26T02:43:53.494 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:54.188 INFO:teuthology.orchestra.run.trial161.stdout:librbd1-debuginfo-19.2.3-687.g8d724284.el9.x86_ 48 MB/s | 54 MB 00:01 2026-02-26T02:43:54.188 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:54.188 INFO:teuthology.orchestra.run.trial161.stdout:Total 48 MB/s | 54 MB 00:01 2026-02-26T02:43:54.189 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:54.191 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:54.191 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:54.371 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:54.371 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:54.379 INFO:teuthology.orchestra.run.trial130.stdout:libcephfs2-debuginfo-19.2.3-687.g8d724284.el9.x 6.7 MB/s | 6.0 MB 00:00 2026-02-26T02:43:54.379 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:54.379 INFO:teuthology.orchestra.run.trial130.stdout:Total 6.7 MB/s | 6.0 MB 00:00 2026-02-26T02:43:54.379 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:54.381 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:54.381 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:54.395 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:54.418 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:54.418 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:54.460 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:54.460 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:54.460 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:54.460 INFO:teuthology.orchestra.run.trial093.stdout: ceph-osd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:54.460 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:54.461 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:54.517 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install ceph-fuse-debuginfo 2026-02-26T02:43:54.766 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:54.784 INFO:teuthology.orchestra.run.trial130.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:54.843 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:37 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:54.867 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.8 M 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:54.928 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 6.8 M 2026-02-26T02:43:54.929 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 36 M 2026-02-26T02:43:54.929 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:54.932 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:54.932 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:54.932 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:54.932 INFO:teuthology.orchestra.run.trial130.stdout: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:54.932 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:54.932 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:54.961 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install librados2-debuginfo 2026-02-26T02:43:55.149 INFO:teuthology.orchestra.run.trial093.stdout:ceph-fuse-debuginfo-19.2.3-687.g8d724284.el9.x8 31 MB/s | 6.8 MB 00:00 2026-02-26T02:43:55.150 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:55.150 INFO:teuthology.orchestra.run.trial093.stdout:Total 31 MB/s | 6.8 MB 00:00 2026-02-26T02:43:55.150 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:55.151 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:55.151 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:55.191 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:55.191 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:55.282 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:43 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:55.367 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:55.367 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:55.367 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:55.367 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:55.367 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout: librados2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 47 M 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 47 M 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 302 M 2026-02-26T02:43:55.368 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:43:55.582 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:55.600 INFO:teuthology.orchestra.run.trial093.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:55.692 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:55.756 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:55.757 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:55.757 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:55.757 INFO:teuthology.orchestra.run.trial093.stdout: ceph-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:55.757 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:55.757 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:55.787 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install librados-devel-debuginfo 2026-02-26T02:43:56.111 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:39 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 112 k 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:56.199 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:56.200 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:56.200 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:56.200 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:56.200 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 112 k 2026-02-26T02:43:56.200 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 493 k 2026-02-26T02:43:56.200 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:56.329 INFO:teuthology.orchestra.run.trial093.stdout:librados-devel-debuginfo-19.2.3-687.g8d724284.e 867 kB/s | 112 kB 00:00 2026-02-26T02:43:56.329 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:56.329 INFO:teuthology.orchestra.run.trial093.stdout:Total 860 kB/s | 112 kB 00:00 2026-02-26T02:43:56.330 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:56.331 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:56.331 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:56.333 INFO:teuthology.orchestra.run.trial130.stdout:librados2-debuginfo-19.2.3-687.g8d724284.el9.x8 49 MB/s | 47 MB 00:00 2026-02-26T02:43:56.333 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:56.334 INFO:teuthology.orchestra.run.trial130.stdout:Total 49 MB/s | 47 MB 00:00 2026-02-26T02:43:56.334 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:43:56.336 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:43:56.336 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:43:56.350 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:56.350 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:56.393 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:56.410 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:56.472 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:56.494 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:43:56.495 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:43:56.536 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:56.536 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:56.536 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:56.536 INFO:teuthology.orchestra.run.trial093.stdout: librados-devel-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:56.536 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:56.536 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:56.563 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install libcephfs2-debuginfo 2026-02-26T02:43:56.884 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:39 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:56.969 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 6.0 M 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 6.0 M 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 31 M 2026-02-26T02:43:56.970 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:57.173 INFO:teuthology.orchestra.run.trial093.stdout:libcephfs2-debuginfo-19.2.3-687.g8d724284.el9.x 30 MB/s | 6.0 MB 00:00 2026-02-26T02:43:57.173 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:57.174 INFO:teuthology.orchestra.run.trial093.stdout:Total 30 MB/s | 6.0 MB 00:00 2026-02-26T02:43:57.174 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:57.175 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:57.175 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:57.211 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:57.211 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:57.568 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:43:57.587 INFO:teuthology.orchestra.run.trial093.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:57.629 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:57.647 INFO:teuthology.orchestra.run.trial161.stdout: Installing : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:57.672 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:57.736 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:43:57.736 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:57.736 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:43:57.736 INFO:teuthology.orchestra.run.trial093.stdout: libcephfs2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:57.736 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:57.736 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:43:57.764 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install librados2-debuginfo 2026-02-26T02:43:57.960 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:58.023 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:43:58.023 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:58.024 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:58.024 INFO:teuthology.orchestra.run.trial161.stdout: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:58.024 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:58.024 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:58.054 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-cephfs-debuginfo 2026-02-26T02:43:58.079 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:41 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:43:58.166 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:43:58.166 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:58.166 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:43:58.166 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:58.166 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout: librados2-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 47 M 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 47 M 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 302 M 2026-02-26T02:43:58.167 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:43:58.375 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:46 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:58.458 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:58.458 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 628 k 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:58.459 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 628 k 2026-02-26T02:43:58.460 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 2.1 M 2026-02-26T02:43:58.460 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:58.846 INFO:teuthology.orchestra.run.trial161.stdout:python3-cephfs-debuginfo-19.2.3-687.g8d724284.e 1.6 MB/s | 628 kB 00:00 2026-02-26T02:43:58.847 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:58.847 INFO:teuthology.orchestra.run.trial161.stdout:Total 1.6 MB/s | 628 kB 00:00 2026-02-26T02:43:58.847 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:58.849 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:58.849 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:58.869 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:58.869 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:58.935 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:58.953 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:59.016 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:59.080 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:43:59.080 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:59.080 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:59.080 INFO:teuthology.orchestra.run.trial161.stdout: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:59.080 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:59.080 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:59.106 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-rados-debuginfo 2026-02-26T02:43:59.155 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:43:59.173 INFO:teuthology.orchestra.run.trial093.stdout:librados2-debuginfo-19.2.3-687.g8d724284.el9.x8 47 MB/s | 47 MB 00:01 2026-02-26T02:43:59.173 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:59.174 INFO:teuthology.orchestra.run.trial130.stdout: Installing : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:59.174 INFO:teuthology.orchestra.run.trial093.stdout:Total 47 MB/s | 47 MB 00:01 2026-02-26T02:43:59.174 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:43:59.176 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:43:59.176 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:43:59.336 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:43:59.336 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:43:59.425 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:47 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:59.452 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:59.509 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout: python3-rados-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 779 k 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:43:59.510 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:43:59.511 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:43:59.511 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:59.511 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 779 k 2026-02-26T02:43:59.511 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 2.8 M 2026-02-26T02:43:59.511 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:43:59.516 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:43:59.516 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:59.516 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:43:59.516 INFO:teuthology.orchestra.run.trial130.stdout: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:59.516 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:59.516 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:43:59.547 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install librbd1-debuginfo 2026-02-26T02:43:59.639 INFO:teuthology.orchestra.run.trial161.stdout:python3-rados-debuginfo-19.2.3-687.g8d724284.el 5.9 MB/s | 779 kB 00:00 2026-02-26T02:43:59.639 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:43:59.640 INFO:teuthology.orchestra.run.trial161.stdout:Total 5.8 MB/s | 779 kB 00:00 2026-02-26T02:43:59.640 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:43:59.641 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:43:59.641 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:43:59.663 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:43:59.663 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:43:59.734 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:43:59.752 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:43:59.813 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:43:59.858 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:47 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:43:59.877 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:43:59.877 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:59.877 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:43:59.877 INFO:teuthology.orchestra.run.trial161.stdout: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:43:59.877 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:43:59.877 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:43:59.903 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-rbd-debuginfo 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout: librbd1-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:59.943 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:43:59.944 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:43:59.944 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:43:59.944 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:43:59.944 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 54 M 2026-02-26T02:43:59.944 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 374 M 2026-02-26T02:43:59.944 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:00.221 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:48 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:00.304 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:00.305 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:44:00.306 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:00.306 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 1.1 M 2026-02-26T02:44:00.306 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 4.3 M 2026-02-26T02:44:00.306 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:44:00.802 INFO:teuthology.orchestra.run.trial161.stdout:python3-rbd-debuginfo-19.2.3-687.g8d724284.el9. 2.3 MB/s | 1.1 MB 00:00 2026-02-26T02:44:00.803 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:00.803 INFO:teuthology.orchestra.run.trial161.stdout:Total 2.3 MB/s | 1.1 MB 00:00 2026-02-26T02:44:00.803 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:44:00.804 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:44:00.804 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:44:00.827 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:44:00.827 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:44:00.918 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:44:00.936 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:00.999 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:01.063 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:01.063 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:01.063 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:44:01.063 INFO:teuthology.orchestra.run.trial161.stdout: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:01.063 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:01.063 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:44:01.068 INFO:teuthology.orchestra.run.trial130.stdout:librbd1-debuginfo-19.2.3-687.g8d724284.el9.x86_ 48 MB/s | 54 MB 00:01 2026-02-26T02:44:01.069 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:01.069 INFO:teuthology.orchestra.run.trial130.stdout:Total 48 MB/s | 54 MB 00:01 2026-02-26T02:44:01.069 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:01.071 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:01.071 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:01.089 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install python3-rgw-debuginfo 2026-02-26T02:44:01.251 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:01.251 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:01.404 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:49 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:01.488 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:44:01.488 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:01.488 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 339 k 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 339 k 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 1.0 M 2026-02-26T02:44:01.489 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:44:01.685 INFO:teuthology.orchestra.run.trial161.stdout:python3-rgw-debuginfo-19.2.3-687.g8d724284.el9. 1.7 MB/s | 339 kB 00:00 2026-02-26T02:44:01.686 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:01.686 INFO:teuthology.orchestra.run.trial161.stdout:Total 1.7 MB/s | 339 kB 00:00 2026-02-26T02:44:01.686 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:44:01.688 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:44:01.688 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:44:01.708 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:44:01.708 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:44:01.759 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:44:01.776 INFO:teuthology.orchestra.run.trial161.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:01.837 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:01.901 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:01.902 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:01.902 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:44:01.902 INFO:teuthology.orchestra.run.trial161.stdout: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:01.902 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:01.902 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:44:01.928 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install rbd-fuse-debuginfo 2026-02-26T02:44:02.026 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:02.045 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:44:02.250 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:50 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:02.326 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:44:02.335 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:44:02.336 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:02.336 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:44:02.336 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:02.336 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:44:02.336 INFO:teuthology.orchestra.run.trial161.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 547 k 2026-02-26T02:44:02.336 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:02.337 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:44:02.337 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:02.337 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:44:02.337 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:02.337 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 547 k 2026-02-26T02:44:02.337 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 3.0 M 2026-02-26T02:44:02.337 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:44:02.390 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_6 1/1 2026-02-26T02:44:02.390 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:02.390 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:02.391 INFO:teuthology.orchestra.run.trial093.stdout: librados2-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:02.391 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:02.391 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:02.421 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install librbd1-debuginfo 2026-02-26T02:44:02.489 INFO:teuthology.orchestra.run.trial161.stdout:rbd-fuse-debuginfo-19.2.3-687.g8d724284.el9.x86 3.5 MB/s | 547 kB 00:00 2026-02-26T02:44:02.489 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:02.489 INFO:teuthology.orchestra.run.trial161.stdout:Total 3.5 MB/s | 547 kB 00:00 2026-02-26T02:44:02.489 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:44:02.492 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:44:02.492 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:44:02.513 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:44:02.513 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:44:02.577 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:44:02.595 INFO:teuthology.orchestra.run.trial161.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:02.657 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:02.721 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:02.721 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:02.721 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:44:02.721 INFO:teuthology.orchestra.run.trial161.stdout: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:02.721 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:02.721 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:44:02.737 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:45 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:02.748 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install rbd-mirror-debuginfo 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout: librbd1-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 54 M 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 374 M 2026-02-26T02:44:02.822 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:03.074 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:51 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:03.158 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:44:03.159 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:03.159 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 54 M 2026-02-26T02:44:03.159 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 353 M 2026-02-26T02:44:03.159 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:44:04.026 INFO:teuthology.orchestra.run.trial093.stdout:librbd1-debuginfo-19.2.3-687.g8d724284.el9.x86_ 45 MB/s | 54 MB 00:01 2026-02-26T02:44:04.027 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:04.027 INFO:teuthology.orchestra.run.trial093.stdout:Total 45 MB/s | 54 MB 00:01 2026-02-26T02:44:04.027 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:04.029 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:04.029 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:04.209 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:04.210 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:04.499 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:04.517 INFO:teuthology.orchestra.run.trial130.stdout: Installing : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:04.844 INFO:teuthology.orchestra.run.trial161.stdout:rbd-mirror-debuginfo-19.2.3-687.g8d724284.el9.x 32 MB/s | 54 MB 00:01 2026-02-26T02:44:04.845 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:04.845 INFO:teuthology.orchestra.run.trial161.stdout:Total 32 MB/s | 54 MB 00:01 2026-02-26T02:44:04.845 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:44:04.847 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:44:04.847 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:44:04.848 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:04.911 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:04.912 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:04.912 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:04.912 INFO:teuthology.orchestra.run.trial130.stdout: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:04.912 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:04.912 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:04.944 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-cephfs-debuginfo 2026-02-26T02:44:05.024 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:44:05.024 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:44:05.262 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:53 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:05.346 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:44:05.346 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:05.346 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 628 k 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:44:05.347 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:05.348 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 628 k 2026-02-26T02:44:05.348 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 2.1 M 2026-02-26T02:44:05.348 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:05.515 INFO:teuthology.orchestra.run.trial130.stdout:python3-cephfs-debuginfo-19.2.3-687.g8d724284.e 3.6 MB/s | 628 kB 00:00 2026-02-26T02:44:05.516 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:05.516 INFO:teuthology.orchestra.run.trial130.stdout:Total 3.6 MB/s | 628 kB 00:00 2026-02-26T02:44:05.516 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:05.517 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:05.517 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:05.537 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:05.537 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:05.600 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:05.619 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:44:05.680 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:44:05.743 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:44:05.743 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:05.743 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:05.743 INFO:teuthology.orchestra.run.trial130.stdout: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:05.743 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:05.744 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:05.771 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-rados-debuginfo 2026-02-26T02:44:06.090 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:54 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:06.174 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:44:06.175 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:06.175 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:44:06.175 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:06.175 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:44:06.175 INFO:teuthology.orchestra.run.trial130.stdout: python3-rados-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 779 k 2026-02-26T02:44:06.175 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:06.175 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:44:06.176 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:06.176 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:44:06.176 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:06.176 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 779 k 2026-02-26T02:44:06.176 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 2.8 M 2026-02-26T02:44:06.176 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:06.286 INFO:teuthology.orchestra.run.trial130.stdout:python3-rados-debuginfo-19.2.3-687.g8d724284.el 6.9 MB/s | 779 kB 00:00 2026-02-26T02:44:06.286 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:06.286 INFO:teuthology.orchestra.run.trial130.stdout:Total 6.9 MB/s | 779 kB 00:00 2026-02-26T02:44:06.286 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:06.287 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:06.287 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:06.307 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:06.307 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:06.379 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:06.396 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:44:06.458 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:44:06.522 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:44:06.523 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:06.523 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:06.523 INFO:teuthology.orchestra.run.trial130.stdout: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:06.523 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:06.523 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:06.547 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-rbd-debuginfo 2026-02-26T02:44:06.860 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:54 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:06.944 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:44:06.945 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:06.946 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:44:06.946 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:06.946 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 1.1 M 2026-02-26T02:44:06.946 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 4.3 M 2026-02-26T02:44:06.946 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:07.188 INFO:teuthology.orchestra.run.trial130.stdout:python3-rbd-debuginfo-19.2.3-687.g8d724284.el9. 4.7 MB/s | 1.1 MB 00:00 2026-02-26T02:44:07.188 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:07.189 INFO:teuthology.orchestra.run.trial130.stdout:Total 4.7 MB/s | 1.1 MB 00:00 2026-02-26T02:44:07.189 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:07.191 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:07.191 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:07.213 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:07.214 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:07.304 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:07.322 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:07.345 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:07.364 INFO:teuthology.orchestra.run.trial093.stdout: Installing : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:07.384 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:07.447 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:07.447 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:07.447 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:07.447 INFO:teuthology.orchestra.run.trial130.stdout: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:07.447 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:07.447 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:07.474 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install python3-rgw-debuginfo 2026-02-26T02:44:07.686 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:07.751 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:07.751 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:07.751 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:07.751 INFO:teuthology.orchestra.run.trial093.stdout: librbd1-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:07.751 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:07.751 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:07.784 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-cephfs-debuginfo 2026-02-26T02:44:07.787 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:55 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 339 k 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:07.872 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:44:07.873 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:07.873 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:44:07.873 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:07.873 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 339 k 2026-02-26T02:44:07.873 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 1.0 M 2026-02-26T02:44:07.873 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:07.971 INFO:teuthology.orchestra.run.trial130.stdout:python3-rgw-debuginfo-19.2.3-687.g8d724284.el9. 3.3 MB/s | 339 kB 00:00 2026-02-26T02:44:07.971 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:07.971 INFO:teuthology.orchestra.run.trial130.stdout:Total 3.3 MB/s | 339 kB 00:00 2026-02-26T02:44:07.971 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:07.973 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:07.973 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:07.994 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:07.994 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:08.044 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:08.062 INFO:teuthology.orchestra.run.trial130.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:08.107 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:51 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:08.127 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:08.130 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:44:08.148 INFO:teuthology.orchestra.run.trial161.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:08.190 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:08.190 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:08.190 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:08.190 INFO:teuthology.orchestra.run.trial130.stdout: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:08.190 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:08.190 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:08.191 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:08.191 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:08.191 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 628 k 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 628 k 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 2.1 M 2026-02-26T02:44:08.192 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:08.216 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install rbd-fuse-debuginfo 2026-02-26T02:44:08.302 INFO:teuthology.orchestra.run.trial093.stdout:python3-cephfs-debuginfo-19.2.3-687.g8d724284.e 5.6 MB/s | 628 kB 00:00 2026-02-26T02:44:08.302 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:08.303 INFO:teuthology.orchestra.run.trial093.stdout:Total 5.6 MB/s | 628 kB 00:00 2026-02-26T02:44:08.303 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:08.305 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:08.305 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:08.325 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:08.325 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:08.390 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:08.409 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:44:08.463 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:08.475 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:44:08.527 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:08.527 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:08.527 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:44:08.527 INFO:teuthology.orchestra.run.trial161.stdout: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:08.527 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:08.527 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:44:08.538 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:56 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:08.540 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9. 1/1 2026-02-26T02:44:08.540 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:08.540 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:08.540 INFO:teuthology.orchestra.run.trial093.stdout: python3-cephfs-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:08.540 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:08.540 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:08.561 DEBUG:teuthology.orchestra.run.trial161:> sudo yum -y install rbd-nbd-debuginfo 2026-02-26T02:44:08.568 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-rados-debuginfo 2026-02-26T02:44:08.623 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:44:08.624 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:08.624 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:44:08.624 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:08.624 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:44:08.624 INFO:teuthology.orchestra.run.trial130.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 547 k 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 547 k 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 3.0 M 2026-02-26T02:44:08.625 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:08.735 INFO:teuthology.orchestra.run.trial130.stdout:rbd-fuse-debuginfo-19.2.3-687.g8d724284.el9.x86 4.9 MB/s | 547 kB 00:00 2026-02-26T02:44:08.735 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:08.735 INFO:teuthology.orchestra.run.trial130.stdout:Total 4.8 MB/s | 547 kB 00:00 2026-02-26T02:44:08.735 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:08.737 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:08.737 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:08.758 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:08.758 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:08.822 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:08.840 INFO:teuthology.orchestra.run.trial130.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:08.882 INFO:teuthology.orchestra.run.trial161.stdout:Last metadata expiration check: 0:05:56 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:08.886 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:51 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:08.902 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:08.966 INFO:teuthology.orchestra.run.trial161.stdout:Dependencies resolved. 2026-02-26T02:44:08.966 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:08.966 INFO:teuthology.orchestra.run.trial161.stdout: Package Arch Version Repo Size 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout:Installing: 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.4 M 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout:Transaction Summary 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout:================================================================================ 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout:Install 1 Package 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout:Total download size: 1.4 M 2026-02-26T02:44:08.967 INFO:teuthology.orchestra.run.trial161.stdout:Installed size: 6.6 M 2026-02-26T02:44:08.968 INFO:teuthology.orchestra.run.trial161.stdout:Downloading Packages: 2026-02-26T02:44:08.968 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:08.968 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:08.968 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:08.968 INFO:teuthology.orchestra.run.trial130.stdout: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:08.968 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:08.969 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:08.971 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:08.972 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:08.972 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:08.972 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:08.972 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:08.972 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 779 k 2026-02-26T02:44:08.972 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:08.973 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:08.973 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:08.973 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:08.973 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:08.973 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 779 k 2026-02-26T02:44:08.973 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 2.8 M 2026-02-26T02:44:08.973 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:08.993 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install rbd-mirror-debuginfo 2026-02-26T02:44:09.082 INFO:teuthology.orchestra.run.trial093.stdout:python3-rados-debuginfo-19.2.3-687.g8d724284.el 7.0 MB/s | 779 kB 00:00 2026-02-26T02:44:09.083 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:09.083 INFO:teuthology.orchestra.run.trial093.stdout:Total 6.9 MB/s | 779 kB 00:00 2026-02-26T02:44:09.083 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:09.084 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:09.084 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:09.088 INFO:teuthology.orchestra.run.trial161.stdout:rbd-nbd-debuginfo-19.2.3-687.g8d724284.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-26T02:44:09.089 INFO:teuthology.orchestra.run.trial161.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:09.089 INFO:teuthology.orchestra.run.trial161.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-26T02:44:09.089 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction check 2026-02-26T02:44:09.091 INFO:teuthology.orchestra.run.trial161.stdout:Transaction check succeeded. 2026-02-26T02:44:09.091 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction test 2026-02-26T02:44:09.104 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:09.105 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:09.113 INFO:teuthology.orchestra.run.trial161.stdout:Transaction test succeeded. 2026-02-26T02:44:09.113 INFO:teuthology.orchestra.run.trial161.stdout:Running transaction 2026-02-26T02:44:09.176 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:09.195 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:44:09.218 INFO:teuthology.orchestra.run.trial161.stdout: Preparing : 1/1 2026-02-26T02:44:09.236 INFO:teuthology.orchestra.run.trial161.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:09.257 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:44:09.301 INFO:teuthology.orchestra.run.trial161.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:09.311 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:05:57 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:09.320 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x 1/1 2026-02-26T02:44:09.320 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:09.320 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:09.321 INFO:teuthology.orchestra.run.trial093.stdout: python3-rados-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:09.321 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:09.321 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:09.348 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-rbd-debuginfo 2026-02-26T02:44:09.365 INFO:teuthology.orchestra.run.trial161.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:09.365 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:09.365 INFO:teuthology.orchestra.run.trial161.stdout:Installed: 2026-02-26T02:44:09.365 INFO:teuthology.orchestra.run.trial161.stdout: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:09.365 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:09.365 INFO:teuthology.orchestra.run.trial161.stdout:Complete! 2026-02-26T02:44:09.402 DEBUG:teuthology.parallel:result is None 2026-02-26T02:44:09.403 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:44:09.404 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:09.405 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:44:09.405 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:09.405 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 54 M 2026-02-26T02:44:09.405 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 353 M 2026-02-26T02:44:09.405 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:09.667 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:52 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:09.752 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:09.753 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:09.753 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.1 M 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 1.1 M 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 4.3 M 2026-02-26T02:44:09.754 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:10.277 INFO:teuthology.orchestra.run.trial093.stdout:python3-rbd-debuginfo-19.2.3-687.g8d724284.el9. 2.2 MB/s | 1.1 MB 00:00 2026-02-26T02:44:10.278 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:10.278 INFO:teuthology.orchestra.run.trial093.stdout:Total 2.2 MB/s | 1.1 MB 00:00 2026-02-26T02:44:10.278 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:10.280 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:10.280 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:10.301 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:10.301 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:10.397 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:10.415 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:10.477 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:10.507 INFO:teuthology.orchestra.run.trial130.stdout:rbd-mirror-debuginfo-19.2.3-687.g8d724284.el9.x 48 MB/s | 54 MB 00:01 2026-02-26T02:44:10.508 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:10.508 INFO:teuthology.orchestra.run.trial130.stdout:Total 48 MB/s | 54 MB 00:01 2026-02-26T02:44:10.508 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:10.510 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:10.510 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:10.540 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:10.540 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:10.540 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:10.541 INFO:teuthology.orchestra.run.trial093.stdout: python3-rbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:10.541 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:10.541 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:10.567 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install python3-rgw-debuginfo 2026-02-26T02:44:10.687 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:10.688 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:10.879 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:53 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:10.964 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:10.964 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:10.964 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:10.964 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:10.964 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:10.964 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 339 k 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 339 k 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 1.0 M 2026-02-26T02:44:10.965 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:11.426 INFO:teuthology.orchestra.run.trial093.stdout:python3-rgw-debuginfo-19.2.3-687.g8d724284.el9. 736 kB/s | 339 kB 00:00 2026-02-26T02:44:11.427 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:11.428 INFO:teuthology.orchestra.run.trial093.stdout:Total 734 kB/s | 339 kB 00:00 2026-02-26T02:44:11.428 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:11.429 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:11.429 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:11.450 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:11.450 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:11.500 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:11.518 INFO:teuthology.orchestra.run.trial093.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:11.579 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:11.643 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86 1/1 2026-02-26T02:44:11.643 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:11.643 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:11.643 INFO:teuthology.orchestra.run.trial093.stdout: python3-rgw-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:11.643 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:11.643 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:11.669 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install rbd-fuse-debuginfo 2026-02-26T02:44:11.991 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:54 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 547 k 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:12.076 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:12.077 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 547 k 2026-02-26T02:44:12.077 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 3.0 M 2026-02-26T02:44:12.077 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:12.469 INFO:teuthology.orchestra.run.trial093.stdout:rbd-fuse-debuginfo-19.2.3-687.g8d724284.el9.x86 1.4 MB/s | 547 kB 00:00 2026-02-26T02:44:12.470 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:12.470 INFO:teuthology.orchestra.run.trial093.stdout:Total 1.4 MB/s | 547 kB 00:00 2026-02-26T02:44:12.470 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:12.472 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:12.472 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:12.492 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:12.493 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:12.557 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:12.576 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:12.637 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:12.700 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:12.700 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:12.700 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:12.700 INFO:teuthology.orchestra.run.trial093.stdout: rbd-fuse-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:12.700 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:12.700 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:12.728 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install rbd-mirror-debuginfo 2026-02-26T02:44:13.048 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:05:56 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:13.132 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:13.132 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:13.132 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:13.132 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:13.132 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:13.132 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 54 M 2026-02-26T02:44:13.132 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:13.133 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:13.133 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:13.133 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:13.133 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:13.133 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 54 M 2026-02-26T02:44:13.133 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 353 M 2026-02-26T02:44:13.133 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:13.736 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:13.754 INFO:teuthology.orchestra.run.trial130.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:14.043 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:14.105 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:14.105 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:14.105 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:14.105 INFO:teuthology.orchestra.run.trial130.stdout: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:14.106 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:14.106 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:14.138 DEBUG:teuthology.orchestra.run.trial130:> sudo yum -y install rbd-nbd-debuginfo 2026-02-26T02:44:14.452 INFO:teuthology.orchestra.run.trial130.stdout:Last metadata expiration check: 0:06:02 ago on Thu 26 Feb 2026 02:38:12 AM UTC. 2026-02-26T02:44:14.537 INFO:teuthology.orchestra.run.trial130.stdout:Dependencies resolved. 2026-02-26T02:44:14.537 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:14.537 INFO:teuthology.orchestra.run.trial130.stdout: Package Arch Version Repo Size 2026-02-26T02:44:14.537 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:14.537 INFO:teuthology.orchestra.run.trial130.stdout:Installing: 2026-02-26T02:44:14.537 INFO:teuthology.orchestra.run.trial130.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.4 M 2026-02-26T02:44:14.537 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:14.538 INFO:teuthology.orchestra.run.trial130.stdout:Transaction Summary 2026-02-26T02:44:14.538 INFO:teuthology.orchestra.run.trial130.stdout:================================================================================ 2026-02-26T02:44:14.538 INFO:teuthology.orchestra.run.trial130.stdout:Install 1 Package 2026-02-26T02:44:14.538 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:14.538 INFO:teuthology.orchestra.run.trial130.stdout:Total download size: 1.4 M 2026-02-26T02:44:14.538 INFO:teuthology.orchestra.run.trial130.stdout:Installed size: 6.6 M 2026-02-26T02:44:14.538 INFO:teuthology.orchestra.run.trial130.stdout:Downloading Packages: 2026-02-26T02:44:15.696 INFO:teuthology.orchestra.run.trial093.stdout:rbd-mirror-debuginfo-19.2.3-687.g8d724284.el9.x 21 MB/s | 54 MB 00:02 2026-02-26T02:44:15.697 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:15.697 INFO:teuthology.orchestra.run.trial093.stdout:Total 21 MB/s | 54 MB 00:02 2026-02-26T02:44:15.697 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:15.699 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:15.699 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:15.764 INFO:teuthology.orchestra.run.trial130.stdout:rbd-nbd-debuginfo-19.2.3-687.g8d724284.el9.x86_ 1.1 MB/s | 1.4 MB 00:01 2026-02-26T02:44:15.765 INFO:teuthology.orchestra.run.trial130.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:15.765 INFO:teuthology.orchestra.run.trial130.stdout:Total 1.1 MB/s | 1.4 MB 00:01 2026-02-26T02:44:15.765 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction check 2026-02-26T02:44:15.767 INFO:teuthology.orchestra.run.trial130.stdout:Transaction check succeeded. 2026-02-26T02:44:15.767 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction test 2026-02-26T02:44:15.788 INFO:teuthology.orchestra.run.trial130.stdout:Transaction test succeeded. 2026-02-26T02:44:15.788 INFO:teuthology.orchestra.run.trial130.stdout:Running transaction 2026-02-26T02:44:15.875 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:15.875 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:15.892 INFO:teuthology.orchestra.run.trial130.stdout: Preparing : 1/1 2026-02-26T02:44:15.909 INFO:teuthology.orchestra.run.trial130.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:15.973 INFO:teuthology.orchestra.run.trial130.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:16.035 INFO:teuthology.orchestra.run.trial130.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:16.036 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:16.036 INFO:teuthology.orchestra.run.trial130.stdout:Installed: 2026-02-26T02:44:16.036 INFO:teuthology.orchestra.run.trial130.stdout: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:16.036 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:16.036 INFO:teuthology.orchestra.run.trial130.stdout:Complete! 2026-02-26T02:44:16.067 DEBUG:teuthology.parallel:result is None 2026-02-26T02:44:18.922 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:18.941 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:19.259 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:19.323 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_ 1/1 2026-02-26T02:44:19.323 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:19.324 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:19.324 INFO:teuthology.orchestra.run.trial093.stdout: rbd-mirror-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:19.324 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:19.324 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:19.358 DEBUG:teuthology.orchestra.run.trial093:> sudo yum -y install rbd-nbd-debuginfo 2026-02-26T02:44:19.680 INFO:teuthology.orchestra.run.trial093.stdout:Last metadata expiration check: 0:06:02 ago on Thu 26 Feb 2026 02:38:17 AM UTC. 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:Dependencies resolved. 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout: Package Arch Version Repo Size 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:Installing: 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-687.g8d724284.el9 ceph 1.4 M 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:Transaction Summary 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:================================================================================ 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:Install 1 Package 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:Total download size: 1.4 M 2026-02-26T02:44:19.767 INFO:teuthology.orchestra.run.trial093.stdout:Installed size: 6.6 M 2026-02-26T02:44:19.768 INFO:teuthology.orchestra.run.trial093.stdout:Downloading Packages: 2026-02-26T02:44:19.887 INFO:teuthology.orchestra.run.trial093.stdout:rbd-nbd-debuginfo-19.2.3-687.g8d724284.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-26T02:44:19.888 INFO:teuthology.orchestra.run.trial093.stdout:-------------------------------------------------------------------------------- 2026-02-26T02:44:19.888 INFO:teuthology.orchestra.run.trial093.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-26T02:44:19.888 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction check 2026-02-26T02:44:19.889 INFO:teuthology.orchestra.run.trial093.stdout:Transaction check succeeded. 2026-02-26T02:44:19.889 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction test 2026-02-26T02:44:19.911 INFO:teuthology.orchestra.run.trial093.stdout:Transaction test succeeded. 2026-02-26T02:44:19.911 INFO:teuthology.orchestra.run.trial093.stdout:Running transaction 2026-02-26T02:44:20.016 INFO:teuthology.orchestra.run.trial093.stdout: Preparing : 1/1 2026-02-26T02:44:20.034 INFO:teuthology.orchestra.run.trial093.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:20.101 INFO:teuthology.orchestra.run.trial093.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:20.165 INFO:teuthology.orchestra.run.trial093.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 1/1 2026-02-26T02:44:20.165 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:20.165 INFO:teuthology.orchestra.run.trial093.stdout:Installed: 2026-02-26T02:44:20.166 INFO:teuthology.orchestra.run.trial093.stdout: rbd-nbd-debuginfo-2:19.2.3-687.g8d724284.el9.x86_64 2026-02-26T02:44:20.166 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:20.166 INFO:teuthology.orchestra.run.trial093.stdout:Complete! 2026-02-26T02:44:20.195 DEBUG:teuthology.parallel:result is None 2026-02-26T02:44:20.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:44:20.329 DEBUG:teuthology.orchestra.run.trial093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T02:44:20.349 INFO:teuthology.orchestra.run.trial093.stdout:19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.350 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.350 INFO:teuthology.task.install:The correct ceph version 19.2.3-687.g8d724284 is installed. 2026-02-26T02:44:20.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:44:20.486 DEBUG:teuthology.orchestra.run.trial130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T02:44:20.507 INFO:teuthology.orchestra.run.trial130.stdout:19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.507 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.507 INFO:teuthology.task.install:The correct ceph version 19.2.3-687.g8d724284 is installed. 2026-02-26T02:44:20.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:44:20.654 DEBUG:teuthology.orchestra.run.trial161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T02:44:20.674 INFO:teuthology.orchestra.run.trial161.stdout:19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.674 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.674 INFO:teuthology.task.install:The correct ceph version 19.2.3-687.g8d724284 is installed. 2026-02-26T02:44:20.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5 2026-02-26T02:44:20.827 DEBUG:teuthology.orchestra.run.trial192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-26T02:44:20.849 INFO:teuthology.orchestra.run.trial192.stdout:19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.850 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-687.g8d724284.el9 2026-02-26T02:44:20.850 INFO:teuthology.task.install:The correct ceph version 19.2.3-687.g8d724284 is installed. 2026-02-26T02:44:20.851 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-26T02:44:20.852 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:20.852 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-26T02:44:20.877 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:44:20.877 DEBUG:teuthology.orchestra.run.trial130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-26T02:44:20.903 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:44:20.903 DEBUG:teuthology.orchestra.run.trial161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-26T02:44:20.929 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:44:20.930 DEBUG:teuthology.orchestra.run.trial192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-26T02:44:20.956 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-26T02:44:20.957 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:20.957 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/daemon-helper 2026-02-26T02:44:20.982 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-26T02:44:21.046 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:44:21.047 DEBUG:teuthology.orchestra.run.trial130:> sudo dd of=/usr/bin/daemon-helper 2026-02-26T02:44:21.074 DEBUG:teuthology.orchestra.run.trial130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-26T02:44:21.137 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:44:21.137 DEBUG:teuthology.orchestra.run.trial161:> sudo dd of=/usr/bin/daemon-helper 2026-02-26T02:44:21.162 DEBUG:teuthology.orchestra.run.trial161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-26T02:44:21.227 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:44:21.227 DEBUG:teuthology.orchestra.run.trial192:> sudo dd of=/usr/bin/daemon-helper 2026-02-26T02:44:21.253 DEBUG:teuthology.orchestra.run.trial192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-26T02:44:21.318 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-26T02:44:21.318 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:21.318 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-26T02:44:21.343 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-26T02:44:21.407 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:44:21.408 DEBUG:teuthology.orchestra.run.trial130:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-26T02:44:21.432 DEBUG:teuthology.orchestra.run.trial130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-26T02:44:21.496 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:44:21.496 DEBUG:teuthology.orchestra.run.trial161:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-26T02:44:21.521 DEBUG:teuthology.orchestra.run.trial161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-26T02:44:21.585 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:44:21.585 DEBUG:teuthology.orchestra.run.trial192:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-26T02:44:21.610 DEBUG:teuthology.orchestra.run.trial192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-26T02:44:21.674 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-26T02:44:21.674 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:21.674 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/usr/bin/stdin-killer 2026-02-26T02:44:21.699 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-26T02:44:21.764 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:44:21.764 DEBUG:teuthology.orchestra.run.trial130:> sudo dd of=/usr/bin/stdin-killer 2026-02-26T02:44:21.791 DEBUG:teuthology.orchestra.run.trial130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-26T02:44:21.857 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:44:21.857 DEBUG:teuthology.orchestra.run.trial161:> sudo dd of=/usr/bin/stdin-killer 2026-02-26T02:44:21.882 DEBUG:teuthology.orchestra.run.trial161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-26T02:44:21.946 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:44:21.946 DEBUG:teuthology.orchestra.run.trial192:> sudo dd of=/usr/bin/stdin-killer 2026-02-26T02:44:21.971 DEBUG:teuthology.orchestra.run.trial192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-26T02:44:22.035 INFO:teuthology.run_tasks:Running task ceph... 2026-02-26T02:44:22.114 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-26T02:44:22.114 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 777 /var/log/ceph 2026-02-26T02:44:22.116 DEBUG:teuthology.orchestra.run.trial130:> sudo chmod 777 /var/log/ceph 2026-02-26T02:44:22.118 DEBUG:teuthology.orchestra.run.trial161:> sudo chmod 777 /var/log/ceph 2026-02-26T02:44:22.154 DEBUG:teuthology.orchestra.run.trial192:> sudo chmod 777 /var/log/ceph 2026-02-26T02:44:22.179 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-26T02:44:22.179 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-26T02:44:22.194 DEBUG:teuthology.orchestra.run.trial130:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-26T02:44:22.196 DEBUG:teuthology.orchestra.run.trial161:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-26T02:44:22.219 DEBUG:teuthology.orchestra.run.trial192:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-26T02:44:22.242 INFO:tasks.ceph:Creating extra log directories... 2026-02-26T02:44:22.242 DEBUG:teuthology.orchestra.run.trial093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-26T02:44:22.258 DEBUG:teuthology.orchestra.run.trial130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-26T02:44:22.260 DEBUG:teuthology.orchestra.run.trial161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-26T02:44:22.285 DEBUG:teuthology.orchestra.run.trial192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-26T02:44:22.329 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-26T02:44:22.329 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_class_default_list': '*', 'osd_class_load_list': '*'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-26T02:44:22.329 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027', 'branch': 'wip-yuri9-testing-2026-02-25-1600-squid', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '71027', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri9-testing-2026-02-25-1600-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_class_default_list': '*', 'osd_class_load_list': '*'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'mon_bind_msgr2': False, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri9-testing-2026-02-25-1600-squid', 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 1525, 'sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri9-testing-2026-02-25-1600-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5', 'targets': {'trial093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHt++30EwYkFfRfsYjJeoQPCNEKgxDI+wxwNZhM8ccNkXzLXT+Xqak6ay9QzrLUti438bPP7BMdKafVYDjoP/yY=', 'trial130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7oeftG/UjEyZ4FD0+JBNfjnHcJdrtMApX3LN4uZ946ekqHKS5cTH9X+ZVjz6BdZ+tQfRnZYPdyFtqUiVNF63o=', 'trial161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK1ReN88deVHuPs0gaPaxZRz2/yPDuH0PToX9YGZOUBveP8HeqBYJEsY8PsD+mnXpPjug5Wi42OX6yc0sHKNNyc=', 'trial192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCnrCF9NhSdfojWS3Zz2vL6BzKES7jfgeiFYPAm5VP48ubCOIZbhdB4dyCN3w/HeNEyVGTFp32KMuxVkrG0vuSQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['cls']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6e3d0419ccca0e75a03e08feb708946e198236f4', 'timestamp': '2026-02-26_01:51:16', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-26T02:44:22.330 DEBUG:teuthology.orchestra.run.trial093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-26T02:44:22.332 DEBUG:teuthology.orchestra.run.trial130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-26T02:44:22.335 DEBUG:teuthology.orchestra.run.trial161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-26T02:44:22.349 DEBUG:teuthology.orchestra.run.trial192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-26T02:44:22.366 DEBUG:teuthology.orchestra.run.trial093:> sudo install -d -m0777 -- /var/run/ceph 2026-02-26T02:44:22.389 DEBUG:teuthology.orchestra.run.trial130:> sudo install -d -m0777 -- /var/run/ceph 2026-02-26T02:44:22.392 DEBUG:teuthology.orchestra.run.trial161:> sudo install -d -m0777 -- /var/run/ceph 2026-02-26T02:44:22.407 DEBUG:teuthology.orchestra.run.trial192:> sudo install -d -m0777 -- /var/run/ceph 2026-02-26T02:44:22.431 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:22.431 DEBUG:teuthology.orchestra.run.trial093:> dd if=/scratch_devs of=/dev/stdout 2026-02-26T02:44:22.468 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-26T02:44:22.468 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_1 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-26 02:39:20.992476371 +0000 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.523 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.524 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-26T02:44:22.586 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-26T02:44:22.586 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-26T02:44:22.586 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000152753 s, 3.4 MB/s 2026-02-26T02:44:22.587 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-26T02:44:22.644 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_2 2026-02-26T02:44:22.701 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-26T02:44:22.701 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:22.701 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-26T02:44:22.701 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:22.701 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:22.702 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-26 02:39:20.992476371 +0000 2026-02-26T02:44:22.702 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.702 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.702 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.702 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-26T02:44:22.764 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-26T02:44:22.764 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-26T02:44:22.764 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000142695 s, 3.6 MB/s 2026-02-26T02:44:22.766 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-26T02:44:22.822 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_3 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-26 02:39:20.993476352 +0000 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.879 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.880 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-26 02:38:27.137429458 +0000 2026-02-26T02:44:22.880 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-26T02:44:22.941 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-26T02:44:22.942 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-26T02:44:22.942 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000157192 s, 3.3 MB/s 2026-02-26T02:44:22.943 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-26T02:44:23.000 DEBUG:teuthology.orchestra.run.trial093:> stat /dev/vg_nvme/lv_4 2026-02-26T02:44:23.056 INFO:teuthology.orchestra.run.trial093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-26T02:44:23.056 INFO:teuthology.orchestra.run.trial093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:23.056 INFO:teuthology.orchestra.run.trial093.stdout:Device: 6h/6d Inode: 1284 Links: 1 2026-02-26T02:44:23.056 INFO:teuthology.orchestra.run.trial093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:23.056 INFO:teuthology.orchestra.run.trial093.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:23.056 INFO:teuthology.orchestra.run.trial093.stdout:Access: 2026-02-26 02:39:20.993476352 +0000 2026-02-26T02:44:23.057 INFO:teuthology.orchestra.run.trial093.stdout:Modify: 2026-02-26 02:38:27.135429492 +0000 2026-02-26T02:44:23.057 INFO:teuthology.orchestra.run.trial093.stdout:Change: 2026-02-26 02:38:27.135429492 +0000 2026-02-26T02:44:23.057 INFO:teuthology.orchestra.run.trial093.stdout: Birth: 2026-02-26 02:38:27.135429492 +0000 2026-02-26T02:44:23.057 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-26T02:44:23.119 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records in 2026-02-26T02:44:23.119 INFO:teuthology.orchestra.run.trial093.stderr:1+0 records out 2026-02-26T02:44:23.119 INFO:teuthology.orchestra.run.trial093.stderr:512 bytes copied, 0.000143025 s, 3.6 MB/s 2026-02-26T02:44:23.121 DEBUG:teuthology.orchestra.run.trial093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-26T02:44:23.177 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:23.178 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:44:23.178 DEBUG:teuthology.orchestra.run.trial130:> dd if=/scratch_devs of=/dev/stdout 2026-02-26T02:44:23.196 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-26T02:44:23.196 DEBUG:teuthology.orchestra.run.trial130:> stat /dev/vg_nvme/lv_1 2026-02-26T02:44:23.250 INFO:teuthology.orchestra.run.trial130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-26T02:44:23.250 INFO:teuthology.orchestra.run.trial130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:23.251 INFO:teuthology.orchestra.run.trial130.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-26T02:44:23.251 INFO:teuthology.orchestra.run.trial130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:23.251 INFO:teuthology.orchestra.run.trial130.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:23.251 INFO:teuthology.orchestra.run.trial130.stdout:Access: 2026-02-26 02:39:14.116048418 +0000 2026-02-26T02:44:23.251 INFO:teuthology.orchestra.run.trial130.stdout:Modify: 2026-02-26 02:38:23.028329187 +0000 2026-02-26T02:44:23.251 INFO:teuthology.orchestra.run.trial130.stdout:Change: 2026-02-26 02:38:23.028329187 +0000 2026-02-26T02:44:23.251 INFO:teuthology.orchestra.run.trial130.stdout: Birth: 2026-02-26 02:38:23.028329187 +0000 2026-02-26T02:44:23.251 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-26T02:44:23.313 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records in 2026-02-26T02:44:23.314 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records out 2026-02-26T02:44:23.314 INFO:teuthology.orchestra.run.trial130.stderr:512 bytes copied, 0.000168684 s, 3.0 MB/s 2026-02-26T02:44:23.315 DEBUG:teuthology.orchestra.run.trial130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-26T02:44:23.371 DEBUG:teuthology.orchestra.run.trial130:> stat /dev/vg_nvme/lv_2 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout:Device: 6h/6d Inode: 1285 Links: 1 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout:Access: 2026-02-26 02:39:14.116048418 +0000 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout:Modify: 2026-02-26 02:38:23.026329251 +0000 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout:Change: 2026-02-26 02:38:23.026329251 +0000 2026-02-26T02:44:23.427 INFO:teuthology.orchestra.run.trial130.stdout: Birth: 2026-02-26 02:38:23.026329251 +0000 2026-02-26T02:44:23.427 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-26T02:44:23.490 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records in 2026-02-26T02:44:23.490 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records out 2026-02-26T02:44:23.490 INFO:teuthology.orchestra.run.trial130.stderr:512 bytes copied, 0.000141694 s, 3.6 MB/s 2026-02-26T02:44:23.491 DEBUG:teuthology.orchestra.run.trial130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-26T02:44:23.548 DEBUG:teuthology.orchestra.run.trial130:> stat /dev/vg_nvme/lv_3 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout:Access: 2026-02-26 02:39:14.116048418 +0000 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout:Modify: 2026-02-26 02:38:23.027329219 +0000 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout:Change: 2026-02-26 02:38:23.027329219 +0000 2026-02-26T02:44:23.604 INFO:teuthology.orchestra.run.trial130.stdout: Birth: 2026-02-26 02:38:23.027329219 +0000 2026-02-26T02:44:23.605 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-26T02:44:23.666 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records in 2026-02-26T02:44:23.666 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records out 2026-02-26T02:44:23.666 INFO:teuthology.orchestra.run.trial130.stderr:512 bytes copied, 0.000154418 s, 3.3 MB/s 2026-02-26T02:44:23.667 DEBUG:teuthology.orchestra.run.trial130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-26T02:44:23.725 DEBUG:teuthology.orchestra.run.trial130:> stat /dev/vg_nvme/lv_4 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout:Device: 6h/6d Inode: 1288 Links: 1 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout:Access: 2026-02-26 02:39:14.117048413 +0000 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout:Modify: 2026-02-26 02:38:23.026329251 +0000 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout:Change: 2026-02-26 02:38:23.026329251 +0000 2026-02-26T02:44:23.781 INFO:teuthology.orchestra.run.trial130.stdout: Birth: 2026-02-26 02:38:23.026329251 +0000 2026-02-26T02:44:23.781 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-26T02:44:23.844 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records in 2026-02-26T02:44:23.844 INFO:teuthology.orchestra.run.trial130.stderr:1+0 records out 2026-02-26T02:44:23.844 INFO:teuthology.orchestra.run.trial130.stderr:512 bytes copied, 0.000144009 s, 3.6 MB/s 2026-02-26T02:44:23.845 DEBUG:teuthology.orchestra.run.trial130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-26T02:44:23.902 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:23.903 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:44:23.903 DEBUG:teuthology.orchestra.run.trial161:> dd if=/scratch_devs of=/dev/stdout 2026-02-26T02:44:23.922 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-26T02:44:23.922 DEBUG:teuthology.orchestra.run.trial161:> stat /dev/vg_nvme/lv_1 2026-02-26T02:44:23.979 INFO:teuthology.orchestra.run.trial161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout:Access: 2026-02-26 02:39:17.477334248 +0000 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout:Modify: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout:Change: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:23.980 INFO:teuthology.orchestra.run.trial161.stdout: Birth: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:23.980 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-26T02:44:24.051 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records in 2026-02-26T02:44:24.052 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records out 2026-02-26T02:44:24.052 INFO:teuthology.orchestra.run.trial161.stderr:512 bytes copied, 0.000169375 s, 3.0 MB/s 2026-02-26T02:44:24.054 DEBUG:teuthology.orchestra.run.trial161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-26T02:44:24.114 DEBUG:teuthology.orchestra.run.trial161:> stat /dev/vg_nvme/lv_2 2026-02-26T02:44:24.171 INFO:teuthology.orchestra.run.trial161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-26T02:44:24.171 INFO:teuthology.orchestra.run.trial161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:24.171 INFO:teuthology.orchestra.run.trial161.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-26T02:44:24.171 INFO:teuthology.orchestra.run.trial161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:24.172 INFO:teuthology.orchestra.run.trial161.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:24.172 INFO:teuthology.orchestra.run.trial161.stdout:Access: 2026-02-26 02:39:17.478334224 +0000 2026-02-26T02:44:24.172 INFO:teuthology.orchestra.run.trial161.stdout:Modify: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:24.172 INFO:teuthology.orchestra.run.trial161.stdout:Change: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:24.172 INFO:teuthology.orchestra.run.trial161.stdout: Birth: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:24.173 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-26T02:44:24.233 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records in 2026-02-26T02:44:24.234 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records out 2026-02-26T02:44:24.234 INFO:teuthology.orchestra.run.trial161.stderr:512 bytes copied, 0.000145581 s, 3.5 MB/s 2026-02-26T02:44:24.235 DEBUG:teuthology.orchestra.run.trial161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-26T02:44:24.292 DEBUG:teuthology.orchestra.run.trial161:> stat /dev/vg_nvme/lv_3 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout:Access: 2026-02-26 02:39:17.478334224 +0000 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout:Modify: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout:Change: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:24.347 INFO:teuthology.orchestra.run.trial161.stdout: Birth: 2026-02-26 02:38:28.570501998 +0000 2026-02-26T02:44:24.348 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-26T02:44:24.410 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records in 2026-02-26T02:44:24.411 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records out 2026-02-26T02:44:24.411 INFO:teuthology.orchestra.run.trial161.stderr:512 bytes copied, 0.000150129 s, 3.4 MB/s 2026-02-26T02:44:24.412 DEBUG:teuthology.orchestra.run.trial161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-26T02:44:24.470 DEBUG:teuthology.orchestra.run.trial161:> stat /dev/vg_nvme/lv_4 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout:Access: 2026-02-26 02:39:17.478334224 +0000 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout:Modify: 2026-02-26 02:38:28.571501975 +0000 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout:Change: 2026-02-26 02:38:28.571501975 +0000 2026-02-26T02:44:24.526 INFO:teuthology.orchestra.run.trial161.stdout: Birth: 2026-02-26 02:38:28.571501975 +0000 2026-02-26T02:44:24.526 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-26T02:44:24.589 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records in 2026-02-26T02:44:24.589 INFO:teuthology.orchestra.run.trial161.stderr:1+0 records out 2026-02-26T02:44:24.590 INFO:teuthology.orchestra.run.trial161.stderr:512 bytes copied, 0.000169094 s, 3.0 MB/s 2026-02-26T02:44:24.592 DEBUG:teuthology.orchestra.run.trial161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-26T02:44:24.648 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:24.648 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:44:24.649 DEBUG:teuthology.orchestra.run.trial192:> dd if=/scratch_devs of=/dev/stdout 2026-02-26T02:44:24.666 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-26T02:44:24.667 DEBUG:teuthology.orchestra.run.trial192:> stat /dev/vg_nvme/lv_1 2026-02-26T02:44:24.724 INFO:teuthology.orchestra.run.trial192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-26T02:44:24.724 INFO:teuthology.orchestra.run.trial192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:24.724 INFO:teuthology.orchestra.run.trial192.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-26T02:44:24.725 INFO:teuthology.orchestra.run.trial192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:24.725 INFO:teuthology.orchestra.run.trial192.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:24.725 INFO:teuthology.orchestra.run.trial192.stdout:Access: 2026-02-26 02:39:16.587357191 +0000 2026-02-26T02:44:24.725 INFO:teuthology.orchestra.run.trial192.stdout:Modify: 2026-02-26 02:38:27.325022954 +0000 2026-02-26T02:44:24.725 INFO:teuthology.orchestra.run.trial192.stdout:Change: 2026-02-26 02:38:27.325022954 +0000 2026-02-26T02:44:24.725 INFO:teuthology.orchestra.run.trial192.stdout: Birth: 2026-02-26 02:38:27.325022954 +0000 2026-02-26T02:44:24.725 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-26T02:44:24.786 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records in 2026-02-26T02:44:24.786 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records out 2026-02-26T02:44:24.786 INFO:teuthology.orchestra.run.trial192.stderr:512 bytes copied, 0.000151062 s, 3.4 MB/s 2026-02-26T02:44:24.788 DEBUG:teuthology.orchestra.run.trial192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-26T02:44:24.846 DEBUG:teuthology.orchestra.run.trial192:> stat /dev/vg_nvme/lv_2 2026-02-26T02:44:24.902 INFO:teuthology.orchestra.run.trial192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-26T02:44:24.902 INFO:teuthology.orchestra.run.trial192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:24.902 INFO:teuthology.orchestra.run.trial192.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-26T02:44:24.903 INFO:teuthology.orchestra.run.trial192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:24.903 INFO:teuthology.orchestra.run.trial192.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:24.903 INFO:teuthology.orchestra.run.trial192.stdout:Access: 2026-02-26 02:39:16.587357191 +0000 2026-02-26T02:44:24.903 INFO:teuthology.orchestra.run.trial192.stdout:Modify: 2026-02-26 02:38:27.324022992 +0000 2026-02-26T02:44:24.903 INFO:teuthology.orchestra.run.trial192.stdout:Change: 2026-02-26 02:38:27.324022992 +0000 2026-02-26T02:44:24.903 INFO:teuthology.orchestra.run.trial192.stdout: Birth: 2026-02-26 02:38:27.324022992 +0000 2026-02-26T02:44:24.903 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-26T02:44:24.965 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records in 2026-02-26T02:44:24.965 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records out 2026-02-26T02:44:24.966 INFO:teuthology.orchestra.run.trial192.stderr:512 bytes copied, 0.000132557 s, 3.9 MB/s 2026-02-26T02:44:24.967 DEBUG:teuthology.orchestra.run.trial192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-26T02:44:25.024 DEBUG:teuthology.orchestra.run.trial192:> stat /dev/vg_nvme/lv_3 2026-02-26T02:44:25.079 INFO:teuthology.orchestra.run.trial192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-26T02:44:25.079 INFO:teuthology.orchestra.run.trial192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:25.079 INFO:teuthology.orchestra.run.trial192.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-26T02:44:25.080 INFO:teuthology.orchestra.run.trial192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:25.080 INFO:teuthology.orchestra.run.trial192.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:25.080 INFO:teuthology.orchestra.run.trial192.stdout:Access: 2026-02-26 02:39:16.587357191 +0000 2026-02-26T02:44:25.080 INFO:teuthology.orchestra.run.trial192.stdout:Modify: 2026-02-26 02:38:27.325022954 +0000 2026-02-26T02:44:25.080 INFO:teuthology.orchestra.run.trial192.stdout:Change: 2026-02-26 02:38:27.325022954 +0000 2026-02-26T02:44:25.080 INFO:teuthology.orchestra.run.trial192.stdout: Birth: 2026-02-26 02:38:27.325022954 +0000 2026-02-26T02:44:25.080 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-26T02:44:25.142 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records in 2026-02-26T02:44:25.142 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records out 2026-02-26T02:44:25.142 INFO:teuthology.orchestra.run.trial192.stderr:512 bytes copied, 0.00014506 s, 3.5 MB/s 2026-02-26T02:44:25.144 DEBUG:teuthology.orchestra.run.trial192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-26T02:44:25.200 DEBUG:teuthology.orchestra.run.trial192:> stat /dev/vg_nvme/lv_4 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout:Context: system_u:object_r:device_t:s0 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout:Access: 2026-02-26 02:39:16.588357166 +0000 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout:Modify: 2026-02-26 02:38:27.324022992 +0000 2026-02-26T02:44:25.257 INFO:teuthology.orchestra.run.trial192.stdout:Change: 2026-02-26 02:38:27.324022992 +0000 2026-02-26T02:44:25.258 INFO:teuthology.orchestra.run.trial192.stdout: Birth: 2026-02-26 02:38:27.324022992 +0000 2026-02-26T02:44:25.258 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-26T02:44:25.319 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records in 2026-02-26T02:44:25.319 INFO:teuthology.orchestra.run.trial192.stderr:1+0 records out 2026-02-26T02:44:25.319 INFO:teuthology.orchestra.run.trial192.stderr:512 bytes copied, 0.000129651 s, 3.9 MB/s 2026-02-26T02:44:25.321 DEBUG:teuthology.orchestra.run.trial192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-26T02:44:25.377 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:25.378 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial130.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial161.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial192.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-26T02:44:25.378 INFO:tasks.ceph:Generating config... 2026-02-26T02:44:25.380 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-26T02:44:25.381 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-26T02:44:25.381 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-26T02:44:25.381 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-26T02:44:25.381 INFO:tasks.ceph:[global] ms type = async 2026-02-26T02:44:25.381 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-26T02:44:25.381 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-26T02:44:25.381 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-26T02:44:25.381 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-26T02:44:25.382 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-26T02:44:25.383 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-26T02:44:25.384 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-26T02:44:25.385 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-26T02:44:25.385 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-26T02:44:25.385 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-26T02:44:25.385 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-26T02:44:25.385 INFO:tasks.ceph:[osd] osd_class_default_list = * 2026-02-26T02:44:25.385 INFO:tasks.ceph:[osd] osd_class_load_list = * 2026-02-26T02:44:25.385 INFO:tasks.ceph:Setting up mon.a... 2026-02-26T02:44:25.385 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-26T02:44:25.422 INFO:teuthology.orchestra.run.trial093.stdout:creating /etc/ceph/ceph.keyring 2026-02-26T02:44:25.424 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-26T02:44:25.502 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-26T02:44:25.566 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.93:6789]'), ('mon.b', '[v1:10.20.193.130:6789]'), ('mon.c', '[v1:10.20.193.161:6789]')] 2026-02-26T02:44:25.567 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.93:6789],[v1:10.20.193.130:6789],[v1:10.20.193.161:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_class_default_list': '*', 'osd_class_load_list': '*'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-26T02:44:25.568 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:25.568 DEBUG:teuthology.orchestra.run.trial093:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-26T02:44:25.622 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.93:6789]' --addv b '[v1:10.20.193.130:6789]' --addv c '[v1:10.20.193.161:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:monmaptool: generated fsid 51abe019-1bbf-44c1-9d15-783dc1e2d8fe 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:setting min_mon_release = quincy 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:epoch 0 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:fsid 51abe019-1bbf-44c1-9d15-783dc1e2d8fe 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:last_changed 2026-02-26T02:44:25.694903+0000 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:created 2026-02-26T02:44:25.694903+0000 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:min_mon_release 17 (quincy) 2026-02-26T02:44:25.695 INFO:teuthology.orchestra.run.trial093.stdout:election_strategy: 1 2026-02-26T02:44:25.696 INFO:teuthology.orchestra.run.trial093.stdout:0: v1:10.20.193.93:6789/0 mon.a 2026-02-26T02:44:25.696 INFO:teuthology.orchestra.run.trial093.stdout:1: v1:10.20.193.130:6789/0 mon.b 2026-02-26T02:44:25.696 INFO:teuthology.orchestra.run.trial093.stdout:2: v1:10.20.193.161:6789/0 mon.c 2026-02-26T02:44:25.696 INFO:teuthology.orchestra.run.trial093.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-26T02:44:25.696 DEBUG:teuthology.orchestra.run.trial093:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-26T02:44:25.753 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 51abe019-1bbf-44c1-9d15-783dc1e2d8fe... 2026-02-26T02:44:25.754 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-26T02:44:25.795 DEBUG:teuthology.orchestra.run.trial130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-26T02:44:25.798 DEBUG:teuthology.orchestra.run.trial161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-26T02:44:25.800 DEBUG:teuthology.orchestra.run.trial192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-26T02:44:25.832 INFO:teuthology.orchestra.run.trial093.stdout:[global] 2026-02-26T02:44:25.833 INFO:teuthology.orchestra.run.trial093.stdout: chdir = "" 2026-02-26T02:44:25.833 INFO:teuthology.orchestra.run.trial093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-26T02:44:25.833 INFO:teuthology.orchestra.run.trial093.stdout: auth supported = cephx 2026-02-26T02:44:25.833 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.833 INFO:teuthology.orchestra.run.trial093.stdout: filestore xattr use omap = true 2026-02-26T02:44:25.833 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: mon clock drift allowed = 1.000 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: osd crush chooseleaf type = 0 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: auth debug = true 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: ms die on old message = true 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: ms die on bug = true 2026-02-26T02:44:25.834 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: mon pg warn max object skew = 0 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: # disable pg_autoscaler by default for new pools 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: osd pool default size = 2 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: mon osd allow primary affinity = true 2026-02-26T02:44:25.835 INFO:teuthology.orchestra.run.trial093.stdout: mon osd allow pg remap = true 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on legacy crush tunables = false 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on crush straw calc version zero = false 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on no sortbitwise = false 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on osd down out interval zero = false 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon warn on too few osds = false 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: mon_allow_pool_size_one = true 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.836 INFO:teuthology.orchestra.run.trial093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: osd default data pool replay window = 5 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: mon allow pool delete = true 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: mon cluster log file level = debug 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: debug asserts on shutdown = true 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: mon health detail to clog = false 2026-02-26T02:44:25.837 INFO:teuthology.orchestra.run.trial093.stdout: mon host = "[v1:10.20.193.93:6789],[v1:10.20.193.130:6789],[v1:10.20.193.161:6789]" 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: mon client directed command retry = 5 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: mon election default strategy = 1 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: ms bind msgr2 = False 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: ms inject socket failures = 5000 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: ms type = async 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: osd heartbeat grace = 160 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: osd op thread timeout = 150 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: fsid = 51abe019-1bbf-44c1-9d15-783dc1e2d8fe 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.838 INFO:teuthology.orchestra.run.trial093.stdout:[osd] 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd journal size = 100 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd scrub load threshold = 5.0 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd scrub max interval = 600 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd mclock profile = high_recovery_ops 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd recover clone overlap = true 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd recovery max chunk = 1048576 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd debug shutdown = true 2026-02-26T02:44:25.839 INFO:teuthology.orchestra.run.trial093.stdout: osd debug op order = true 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: osd debug verify stray on activate = true 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: osd debug trim objects = true 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: osd open classes on start = true 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: osd debug pg log writeout = true 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: osd deep scrub update digest min age = 30 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: osd map max advance = 10 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.840 INFO:teuthology.orchestra.run.trial093.stdout: journal zero on create = true 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: filestore ondisk finisher threads = 3 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: filestore apply finisher threads = 3 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: bdev debug aio = true 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: osd debug misdirected ops = true 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: bluestore block size = 96636764160 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: bluestore compression algorithm = zstd 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: bluestore compression mode = aggressive 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: bluestore fsck on mount = True 2026-02-26T02:44:25.841 INFO:teuthology.orchestra.run.trial093.stdout: bluestore zero block detection = True 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: debug bluefs = 1 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: debug bluestore = 1 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: debug monc = 20 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: debug osd = 20 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: debug rocksdb = 10 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: mon osd backfillfull_ratio = 0.85 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: mon osd full ratio = 0.9 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: mon osd nearfull ratio = 0.8 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: osd debug verify cached snaps = True 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: osd debug verify missing on start = True 2026-02-26T02:44:25.842 INFO:teuthology.orchestra.run.trial093.stdout: osd failsafe full ratio = 0.95 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd fast shutdown = False 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd mclock override recovery settings = True 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd objectstore = bluestore 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd op queue = debug_random 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd op queue cut off = debug_random 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd shutdown pgref assert = True 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd_class_default_list = * 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: osd_class_load_list = * 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout:[mgr] 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-26T02:44:25.843 INFO:teuthology.orchestra.run.trial093.stdout: debug mgr = 20 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: debug mon = 20 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: debug auth = 20 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: mgr/telemetry/nag = false 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout:[mon] 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: debug ms = 1 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: debug mon = 20 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: debug paxos = 20 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: debug auth = 20 2026-02-26T02:44:25.844 INFO:teuthology.orchestra.run.trial093.stdout: mon data avail warn = 5 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: mon mgr mkfs grace = 240 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: mon osd reporter subtree level = osd 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: mon osd prime pg temp = true 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: auth mon ticket ttl = 660 # 11m 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: auth service ticket ttl = 240 # 4m 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: # don't complain about insecure global_id in the test suite 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-26T02:44:25.845 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: # 1m isn't quite enough 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon_down_mkfs_grace = 2m 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon_warn_on_filestore_osds = false 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon min osdmap epochs = 50 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon osd crush smoke test = False 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon osdmap full prune interval = 2 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon osdmap full prune min = 15 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon osdmap full prune txsize = 2 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: mon scrub interval = 300 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: paxos service trim min = 10 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:44:25.846 INFO:teuthology.orchestra.run.trial093.stdout:[client] 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout: rgw cache enabled = true 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout: rgw enable ops log = true 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout: rgw enable usage log = true 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout:[mon.a] 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout:[mon.b] 2026-02-26T02:44:25.847 INFO:teuthology.orchestra.run.trial093.stdout:[mon.c] 2026-02-26T02:44:25.848 INFO:teuthology.orchestra.run.trial192.stdout:[global] 2026-02-26T02:44:25.848 INFO:teuthology.orchestra.run.trial192.stdout: chdir = "" 2026-02-26T02:44:25.848 INFO:teuthology.orchestra.run.trial192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-26T02:44:25.848 INFO:teuthology.orchestra.run.trial192.stdout: auth supported = cephx 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: filestore xattr use omap = true 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: mon clock drift allowed = 1.000 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: osd crush chooseleaf type = 0 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: auth debug = true 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: ms die on old message = true 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: ms die on bug = true 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-26T02:44:25.849 INFO:teuthology.orchestra.run.trial192.stdout: mon pg warn max object skew = 0 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: # disable pg_autoscaler by default for new pools 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: osd pool default size = 2 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: mon osd allow primary affinity = true 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: mon osd allow pg remap = true 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: mon warn on legacy crush tunables = false 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: mon warn on crush straw calc version zero = false 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: mon warn on no sortbitwise = false 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: mon warn on osd down out interval zero = false 2026-02-26T02:44:25.850 INFO:teuthology.orchestra.run.trial192.stdout: mon warn on too few osds = false 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: mon_allow_pool_size_one = true 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: osd default data pool replay window = 5 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: mon allow pool delete = true 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: mon cluster log file level = debug 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: debug asserts on shutdown = true 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: mon health detail to clog = false 2026-02-26T02:44:25.851 INFO:teuthology.orchestra.run.trial192.stdout: mon host = "[v1:10.20.193.93:6789],[v1:10.20.193.130:6789],[v1:10.20.193.161:6789]" 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: mon client directed command retry = 5 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: mon election default strategy = 1 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: ms bind msgr2 = False 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: ms inject socket failures = 5000 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: ms type = async 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: osd heartbeat grace = 160 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: osd op thread timeout = 150 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: fsid = 51abe019-1bbf-44c1-9d15-783dc1e2d8fe 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout:[osd] 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: osd journal size = 100 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: osd scrub load threshold = 5.0 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: osd scrub max interval = 600 2026-02-26T02:44:25.852 INFO:teuthology.orchestra.run.trial192.stdout: osd mclock profile = high_recovery_ops 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd recover clone overlap = true 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd recovery max chunk = 1048576 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd debug shutdown = true 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd debug op order = true 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd debug verify stray on activate = true 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd debug trim objects = true 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd open classes on start = true 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd debug pg log writeout = true 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd deep scrub update digest min age = 30 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.853 INFO:teuthology.orchestra.run.trial192.stdout: osd map max advance = 10 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: journal zero on create = true 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: filestore ondisk finisher threads = 3 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: filestore apply finisher threads = 3 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: bdev debug aio = true 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: osd debug misdirected ops = true 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: bluestore block size = 96636764160 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: bluestore compression algorithm = zstd 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: bluestore compression mode = aggressive 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: bluestore fsck on mount = True 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: bluestore zero block detection = True 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: debug bluefs = 1 2026-02-26T02:44:25.854 INFO:teuthology.orchestra.run.trial192.stdout: debug bluestore = 1 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: debug monc = 20 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: debug ms = 1 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: debug osd = 20 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: debug rocksdb = 10 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: mon osd backfillfull_ratio = 0.85 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: mon osd full ratio = 0.9 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: mon osd nearfull ratio = 0.8 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd debug verify cached snaps = True 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd debug verify missing on start = True 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd failsafe full ratio = 0.95 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd fast shutdown = False 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd mclock override recovery settings = True 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd objectstore = bluestore 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd op queue = debug_random 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd op queue cut off = debug_random 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd shutdown pgref assert = True 2026-02-26T02:44:25.855 INFO:teuthology.orchestra.run.trial192.stdout: osd_class_default_list = * 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: osd_class_load_list = * 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout:[mgr] 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: debug ms = 1 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: debug mgr = 20 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: debug mon = 20 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: debug auth = 20 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: mgr/telemetry/nag = false 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout:[mon] 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: debug ms = 1 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: debug mon = 20 2026-02-26T02:44:25.856 INFO:teuthology.orchestra.run.trial192.stdout: debug paxos = 20 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: debug auth = 20 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon data avail warn = 5 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon mgr mkfs grace = 240 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon osd reporter subtree level = osd 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon osd prime pg temp = true 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: auth mon ticket ttl = 660 # 11m 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: auth service ticket ttl = 240 # 4m 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: # don't complain about insecure global_id in the test suite 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.857 INFO:teuthology.orchestra.run.trial192.stdout: # 1m isn't quite enough 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon_down_mkfs_grace = 2m 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon_warn_on_filestore_osds = false 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon min osdmap epochs = 50 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon osd crush smoke test = False 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon osdmap full prune interval = 2 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon osdmap full prune min = 15 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon osdmap full prune txsize = 2 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: mon scrub interval = 300 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: paxos service trim min = 10 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout:[client] 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: rgw cache enabled = true 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: rgw enable ops log = true 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: rgw enable usage log = true 2026-02-26T02:44:25.858 INFO:teuthology.orchestra.run.trial192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial192.stdout:[mon.a] 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial192.stdout:[mon.b] 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial192.stdout:[mon.c] 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout:[global] 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: chdir = "" 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: auth supported = cephx 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: filestore xattr use omap = true 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: mon clock drift allowed = 1.000 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: osd crush chooseleaf type = 0 2026-02-26T02:44:25.859 INFO:teuthology.orchestra.run.trial161.stdout: auth debug = true 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: ms die on old message = true 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: ms die on bug = true 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: mon pg warn max object skew = 0 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: # disable pg_autoscaler by default for new pools 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: osd pool default size = 2 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: mon osd allow primary affinity = true 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: mon osd allow pg remap = true 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: mon warn on legacy crush tunables = false 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: mon warn on crush straw calc version zero = false 2026-02-26T02:44:25.860 INFO:teuthology.orchestra.run.trial161.stdout: mon warn on no sortbitwise = false 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon warn on osd down out interval zero = false 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon warn on too few osds = false 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon_allow_pool_size_one = true 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: osd default data pool replay window = 5 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon allow pool delete = true 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon cluster log file level = debug 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: debug asserts on shutdown = true 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon health detail to clog = false 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon host = "[v1:10.20.193.93:6789],[v1:10.20.193.130:6789],[v1:10.20.193.161:6789]" 2026-02-26T02:44:25.861 INFO:teuthology.orchestra.run.trial161.stdout: mon client directed command retry = 5 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: mon election default strategy = 1 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: ms bind msgr2 = False 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: ms inject socket failures = 5000 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: ms type = async 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd heartbeat grace = 160 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd op thread timeout = 150 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: fsid = 51abe019-1bbf-44c1-9d15-783dc1e2d8fe 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout:[osd] 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd journal size = 100 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd scrub load threshold = 5.0 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd scrub max interval = 600 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd mclock profile = high_recovery_ops 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd recover clone overlap = true 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: osd recovery max chunk = 1048576 2026-02-26T02:44:25.862 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd debug shutdown = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd debug op order = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd debug verify stray on activate = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd debug trim objects = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd open classes on start = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd debug pg log writeout = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd deep scrub update digest min age = 30 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd map max advance = 10 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: journal zero on create = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: filestore ondisk finisher threads = 3 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: filestore apply finisher threads = 3 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: bdev debug aio = true 2026-02-26T02:44:25.863 INFO:teuthology.orchestra.run.trial161.stdout: osd debug misdirected ops = true 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: bluestore block size = 96636764160 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: bluestore compression algorithm = zstd 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: bluestore compression mode = aggressive 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: bluestore fsck on mount = True 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: bluestore zero block detection = True 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: debug bluefs = 1 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: debug bluestore = 1 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: debug monc = 20 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: debug ms = 1 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: debug osd = 20 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: debug rocksdb = 10 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: mon osd backfillfull_ratio = 0.85 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: mon osd full ratio = 0.9 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: mon osd nearfull ratio = 0.8 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: osd debug verify cached snaps = True 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: osd debug verify missing on start = True 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: osd failsafe full ratio = 0.95 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: osd fast shutdown = False 2026-02-26T02:44:25.864 INFO:teuthology.orchestra.run.trial161.stdout: osd mclock override recovery settings = True 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: osd objectstore = bluestore 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: osd op queue = debug_random 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: osd op queue cut off = debug_random 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: osd shutdown pgref assert = True 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: osd_class_default_list = * 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: osd_class_load_list = * 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout:[mgr] 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: debug ms = 1 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: debug mgr = 20 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: debug mon = 20 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: debug auth = 20 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: mgr/telemetry/nag = false 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout:[mon] 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: debug ms = 1 2026-02-26T02:44:25.865 INFO:teuthology.orchestra.run.trial161.stdout: debug mon = 20 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: debug paxos = 20 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: debug auth = 20 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon data avail warn = 5 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon mgr mkfs grace = 240 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon osd reporter subtree level = osd 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon osd prime pg temp = true 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: auth mon ticket ttl = 660 # 11m 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: auth service ticket ttl = 240 # 4m 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: # don't complain about insecure global_id in the test suite 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: # 1m isn't quite enough 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: mon_down_mkfs_grace = 2m 2026-02-26T02:44:25.866 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: mon_warn_on_filestore_osds = false 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: mon min osdmap epochs = 50 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: mon osd crush smoke test = False 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: mon osdmap full prune interval = 2 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: mon osdmap full prune min = 15 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: mon osdmap full prune txsize = 2 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: mon scrub interval = 300 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: paxos service trim min = 10 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout:[client] 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: rgw cache enabled = true 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: rgw enable ops log = true 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: rgw enable usage log = true 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout:[mon.a] 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout:[mon.b] 2026-02-26T02:44:25.867 INFO:teuthology.orchestra.run.trial161.stdout:[mon.c] 2026-02-26T02:44:25.868 INFO:teuthology.orchestra.run.trial130.stdout:[global] 2026-02-26T02:44:25.868 INFO:teuthology.orchestra.run.trial130.stdout: chdir = "" 2026-02-26T02:44:25.868 INFO:teuthology.orchestra.run.trial130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: auth supported = cephx 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: filestore xattr use omap = true 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: mon clock drift allowed = 1.000 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: osd crush chooseleaf type = 0 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: auth debug = true 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: ms die on old message = true 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: ms die on bug = true 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: mon pg warn max object skew = 0 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: # disable pg_autoscaler by default for new pools 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: osd pool default size = 2 2026-02-26T02:44:25.869 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon osd allow primary affinity = true 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon osd allow pg remap = true 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon warn on legacy crush tunables = false 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon warn on crush straw calc version zero = false 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon warn on no sortbitwise = false 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon warn on osd down out interval zero = false 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon warn on too few osds = false 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon_allow_pool_size_one = true 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: osd default data pool replay window = 5 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon allow pool delete = true 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon cluster log file level = debug 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: debug asserts on shutdown = true 2026-02-26T02:44:25.870 INFO:teuthology.orchestra.run.trial130.stdout: mon health detail to clog = false 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: mon host = "[v1:10.20.193.93:6789],[v1:10.20.193.130:6789],[v1:10.20.193.161:6789]" 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: mon client directed command retry = 5 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: mon election default strategy = 1 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: ms bind msgr2 = False 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: ms inject socket failures = 5000 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: ms type = async 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd heartbeat grace = 160 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd op thread timeout = 150 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: fsid = 51abe019-1bbf-44c1-9d15-783dc1e2d8fe 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout:[osd] 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd journal size = 100 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd scrub load threshold = 5.0 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd scrub max interval = 600 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd mclock profile = high_recovery_ops 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd recover clone overlap = true 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd recovery max chunk = 1048576 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.871 INFO:teuthology.orchestra.run.trial130.stdout: osd debug shutdown = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd debug op order = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd debug verify stray on activate = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd debug trim objects = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd open classes on start = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd debug pg log writeout = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd deep scrub update digest min age = 30 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd map max advance = 10 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: journal zero on create = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: filestore ondisk finisher threads = 3 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: filestore apply finisher threads = 3 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: bdev debug aio = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: osd debug misdirected ops = true 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: bluestore block size = 96636764160 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: bluestore compression algorithm = zstd 2026-02-26T02:44:25.872 INFO:teuthology.orchestra.run.trial130.stdout: bluestore compression mode = aggressive 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: bluestore fsck on mount = True 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: bluestore zero block detection = True 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: debug bluefs = 1 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: debug bluestore = 1 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: debug monc = 20 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: debug ms = 1 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: debug osd = 20 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: debug rocksdb = 10 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: mon osd backfillfull_ratio = 0.85 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: mon osd full ratio = 0.9 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: mon osd nearfull ratio = 0.8 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd debug verify cached snaps = True 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd debug verify missing on start = True 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd failsafe full ratio = 0.95 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd fast shutdown = False 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd mclock override recovery settings = True 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd objectstore = bluestore 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd op queue = debug_random 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd op queue cut off = debug_random 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd shutdown pgref assert = True 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd_class_default_list = * 2026-02-26T02:44:25.873 INFO:teuthology.orchestra.run.trial130.stdout: osd_class_load_list = * 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout:[mgr] 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug ms = 1 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug mgr = 20 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug mon = 20 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug auth = 20 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mgr/telemetry/nag = false 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout:[mon] 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug ms = 1 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug mon = 20 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug paxos = 20 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: debug auth = 20 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon data avail warn = 5 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon mgr mkfs grace = 240 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon reweight min pgs per osd = 4 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon osd reporter subtree level = osd 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon osd prime pg temp = true 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: mon reweight min bytes per osd = 10 2026-02-26T02:44:25.874 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: auth mon ticket ttl = 660 # 11m 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: auth service ticket ttl = 240 # 4m 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: # don't complain about insecure global_id in the test suite 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: # 1m isn't quite enough 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon_down_mkfs_grace = 2m 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon_warn_on_filestore_osds = false 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon min osdmap epochs = 50 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon osd crush smoke test = False 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon osdmap full prune interval = 2 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon osdmap full prune min = 15 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon osdmap full prune txsize = 2 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: mon scrub interval = 300 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: paxos service trim min = 10 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout:[client] 2026-02-26T02:44:25.875 INFO:teuthology.orchestra.run.trial130.stdout: rgw cache enabled = true 2026-02-26T02:44:25.876 INFO:teuthology.orchestra.run.trial130.stdout: rgw enable ops log = true 2026-02-26T02:44:25.876 INFO:teuthology.orchestra.run.trial130.stdout: rgw enable usage log = true 2026-02-26T02:44:25.876 INFO:teuthology.orchestra.run.trial130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-26T02:44:25.876 INFO:teuthology.orchestra.run.trial130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-26T02:44:25.876 INFO:teuthology.orchestra.run.trial130.stdout:[mon.a] 2026-02-26T02:44:25.876 INFO:teuthology.orchestra.run.trial130.stdout:[mon.b] 2026-02-26T02:44:25.876 INFO:teuthology.orchestra.run.trial130.stdout:[mon.c] 2026-02-26T02:44:25.877 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-26T02:44:25.877 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-26T02:44:25.951 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-26T02:44:25.951 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:25.951 DEBUG:teuthology.orchestra.run.trial093:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-26T02:44:26.008 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:26.008 DEBUG:teuthology.orchestra.run.trial093:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-26T02:44:26.064 INFO:tasks.ceph:Sending monmap to node ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:44:26.065 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:26.065 DEBUG:teuthology.orchestra.run.trial093:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-26T02:44:26.065 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-26T02:44:26.136 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:44:26.137 DEBUG:teuthology.orchestra.run.trial093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:26.193 INFO:tasks.ceph:Sending monmap to node ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:44:26.194 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:44:26.194 DEBUG:teuthology.orchestra.run.trial130:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-26T02:44:26.194 DEBUG:teuthology.orchestra.run.trial130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-26T02:44:26.228 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:44:26.229 DEBUG:teuthology.orchestra.run.trial130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:26.285 INFO:tasks.ceph:Sending monmap to node ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:44:26.285 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:44:26.285 DEBUG:teuthology.orchestra.run.trial161:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-26T02:44:26.285 DEBUG:teuthology.orchestra.run.trial161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-26T02:44:26.318 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:44:26.318 DEBUG:teuthology.orchestra.run.trial161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:26.373 INFO:tasks.ceph:Sending monmap to node ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:44:26.373 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:44:26.374 DEBUG:teuthology.orchestra.run.trial192:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-26T02:44:26.374 DEBUG:teuthology.orchestra.run.trial192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-26T02:44:26.408 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:44:26.408 DEBUG:teuthology.orchestra.run.trial192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:26.464 INFO:tasks.ceph:Setting up mon nodes... 2026-02-26T02:44:26.464 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-26T02:44:26.464 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-26T02:44:26.509 INFO:teuthology.orchestra.run.trial093.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-26T02:44:26.512 DEBUG:teuthology.orchestra.run.trial192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-26T02:44:26.555 INFO:teuthology.orchestra.run.trial192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-26T02:44:26.558 INFO:tasks.ceph:Setting up mds nodes... 2026-02-26T02:44:26.558 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-26T02:44:26.558 DEBUG:teuthology.orchestra.run.trial192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-26T02:44:26.632 INFO:teuthology.orchestra.run.trial192.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-26T02:44:26.642 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-26T02:44:26.643 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial130.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial161.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial192.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-26T02:44:26.643 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-26T02:44:26.670 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:26.670 INFO:tasks.ceph:role: osd.0 2026-02-26T02:44:26.670 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:44:26.670 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-26T02:44:26.734 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:26.735 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:27.308 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-26T02:44:27.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-26T02:44:27.310 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-26T02:44:27.379 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-26T02:44:27.451 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-26T02:44:27.515 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:27.515 INFO:tasks.ceph:role: osd.4 2026-02-26T02:44:27.515 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:44:27.515 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-26T02:44:27.580 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:27.580 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:27.580 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:27.580 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:27.580 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:27.581 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:27.581 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:27.581 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:27.581 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:27.581 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:28.150 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-26T02:44:28.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-26T02:44:28.152 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-26T02:44:28.219 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-26T02:44:28.286 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-26T02:44:28.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:28.350 INFO:tasks.ceph:role: osd.8 2026-02-26T02:44:28.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:44:28.350 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:28.414 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:28.971 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-26T02:44:28.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-26T02:44:28.973 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-26T02:44:29.041 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-26T02:44:29.108 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-26T02:44:29.173 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:29.174 INFO:tasks.ceph:role: osd.12 2026-02-26T02:44:29.174 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:44:29.174 DEBUG:teuthology.orchestra.run.trial093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:29.238 INFO:teuthology.orchestra.run.trial093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:29.793 INFO:teuthology.orchestra.run.trial093.stdout:Discarding blocks...Done. 2026-02-26T02:44:29.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial093.front.sepia.ceph.com -o noatime 2026-02-26T02:44:29.795 DEBUG:teuthology.orchestra.run.trial093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-26T02:44:29.871 DEBUG:teuthology.orchestra.run.trial093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-26T02:44:29.938 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:30.018 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:30.015+0000 7f94c939c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-26T02:44:30.018 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:30.016+0000 7f94c939c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-26T02:44:30.018 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:30.016+0000 7f94c939c780 -1 bdev(0x555b816d7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:30.018 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:30.016+0000 7f94c939c780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-26T02:44:32.909 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-26T02:44:32.974 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:33.051 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:33.050+0000 7f39e3cd9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-26T02:44:33.052 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:33.050+0000 7f39e3cd9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-26T02:44:33.052 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:33.050+0000 7f39e3cd9780 -1 bdev(0x556ecb60f800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:33.052 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:33.050+0000 7f39e3cd9780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-26T02:44:35.959 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-26T02:44:36.026 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:36.104 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:36.102+0000 7f49abe0c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-26T02:44:36.104 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:36.102+0000 7f49abe0c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-26T02:44:36.104 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:36.102+0000 7f49abe0c780 -1 bdev(0x5616125a5800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:36.105 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:36.102+0000 7f49abe0c780 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-26T02:44:39.259 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-26T02:44:39.325 DEBUG:teuthology.orchestra.run.trial093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:39.403 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:39.401+0000 7fa1c12b2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-26T02:44:39.404 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:39.401+0000 7fa1c12b2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-26T02:44:39.404 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:39.401+0000 7fa1c12b2780 -1 bdev(0x561b6f963800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:39.404 INFO:teuthology.orchestra.run.trial093.stderr:2026-02-26T02:44:39.401+0000 7fa1c12b2780 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-26T02:44:42.542 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-26T02:44:42.607 DEBUG:teuthology.orchestra.run.trial130:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-26T02:44:42.633 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:42.634 INFO:tasks.ceph:role: osd.1 2026-02-26T02:44:42.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:44:42.634 DEBUG:teuthology.orchestra.run.trial130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-26T02:44:42.698 INFO:teuthology.orchestra.run.trial130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:42.699 INFO:teuthology.orchestra.run.trial130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:43.267 INFO:teuthology.orchestra.run.trial130.stdout:Discarding blocks...Done. 2026-02-26T02:44:43.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial130.front.sepia.ceph.com -o noatime 2026-02-26T02:44:43.269 DEBUG:teuthology.orchestra.run.trial130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-26T02:44:43.338 DEBUG:teuthology.orchestra.run.trial130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-26T02:44:43.406 DEBUG:teuthology.orchestra.run.trial130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-26T02:44:43.471 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:43.472 INFO:tasks.ceph:role: osd.5 2026-02-26T02:44:43.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:44:43.472 DEBUG:teuthology.orchestra.run.trial130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-26T02:44:43.536 INFO:teuthology.orchestra.run.trial130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:43.536 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:43.537 INFO:teuthology.orchestra.run.trial130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:44.093 INFO:teuthology.orchestra.run.trial130.stdout:Discarding blocks...Done. 2026-02-26T02:44:44.094 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial130.front.sepia.ceph.com -o noatime 2026-02-26T02:44:44.094 DEBUG:teuthology.orchestra.run.trial130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-26T02:44:44.167 DEBUG:teuthology.orchestra.run.trial130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-26T02:44:44.234 DEBUG:teuthology.orchestra.run.trial130:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-26T02:44:44.298 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:44.298 INFO:tasks.ceph:role: osd.9 2026-02-26T02:44:44.298 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:44:44.299 DEBUG:teuthology.orchestra.run.trial130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:44.363 INFO:teuthology.orchestra.run.trial130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:44.920 INFO:teuthology.orchestra.run.trial130.stdout:Discarding blocks...Done. 2026-02-26T02:44:44.922 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial130.front.sepia.ceph.com -o noatime 2026-02-26T02:44:44.922 DEBUG:teuthology.orchestra.run.trial130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-26T02:44:44.990 DEBUG:teuthology.orchestra.run.trial130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-26T02:44:45.058 DEBUG:teuthology.orchestra.run.trial130:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-26T02:44:45.122 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:45.122 INFO:tasks.ceph:role: osd.13 2026-02-26T02:44:45.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:44:45.123 DEBUG:teuthology.orchestra.run.trial130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:45.188 INFO:teuthology.orchestra.run.trial130.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:45.189 INFO:teuthology.orchestra.run.trial130.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:45.189 INFO:teuthology.orchestra.run.trial130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:45.742 INFO:teuthology.orchestra.run.trial130.stdout:Discarding blocks...Done. 2026-02-26T02:44:45.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial130.front.sepia.ceph.com -o noatime 2026-02-26T02:44:45.744 DEBUG:teuthology.orchestra.run.trial130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-26T02:44:45.820 DEBUG:teuthology.orchestra.run.trial130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-26T02:44:45.887 DEBUG:teuthology.orchestra.run.trial130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:45.967 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:45.964+0000 7f790bc2f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-26T02:44:45.967 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:45.964+0000 7f790bc2f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-26T02:44:45.967 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:45.964+0000 7f790bc2f780 -1 bdev(0x55787882f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:45.967 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:45.965+0000 7f790bc2f780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-26T02:44:49.113 DEBUG:teuthology.orchestra.run.trial130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-26T02:44:49.179 DEBUG:teuthology.orchestra.run.trial130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:49.259 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:49.257+0000 7f378fa11780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-26T02:44:49.260 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:49.257+0000 7f378fa11780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-26T02:44:49.260 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:49.257+0000 7f378fa11780 -1 bdev(0x56202fe11800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:49.260 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:49.257+0000 7f378fa11780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-26T02:44:52.163 DEBUG:teuthology.orchestra.run.trial130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-26T02:44:52.229 DEBUG:teuthology.orchestra.run.trial130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:52.308 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:52.305+0000 7fd4f25d2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-26T02:44:52.308 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:52.305+0000 7fd4f25d2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-26T02:44:52.308 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:52.305+0000 7fd4f25d2780 -1 bdev(0x558299d53800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:52.308 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:52.306+0000 7fd4f25d2780 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-26T02:44:55.206 DEBUG:teuthology.orchestra.run.trial130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-26T02:44:55.272 DEBUG:teuthology.orchestra.run.trial130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:44:55.352 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:55.351+0000 7fbf8b00f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-26T02:44:55.353 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:55.351+0000 7fbf8b00f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-26T02:44:55.353 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:55.351+0000 7fbf8b00f780 -1 bdev(0x55de0ab05800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-26T02:44:55.353 INFO:teuthology.orchestra.run.trial130.stderr:2026-02-26T02:44:55.351+0000 7fbf8b00f780 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-26T02:44:58.755 DEBUG:teuthology.orchestra.run.trial130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-26T02:44:58.821 DEBUG:teuthology.orchestra.run.trial161:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-26T02:44:58.847 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:58.847 INFO:tasks.ceph:role: osd.2 2026-02-26T02:44:58.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:44:58.847 DEBUG:teuthology.orchestra.run.trial161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-26T02:44:58.912 INFO:teuthology.orchestra.run.trial161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:58.912 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:58.912 INFO:teuthology.orchestra.run.trial161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:58.912 INFO:teuthology.orchestra.run.trial161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:58.912 INFO:teuthology.orchestra.run.trial161.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:58.912 INFO:teuthology.orchestra.run.trial161.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:58.913 INFO:teuthology.orchestra.run.trial161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:58.913 INFO:teuthology.orchestra.run.trial161.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:58.913 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:58.913 INFO:teuthology.orchestra.run.trial161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:44:59.484 INFO:teuthology.orchestra.run.trial161.stdout:Discarding blocks...Done. 2026-02-26T02:44:59.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial161.front.sepia.ceph.com -o noatime 2026-02-26T02:44:59.487 DEBUG:teuthology.orchestra.run.trial161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-26T02:44:59.555 DEBUG:teuthology.orchestra.run.trial161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-26T02:44:59.622 DEBUG:teuthology.orchestra.run.trial161:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-26T02:44:59.686 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-26T02:44:59.686 INFO:tasks.ceph:role: osd.6 2026-02-26T02:44:59.686 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:44:59.686 DEBUG:teuthology.orchestra.run.trial161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-26T02:44:59.751 INFO:teuthology.orchestra.run.trial161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:44:59.751 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:44:59.751 INFO:teuthology.orchestra.run.trial161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:44:59.752 INFO:teuthology.orchestra.run.trial161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:44:59.752 INFO:teuthology.orchestra.run.trial161.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:44:59.752 INFO:teuthology.orchestra.run.trial161.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:44:59.752 INFO:teuthology.orchestra.run.trial161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:44:59.752 INFO:teuthology.orchestra.run.trial161.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:44:59.752 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:44:59.752 INFO:teuthology.orchestra.run.trial161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:45:00.312 INFO:teuthology.orchestra.run.trial161.stdout:Discarding blocks...Done. 2026-02-26T02:45:00.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial161.front.sepia.ceph.com -o noatime 2026-02-26T02:45:00.313 DEBUG:teuthology.orchestra.run.trial161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-26T02:45:00.380 DEBUG:teuthology.orchestra.run.trial161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-26T02:45:00.446 DEBUG:teuthology.orchestra.run.trial161:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-26T02:45:00.511 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-26T02:45:00.511 INFO:tasks.ceph:role: osd.10 2026-02-26T02:45:00.511 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:45:00.511 DEBUG:teuthology.orchestra.run.trial161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:45:00.576 INFO:teuthology.orchestra.run.trial161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:45:01.136 INFO:teuthology.orchestra.run.trial161.stdout:Discarding blocks...Done. 2026-02-26T02:45:01.138 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial161.front.sepia.ceph.com -o noatime 2026-02-26T02:45:01.138 DEBUG:teuthology.orchestra.run.trial161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-26T02:45:01.220 DEBUG:teuthology.orchestra.run.trial161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-26T02:45:01.287 DEBUG:teuthology.orchestra.run.trial161:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-26T02:45:01.351 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-26T02:45:01.351 INFO:tasks.ceph:role: osd.14 2026-02-26T02:45:01.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:45:01.351 DEBUG:teuthology.orchestra.run.trial161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:45:01.416 INFO:teuthology.orchestra.run.trial161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:45:01.973 INFO:teuthology.orchestra.run.trial161.stdout:Discarding blocks...Done. 2026-02-26T02:45:01.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial161.front.sepia.ceph.com -o noatime 2026-02-26T02:45:01.975 DEBUG:teuthology.orchestra.run.trial161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-26T02:45:02.060 DEBUG:teuthology.orchestra.run.trial161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-26T02:45:02.087 DEBUG:teuthology.orchestra.run.trial161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:02.165 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:02.162+0000 7fac22a1c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-26T02:45:02.166 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:02.162+0000 7fac22a1c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-26T02:45:02.166 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:02.162+0000 7fac22a1c780 -1 bdev(0x564b6f339800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:02.166 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:02.163+0000 7fac22a1c780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-26T02:45:05.306 DEBUG:teuthology.orchestra.run.trial161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-26T02:45:05.371 DEBUG:teuthology.orchestra.run.trial161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:05.450 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:05.447+0000 7fc7451f9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-26T02:45:05.450 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:05.447+0000 7fc7451f9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-26T02:45:05.450 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:05.447+0000 7fc7451f9780 -1 bdev(0x55dfff5c9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:05.450 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:05.447+0000 7fc7451f9780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-26T02:45:08.599 DEBUG:teuthology.orchestra.run.trial161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-26T02:45:08.664 DEBUG:teuthology.orchestra.run.trial161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:08.742 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:08.739+0000 7fe81020c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-26T02:45:08.742 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:08.739+0000 7fe81020c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-26T02:45:08.742 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:08.739+0000 7fe81020c780 -1 bdev(0x55abe1bc1800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:08.742 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:08.739+0000 7fe81020c780 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-26T02:45:11.882 DEBUG:teuthology.orchestra.run.trial161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-26T02:45:11.947 DEBUG:teuthology.orchestra.run.trial161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:12.025 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:12.022+0000 7fa9836c0780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-26T02:45:12.026 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:12.022+0000 7fa9836c0780 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-26T02:45:12.026 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:12.022+0000 7fa9836c0780 -1 bdev(0x55f63518f800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:12.026 INFO:teuthology.orchestra.run.trial161.stderr:2026-02-26T02:45:12.022+0000 7fa9836c0780 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-26T02:45:15.168 DEBUG:teuthology.orchestra.run.trial161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-26T02:45:15.233 DEBUG:teuthology.orchestra.run.trial192:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-26T02:45:15.257 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-26T02:45:15.257 INFO:tasks.ceph:role: osd.3 2026-02-26T02:45:15.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:45:15.257 DEBUG:teuthology.orchestra.run.trial192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-26T02:45:15.322 INFO:teuthology.orchestra.run.trial192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:45:15.322 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:45:15.322 INFO:teuthology.orchestra.run.trial192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:45:15.322 INFO:teuthology.orchestra.run.trial192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:45:15.322 INFO:teuthology.orchestra.run.trial192.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:45:15.323 INFO:teuthology.orchestra.run.trial192.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:45:15.323 INFO:teuthology.orchestra.run.trial192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:45:15.323 INFO:teuthology.orchestra.run.trial192.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:45:15.323 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:45:15.323 INFO:teuthology.orchestra.run.trial192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:45:15.885 INFO:teuthology.orchestra.run.trial192.stdout:Discarding blocks...Done. 2026-02-26T02:45:15.887 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial192.front.sepia.ceph.com -o noatime 2026-02-26T02:45:15.887 DEBUG:teuthology.orchestra.run.trial192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-26T02:45:15.957 DEBUG:teuthology.orchestra.run.trial192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-26T02:45:16.025 DEBUG:teuthology.orchestra.run.trial192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-26T02:45:16.089 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-26T02:45:16.089 INFO:tasks.ceph:role: osd.7 2026-02-26T02:45:16.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:45:16.089 DEBUG:teuthology.orchestra.run.trial192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:45:16.153 INFO:teuthology.orchestra.run.trial192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:45:16.714 INFO:teuthology.orchestra.run.trial192.stdout:Discarding blocks...Done. 2026-02-26T02:45:16.716 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial192.front.sepia.ceph.com -o noatime 2026-02-26T02:45:16.717 DEBUG:teuthology.orchestra.run.trial192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-26T02:45:16.785 DEBUG:teuthology.orchestra.run.trial192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-26T02:45:16.851 DEBUG:teuthology.orchestra.run.trial192:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-26T02:45:16.916 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-26T02:45:16.916 INFO:tasks.ceph:role: osd.11 2026-02-26T02:45:16.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:45:16.917 DEBUG:teuthology.orchestra.run.trial192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-26T02:45:16.979 INFO:teuthology.orchestra.run.trial192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:45:16.980 INFO:teuthology.orchestra.run.trial192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:45:17.536 INFO:teuthology.orchestra.run.trial192.stdout:Discarding blocks...Done. 2026-02-26T02:45:17.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial192.front.sepia.ceph.com -o noatime 2026-02-26T02:45:17.538 DEBUG:teuthology.orchestra.run.trial192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-26T02:45:17.606 DEBUG:teuthology.orchestra.run.trial192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-26T02:45:17.673 DEBUG:teuthology.orchestra.run.trial192:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-26T02:45:17.736 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-26T02:45:17.736 INFO:tasks.ceph:role: osd.15 2026-02-26T02:45:17.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:45:17.736 DEBUG:teuthology.orchestra.run.trial192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout: = sunit=0 swidth=0 blks 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-26T02:45:17.800 INFO:teuthology.orchestra.run.trial192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-26T02:45:18.358 INFO:teuthology.orchestra.run.trial192.stdout:Discarding blocks...Done. 2026-02-26T02:45:18.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial192.front.sepia.ceph.com -o noatime 2026-02-26T02:45:18.360 DEBUG:teuthology.orchestra.run.trial192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-26T02:45:18.439 DEBUG:teuthology.orchestra.run.trial192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-26T02:45:18.507 DEBUG:teuthology.orchestra.run.trial192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:18.586 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:18.584+0000 7f7181493780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-26T02:45:18.586 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:18.584+0000 7f7181493780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-26T02:45:18.586 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:18.584+0000 7f7181493780 -1 bdev(0x56546f93f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:18.586 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:18.585+0000 7f7181493780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-26T02:45:21.482 DEBUG:teuthology.orchestra.run.trial192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-26T02:45:21.546 DEBUG:teuthology.orchestra.run.trial192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:21.624 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:21.622+0000 7f049081c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-26T02:45:21.624 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:21.622+0000 7f049081c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-26T02:45:21.624 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:21.622+0000 7f049081c780 -1 bdev(0x558ad0d55800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:21.624 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:21.622+0000 7f049081c780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-26T02:45:24.796 DEBUG:teuthology.orchestra.run.trial192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-26T02:45:24.862 DEBUG:teuthology.orchestra.run.trial192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:24.939 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:24.937+0000 7f8000a13780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-26T02:45:24.940 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:24.938+0000 7f8000a13780 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-26T02:45:24.940 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:24.938+0000 7f8000a13780 -1 bdev(0x560974a5b800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:24.940 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:24.938+0000 7f8000a13780 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-26T02:45:27.839 DEBUG:teuthology.orchestra.run.trial192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-26T02:45:27.905 DEBUG:teuthology.orchestra.run.trial192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:27.984 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:27.982+0000 7f96fe80f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-26T02:45:27.984 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:27.982+0000 7f96fe80f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-26T02:45:27.984 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:27.982+0000 7f96fe80f780 -1 bdev(0x563fcd393800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-26T02:45:27.984 INFO:teuthology.orchestra.run.trial192.stderr:2026-02-26T02:45:27.982+0000 7f96fe80f780 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-26T02:45:31.120 DEBUG:teuthology.orchestra.run.trial192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-26T02:45:31.186 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-26T02:45:31.186 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:45:31.186 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-26T02:45:31.212 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:45:31.212 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-26T02:45:31.276 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:45:31.277 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-26T02:45:31.340 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:45:31.340 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-26T02:45:31.404 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:45:31.404 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-26T02:45:31.468 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:45:31.468 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-26T02:45:31.493 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:45:31.494 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-26T02:45:31.558 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:45:31.558 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-26T02:45:31.623 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:45:31.623 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-26T02:45:31.687 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:45:31.687 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-26T02:45:31.713 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:45:31.713 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-26T02:45:31.777 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:45:31.778 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-26T02:45:31.842 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:45:31.842 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-26T02:45:31.905 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:45:31.905 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-26T02:45:31.930 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:45:31.930 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-26T02:45:31.994 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:45:31.995 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-26T02:45:32.058 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:45:32.058 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-26T02:45:32.120 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:45:32.120 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-26T02:45:32.184 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:45:32.184 DEBUG:teuthology.orchestra.run.trial192:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-26T02:45:32.239 INFO:tasks.ceph:Adding keys to all mons... 2026-02-26T02:45:32.239 DEBUG:teuthology.orchestra.run.trial093:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-26T02:45:32.241 DEBUG:teuthology.orchestra.run.trial130:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-26T02:45:32.243 DEBUG:teuthology.orchestra.run.trial161:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout:[mgr.y] 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCKs59pAfNNHhAAEtMYIwZ8r1MTjWhJZ4pi5w== 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout:[osd.0] 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCOs59ps5wBARAAXlacC83pKbkOINAQrOq0uA== 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout:[osd.4] 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCRs59pKJAOAxAAxnEK837n4qpuuAzjtE+sgw== 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout:[osd.8] 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCUs59pMC8lBhAAoN7i81be3fb0ktNC3T3OLg== 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout:[osd.12] 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCXs59pmpL9FxAA0inguY4I4i/5orQ3eYKWJw== 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout:[osd.1] 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCds59pFs+XORAAVe7F3rjSUFTElhKHfMGm4g== 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout:[osd.5] 2026-02-26T02:45:32.263 INFO:teuthology.orchestra.run.trial093.stdout: key = AQChs59pIRlvDxAApNkNXsBYcJJ+xLTRORO9Nw== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.9] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCks59pf1hREhAA4NAr8cMgbO7nPoLyOUI2FA== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.13] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCns59pS1X5FBAA1sPHWNnKFtI3eWpQPrL6kQ== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.2] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCus59p71W9CRAA/PJckYWJlFEE4scZJOnPHg== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.6] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCxs59pK0i0GhAA5k68J8g0Kf3wICLvf73nbA== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.10] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC0s59p2d8YLBAAo6ay+Mzfz86pRtLzp+zRzQ== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.14] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC4s59pjrxdARAAQ/wBXMR0RnN2n5kKZTStPw== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[mgr.x] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCKs59piLEVIRAAvQtUKZQ368RpWJUx83TAfQ== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.3] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQC+s59pJ9PmIhAA9tGlZWoHN3LQow8LQh3BrA== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.7] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDBs59pdwknJRAASAUZBiq6kX7/GrMz1TJemg== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.11] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDEs59p7yr2NxAA60RD5+xARUdgNoKTLCGR9Q== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[osd.15] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQDHs59pE0KcOhAAHHsUVGTk4ZFEmF3sBR2hAA== 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout:[client.0] 2026-02-26T02:45:32.264 INFO:teuthology.orchestra.run.trial093.stdout: key = AQCKs59pCMChJRAAYgDisP9UbFqaK37cfKs7ng== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[mgr.y] 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCKs59pAfNNHhAAEtMYIwZ8r1MTjWhJZ4pi5w== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[osd.0] 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCOs59ps5wBARAAXlacC83pKbkOINAQrOq0uA== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[osd.4] 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCRs59pKJAOAxAAxnEK837n4qpuuAzjtE+sgw== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[osd.8] 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCUs59pMC8lBhAAoN7i81be3fb0ktNC3T3OLg== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[osd.12] 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCXs59pmpL9FxAA0inguY4I4i/5orQ3eYKWJw== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[osd.1] 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCds59pFs+XORAAVe7F3rjSUFTElhKHfMGm4g== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[osd.5] 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout: key = AQChs59pIRlvDxAApNkNXsBYcJJ+xLTRORO9Nw== 2026-02-26T02:45:32.265 INFO:teuthology.orchestra.run.trial130.stdout:[osd.9] 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCks59pf1hREhAA4NAr8cMgbO7nPoLyOUI2FA== 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout:[osd.13] 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCns59pS1X5FBAA1sPHWNnKFtI3eWpQPrL6kQ== 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout:[osd.2] 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCus59p71W9CRAA/PJckYWJlFEE4scZJOnPHg== 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout:[osd.6] 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCxs59pK0i0GhAA5k68J8g0Kf3wICLvf73nbA== 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout:[osd.10] 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout: key = AQC0s59p2d8YLBAAo6ay+Mzfz86pRtLzp+zRzQ== 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout:[osd.14] 2026-02-26T02:45:32.266 INFO:teuthology.orchestra.run.trial130.stdout: key = AQC4s59pjrxdARAAQ/wBXMR0RnN2n5kKZTStPw== 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout:[mgr.x] 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCKs59piLEVIRAAvQtUKZQ368RpWJUx83TAfQ== 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout:[osd.3] 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout: key = AQC+s59pJ9PmIhAA9tGlZWoHN3LQow8LQh3BrA== 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout:[osd.7] 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout: key = AQDBs59pdwknJRAASAUZBiq6kX7/GrMz1TJemg== 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout:[osd.11] 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout: key = AQDEs59p7yr2NxAA60RD5+xARUdgNoKTLCGR9Q== 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout:[osd.15] 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout: key = AQDHs59pE0KcOhAAHHsUVGTk4ZFEmF3sBR2hAA== 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout:[client.0] 2026-02-26T02:45:32.267 INFO:teuthology.orchestra.run.trial130.stdout: key = AQCKs59pCMChJRAAYgDisP9UbFqaK37cfKs7ng== 2026-02-26T02:45:32.270 INFO:teuthology.orchestra.run.trial161.stdout:[mgr.y] 2026-02-26T02:45:32.270 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCKs59pAfNNHhAAEtMYIwZ8r1MTjWhJZ4pi5w== 2026-02-26T02:45:32.270 INFO:teuthology.orchestra.run.trial161.stdout:[osd.0] 2026-02-26T02:45:32.270 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCOs59ps5wBARAAXlacC83pKbkOINAQrOq0uA== 2026-02-26T02:45:32.270 INFO:teuthology.orchestra.run.trial161.stdout:[osd.4] 2026-02-26T02:45:32.270 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCRs59pKJAOAxAAxnEK837n4qpuuAzjtE+sgw== 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout:[osd.8] 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCUs59pMC8lBhAAoN7i81be3fb0ktNC3T3OLg== 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout:[osd.12] 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCXs59pmpL9FxAA0inguY4I4i/5orQ3eYKWJw== 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout:[osd.1] 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCds59pFs+XORAAVe7F3rjSUFTElhKHfMGm4g== 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout:[osd.5] 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout: key = AQChs59pIRlvDxAApNkNXsBYcJJ+xLTRORO9Nw== 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout:[osd.9] 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCks59pf1hREhAA4NAr8cMgbO7nPoLyOUI2FA== 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout:[osd.13] 2026-02-26T02:45:32.271 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCns59pS1X5FBAA1sPHWNnKFtI3eWpQPrL6kQ== 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout:[osd.2] 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCus59p71W9CRAA/PJckYWJlFEE4scZJOnPHg== 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout:[osd.6] 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCxs59pK0i0GhAA5k68J8g0Kf3wICLvf73nbA== 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout:[osd.10] 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout: key = AQC0s59p2d8YLBAAo6ay+Mzfz86pRtLzp+zRzQ== 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout:[osd.14] 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout: key = AQC4s59pjrxdARAAQ/wBXMR0RnN2n5kKZTStPw== 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout:[mgr.x] 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCKs59piLEVIRAAvQtUKZQ368RpWJUx83TAfQ== 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout:[osd.3] 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout: key = AQC+s59pJ9PmIhAA9tGlZWoHN3LQow8LQh3BrA== 2026-02-26T02:45:32.272 INFO:teuthology.orchestra.run.trial161.stdout:[osd.7] 2026-02-26T02:45:32.273 INFO:teuthology.orchestra.run.trial161.stdout: key = AQDBs59pdwknJRAASAUZBiq6kX7/GrMz1TJemg== 2026-02-26T02:45:32.273 INFO:teuthology.orchestra.run.trial161.stdout:[osd.11] 2026-02-26T02:45:32.273 INFO:teuthology.orchestra.run.trial161.stdout: key = AQDEs59p7yr2NxAA60RD5+xARUdgNoKTLCGR9Q== 2026-02-26T02:45:32.273 INFO:teuthology.orchestra.run.trial161.stdout:[osd.15] 2026-02-26T02:45:32.273 INFO:teuthology.orchestra.run.trial161.stdout: key = AQDHs59pE0KcOhAAHHsUVGTk4ZFEmF3sBR2hAA== 2026-02-26T02:45:32.273 INFO:teuthology.orchestra.run.trial161.stdout:[client.0] 2026-02-26T02:45:32.273 INFO:teuthology.orchestra.run.trial161.stdout: key = AQCKs59pCMChJRAAYgDisP9UbFqaK37cfKs7ng== 2026-02-26T02:45:32.273 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-26T02:45:32.311 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-26T02:45:32.314 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-26T02:45:32.354 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.392 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.395 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.436 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.472 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.475 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.514 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.551 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.554 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.594 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.631 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.634 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.675 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.711 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.714 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.755 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.791 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.802 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.845 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.870 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.882 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.924 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.951 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:32.960 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.001 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.031 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.041 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.079 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.111 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.118 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.159 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.193 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.196 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.239 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.272 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.277 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.317 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-26T02:45:33.352 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-26T02:45:33.357 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-26T02:45:33.395 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.431 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.438 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.477 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.510 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.517 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.557 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.589 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.597 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.637 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.669 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.677 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-26T02:45:33.715 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-26T02:45:33.747 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-26T02:45:33.757 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-26T02:45:33.797 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-26T02:45:33.797 DEBUG:teuthology.orchestra.run.trial093:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-26T02:45:33.849 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-26T02:45:33.937 DEBUG:teuthology.orchestra.run.trial093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-26T02:45:33.962 DEBUG:teuthology.orchestra.run.trial130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-26T02:45:33.987 DEBUG:teuthology.orchestra.run.trial130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-26T02:45:34.073 DEBUG:teuthology.orchestra.run.trial130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-26T02:45:34.097 DEBUG:teuthology.orchestra.run.trial161:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-26T02:45:34.122 DEBUG:teuthology.orchestra.run.trial161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-26T02:45:34.209 DEBUG:teuthology.orchestra.run.trial161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-26T02:45:34.234 DEBUG:teuthology.orchestra.run.trial093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:34.237 DEBUG:teuthology.orchestra.run.trial130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:34.240 DEBUG:teuthology.orchestra.run.trial161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-26T02:45:34.290 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-26T02:45:34.291 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-26T02:45:34.291 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-26T02:45:34.291 DEBUG:teuthology.orchestra.run.trial093:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-26T02:45:34.294 INFO:tasks.ceph.mon.a:Started 2026-02-26T02:45:34.295 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-26T02:45:34.295 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-26T02:45:34.295 DEBUG:teuthology.orchestra.run.trial130:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-26T02:45:34.298 INFO:tasks.ceph.mon.b:Started 2026-02-26T02:45:34.298 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-26T02:45:34.298 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-26T02:45:34.298 DEBUG:teuthology.orchestra.run.trial161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-26T02:45:34.332 INFO:tasks.ceph.mon.c:Started 2026-02-26T02:45:34.332 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-26T02:45:34.333 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-26T02:45:34.333 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-26T02:45:34.335 INFO:tasks.ceph.mgr.y:Started 2026-02-26T02:45:34.335 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-26T02:45:34.335 DEBUG:teuthology.orchestra.run.trial192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-26T02:45:34.338 INFO:tasks.ceph.mgr.x:Started 2026-02-26T02:45:34.338 INFO:tasks.ceph:Setting crush tunables to default 2026-02-26T02:45:34.339 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd crush tunables default 2026-02-26T02:45:44.740 INFO:tasks.ceph.mon.c.trial161.stderr:--00:00:00:10.360 44622-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ad/5c28b64e9e2539107d2bb61ed14390bc260c7e.debug 2026-02-26T02:45:44.741 INFO:tasks.ceph.mon.a.trial093.stderr:--00:00:00:10.396 45143-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ad/5c28b64e9e2539107d2bb61ed14390bc260c7e.debug 2026-02-26T02:45:44.801 INFO:tasks.ceph.mon.b.trial130.stderr:--00:00:00:10.453 44431-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ad/5c28b64e9e2539107d2bb61ed14390bc260c7e.debug 2026-02-26T02:45:50.347 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:00:15.967 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:45:50.391 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:00:16.046 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:45:50.433 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:00:16.085 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:45:50.498 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:00:16.118 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:45:50.542 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:00:16.198 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:45:50.583 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:00:16.236 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:03.124 INFO:teuthology.orchestra.run.trial093.stderr:adjusted tunables profile to default 2026-02-26T02:46:03.134 INFO:tasks.ceph:check_enable_crimson: False 2026-02-26T02:46:03.134 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-26T02:46:03.134 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:46:03.135 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-26T02:46:03.161 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:46:03.161 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-26T02:46:03.224 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:46:03.224 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-26T02:46:03.243 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.241+0000 7f6746b2c140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-26T02:46:03.248 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.246+0000 7f508060e140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-26T02:46:03.273 DEBUG:teuthology.orchestra.run.trial093:> set -ex 2026-02-26T02:46:03.273 DEBUG:teuthology.orchestra.run.trial093:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-26T02:46:03.338 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:46:03.339 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-26T02:46:03.363 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.361+0000 7f6746b2c140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-26T02:46:03.367 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:46:03.367 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-26T02:46:03.369 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.367+0000 7f508060e140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-26T02:46:03.390 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.388+0000 7f6746b2c140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-26T02:46:03.396 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.394+0000 7f508060e140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-26T02:46:03.422 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.421+0000 7f6746b2c140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-26T02:46:03.429 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.427+0000 7f508060e140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-26T02:46:03.430 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:46:03.430 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-26T02:46:03.445 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.444+0000 7f6746b2c140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-26T02:46:03.452 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.450+0000 7f508060e140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-26T02:46:03.471 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.470+0000 7f6746b2c140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-26T02:46:03.479 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.476+0000 7f508060e140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-26T02:46:03.495 DEBUG:teuthology.orchestra.run.trial130:> set -ex 2026-02-26T02:46:03.495 DEBUG:teuthology.orchestra.run.trial130:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-26T02:46:03.526 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.525+0000 7f6746b2c140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-26T02:46:03.534 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.532+0000 7f508060e140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-26T02:46:03.559 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:46:03.560 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-26T02:46:03.587 INFO:tasks.ceph.mgr.x.trial192.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-26T02:46:03.587 INFO:tasks.ceph.mgr.x.trial192.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-26T02:46:03.587 INFO:tasks.ceph.mgr.x.trial192.stderr: from numpy import show_config as show_numpy_config 2026-02-26T02:46:03.589 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:46:03.589 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-26T02:46:03.590 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.589+0000 7f6746b2c140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-26T02:46:03.595 INFO:tasks.ceph.mgr.y.trial093.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-26T02:46:03.595 INFO:tasks.ceph.mgr.y.trial093.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-26T02:46:03.595 INFO:tasks.ceph.mgr.y.trial093.stderr: from numpy import show_config as show_numpy_config 2026-02-26T02:46:03.599 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.597+0000 7f508060e140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-26T02:46:03.615 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.614+0000 7f6746b2c140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-26T02:46:03.624 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.622+0000 7f508060e140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-26T02:46:03.653 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:46:03.654 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-26T02:46:03.670 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.669+0000 7f6746b2c140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-26T02:46:03.679 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.677+0000 7f508060e140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-26T02:46:03.713 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.711+0000 7f6746b2c140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-26T02:46:03.717 DEBUG:teuthology.orchestra.run.trial161:> set -ex 2026-02-26T02:46:03.717 DEBUG:teuthology.orchestra.run.trial161:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-26T02:46:03.722 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.720+0000 7f508060e140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-26T02:46:03.738 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.737+0000 7f6746b2c140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-26T02:46:03.747 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.745+0000 7f508060e140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-26T02:46:03.762 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.761+0000 7f6746b2c140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-26T02:46:03.772 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.770+0000 7f508060e140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-26T02:46:03.781 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:46:03.781 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-26T02:46:03.788 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.786+0000 7f6746b2c140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-26T02:46:03.797 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.795+0000 7f508060e140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-26T02:46:03.805 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:46:03.805 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-26T02:46:03.810 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:03.809+0000 7f6746b2c140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-26T02:46:03.820 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:03.818+0000 7f508060e140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-26T02:46:03.833 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:46:03.833 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-26T02:46:03.898 DEBUG:teuthology.orchestra.run.trial192:> set -ex 2026-02-26T02:46:03.898 DEBUG:teuthology.orchestra.run.trial192:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-26T02:46:03.962 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 404d926b-352a-4df2-bf26-b477aa215897 0 2026-02-26T02:46:04.004 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.002+0000 7f6746b2c140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-26T02:46:04.014 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.012+0000 7f508060e140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-26T02:46:04.059 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.057+0000 7f6746b2c140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-26T02:46:04.069 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.067+0000 7f508060e140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-26T02:46:04.081 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.080+0000 7f6746b2c140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-26T02:46:04.091 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.089+0000 7f508060e140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-26T02:46:04.105 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.103+0000 7f6746b2c140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-26T02:46:04.115 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.113+0000 7f508060e140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-26T02:46:04.158 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.156+0000 7f6746b2c140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:46:04.168 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.166+0000 7f508060e140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:46:04.179 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.177+0000 7f6746b2c140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-26T02:46:04.189 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.187+0000 7f508060e140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-26T02:46:04.210 INFO:teuthology.orchestra.run.trial192.stdout:0 2026-02-26T02:46:04.219 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 497fd582-3ad5-417b-89e0-aeaf8287719c 1 2026-02-26T02:46:04.231 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.229+0000 7f6746b2c140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:46:04.242 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.240+0000 7f508060e140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-26T02:46:04.413 INFO:teuthology.orchestra.run.trial192.stdout:1 2026-02-26T02:46:04.420 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6 2 2026-02-26T02:46:04.585 INFO:teuthology.orchestra.run.trial192.stdout:2 2026-02-26T02:46:04.593 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new de2c8cb9-692e-4401-8813-3cf3630a7aa2 3 2026-02-26T02:46:04.622 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.620+0000 7f6746b2c140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-26T02:46:04.635 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.633+0000 7f508060e140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-26T02:46:04.644 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.643+0000 7f6746b2c140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-26T02:46:04.657 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.655+0000 7f508060e140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-26T02:46:04.839 INFO:teuthology.orchestra.run.trial192.stdout:3 2026-02-26T02:46:04.848 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new a1820965-5ca7-4bea-b1cf-00d0317666e5 4 2026-02-26T02:46:04.985 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:04.983+0000 7f6746b2c140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-26T02:46:05.000 INFO:tasks.ceph.mgr.y.trial093.stderr:2026-02-26T02:46:04.998+0000 7f508060e140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-26T02:46:05.237 INFO:teuthology.orchestra.run.trial192.stdout:4 2026-02-26T02:46:05.245 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae 5 2026-02-26T02:46:05.454 INFO:teuthology.orchestra.run.trial192.stdout:5 2026-02-26T02:46:05.461 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new e07bf7ca-4e5c-444d-a678-65722974523f 6 2026-02-26T02:46:05.647 INFO:teuthology.orchestra.run.trial192.stdout:6 2026-02-26T02:46:05.654 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 0c86bf69-7e41-41f9-8bd3-ad9543511125 7 2026-02-26T02:46:05.842 INFO:teuthology.orchestra.run.trial192.stdout:7 2026-02-26T02:46:05.849 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new c583fa19-de28-4762-abae-f907b377a097 8 2026-02-26T02:46:06.034 INFO:teuthology.orchestra.run.trial192.stdout:8 2026-02-26T02:46:06.041 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 970a9421-71ca-45bb-b4ae-daa96cf2fe6c 9 2026-02-26T02:46:06.242 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:46:06.240+0000 7f66642b8640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-26T02:46:06.483 INFO:teuthology.orchestra.run.trial192.stdout:9 2026-02-26T02:46:06.492 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 7d80ac94-36d5-49dc-899e-47611779e28d 10 2026-02-26T02:46:06.801 INFO:teuthology.orchestra.run.trial192.stdout:10 2026-02-26T02:46:06.811 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 721b6dbe-034f-4007-a813-f07f236c58c4 11 2026-02-26T02:46:07.131 INFO:teuthology.orchestra.run.trial192.stdout:11 2026-02-26T02:46:07.139 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 57b55b92-e8d8-41e7-8241-5b99537e7838 12 2026-02-26T02:46:07.452 INFO:teuthology.orchestra.run.trial192.stdout:12 2026-02-26T02:46:07.461 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 7de2d75f-7e3b-4e73-8fe2-ebc0e446251e 13 2026-02-26T02:46:07.767 INFO:teuthology.orchestra.run.trial192.stdout:13 2026-02-26T02:46:07.775 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new d655aa42-f167-4fbc-8090-83210d67d598 14 2026-02-26T02:46:08.188 INFO:teuthology.orchestra.run.trial192.stdout:14 2026-02-26T02:46:08.199 DEBUG:teuthology.orchestra.run.trial192:> sudo ceph --cluster ceph osd new 989afadd-acc4-423e-8e15-9cc96c658d1f 15 2026-02-26T02:46:08.487 INFO:teuthology.orchestra.run.trial192.stdout:15 2026-02-26T02:46:08.495 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.495 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-26T02:46:08.495 DEBUG:teuthology.orchestra.run.trial093:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-26T02:46:08.497 INFO:tasks.ceph.osd.0:Started 2026-02-26T02:46:08.497 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.497 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-26T02:46:08.498 DEBUG:teuthology.orchestra.run.trial093:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-26T02:46:08.499 INFO:tasks.ceph.osd.4:Started 2026-02-26T02:46:08.499 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.500 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-26T02:46:08.500 DEBUG:teuthology.orchestra.run.trial093:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-26T02:46:08.502 INFO:tasks.ceph.osd.8:Started 2026-02-26T02:46:08.502 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.502 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-26T02:46:08.502 DEBUG:teuthology.orchestra.run.trial093:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-26T02:46:08.504 INFO:tasks.ceph.osd.12:Started 2026-02-26T02:46:08.504 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.504 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-26T02:46:08.504 DEBUG:teuthology.orchestra.run.trial130:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-26T02:46:08.506 INFO:tasks.ceph.osd.1:Started 2026-02-26T02:46:08.506 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.506 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-26T02:46:08.506 DEBUG:teuthology.orchestra.run.trial130:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-26T02:46:08.508 INFO:tasks.ceph.osd.5:Started 2026-02-26T02:46:08.508 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.508 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-26T02:46:08.508 DEBUG:teuthology.orchestra.run.trial130:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-26T02:46:08.510 INFO:tasks.ceph.osd.9:Started 2026-02-26T02:46:08.510 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.510 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-26T02:46:08.511 DEBUG:teuthology.orchestra.run.trial130:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-26T02:46:08.512 INFO:tasks.ceph.osd.13:Started 2026-02-26T02:46:08.512 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.512 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-26T02:46:08.513 DEBUG:teuthology.orchestra.run.trial161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-26T02:46:08.515 INFO:tasks.ceph.osd.2:Started 2026-02-26T02:46:08.515 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.515 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-26T02:46:08.515 DEBUG:teuthology.orchestra.run.trial161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-26T02:46:08.517 INFO:tasks.ceph.osd.6:Started 2026-02-26T02:46:08.517 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.517 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-26T02:46:08.517 DEBUG:teuthology.orchestra.run.trial161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-26T02:46:08.519 INFO:tasks.ceph.osd.10:Started 2026-02-26T02:46:08.519 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.519 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-26T02:46:08.519 DEBUG:teuthology.orchestra.run.trial161:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-26T02:46:08.521 INFO:tasks.ceph.osd.14:Started 2026-02-26T02:46:08.521 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.521 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-26T02:46:08.521 DEBUG:teuthology.orchestra.run.trial192:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-26T02:46:08.523 INFO:tasks.ceph.osd.3:Started 2026-02-26T02:46:08.523 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.523 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-26T02:46:08.523 DEBUG:teuthology.orchestra.run.trial192:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-26T02:46:08.526 INFO:tasks.ceph.osd.7:Started 2026-02-26T02:46:08.526 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.526 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-26T02:46:08.527 DEBUG:teuthology.orchestra.run.trial192:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-26T02:46:08.529 INFO:tasks.ceph.osd.11:Started 2026-02-26T02:46:08.529 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-26T02:46:08.530 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-26T02:46:08.530 DEBUG:teuthology.orchestra.run.trial192:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-26T02:46:08.532 INFO:tasks.ceph.osd.15:Started 2026-02-26T02:46:08.532 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:08.835 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:46:08.835 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:08.845 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-26T02:46:08.845 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-26T02:46:10.457 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:10.753 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:46:10.753 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:10.762 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:46:18.332 INFO:tasks.ceph.osd.11.trial192.stderr:--00:00:00:09.756 45536-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.332 INFO:tasks.ceph.osd.15.trial192.stderr:--00:00:00:09.754 45537-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.333 INFO:tasks.ceph.osd.3.trial192.stderr:--00:00:00:09.758 45534-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.336 INFO:tasks.ceph.osd.7.trial192.stderr:--00:00:00:09.762 45535-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.353 INFO:tasks.ceph.osd.1.trial130.stderr:--00:00:00:09.799 44674-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.353 INFO:tasks.ceph.osd.13.trial130.stderr:--00:00:00:09.795 44677-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.354 INFO:tasks.ceph.osd.9.trial130.stderr:--00:00:00:09.797 44676-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.355 INFO:tasks.ceph.osd.5.trial130.stderr:--00:00:00:09.801 44675-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.374 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:18.389 INFO:tasks.ceph.osd.0.trial093.stderr:--00:00:00:09.845 45496-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.390 INFO:tasks.ceph.osd.8.trial093.stderr:--00:00:00:09.840 45506-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.390 INFO:tasks.ceph.osd.4.trial093.stderr:--00:00:00:09.846 45498-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.392 INFO:tasks.ceph.osd.12.trial093.stderr:--00:00:00:09.843 45511-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.402 INFO:tasks.ceph.osd.6.trial161.stderr:--00:00:00:09.839 44865-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.402 INFO:tasks.ceph.osd.14.trial161.stderr:--00:00:00:09.835 44867-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.402 INFO:tasks.ceph.osd.10.trial161.stderr:--00:00:00:09.835 44868-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.403 INFO:tasks.ceph.osd.2.trial161.stderr:--00:00:00:09.840 44866-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/52/5d5279b7001da3793d69869c5d22246fa389de.debug 2026-02-26T02:46:18.671 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:46:18.671 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:18.684 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:46:22.644 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:14.069 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.659 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:14.082 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.660 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:14.084 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.661 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:14.103 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.662 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:14.107 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.662 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:14.108 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.679 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:14.103 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.696 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:14.139 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.714 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:14.147 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.714 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:14.151 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.722 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:14.178 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.722 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:14.173 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.723 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:14.179 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.728 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:14.165 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.740 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:14.173 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.786 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:14.237 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.942 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:14.367 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.948 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:14.371 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.948 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:14.373 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.949 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:14.390 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.952 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:14.397 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.953 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:14.399 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.970 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:14.395 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.972 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:14.414 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.974 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:14.396 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.974 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:14.420 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.975 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:14.400 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.975 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:14.420 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.975 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:14.399 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.989 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:14.432 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.994 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:14.419 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.997 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:14.422 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.997 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:14.422 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:22.998 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:14.420 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.000 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:14.442 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.005 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:14.438 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.006 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:14.443 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.008 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:14.454 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.008 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:14.453 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.019 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:14.456 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.020 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:14.463 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.021 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:14.472 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.021 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:14.477 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.021 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:14.476 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.022 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:14.446 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.029 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:14.466 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.033 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:14.466 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.035 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:14.468 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.044 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:14.487 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.046 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:14.483 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.049 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:14.500 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.049 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:14.504 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.049 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:14.505 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.054 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:14.491 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.058 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:14.491 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.058 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:14.491 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.066 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:14.503 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.071 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:14.527 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.071 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:14.522 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.072 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:14.527 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.076 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:14.527 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.082 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:14.515 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.095 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:14.545 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.115 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:14.565 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.265 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:14.706 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.266 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:14.690 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.269 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:14.691 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.269 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:14.694 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.281 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:14.727 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.281 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:14.726 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.293 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:14.717 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.294 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:14.717 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.310 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:14.732 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.311 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:14.754 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.324 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:14.761 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.328 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:14.761 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.332 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:14.769 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.335 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:14.778 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.341 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:14.797 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.342 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:14.792 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.345 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:14.800 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.350 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:14.793 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.352 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:14.785 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.354 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:14.787 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.369 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:14.802 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.372 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:14.828 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.375 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:14.831 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.381 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:14.831 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.387 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:14.843 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.390 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:14.845 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.531 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:14.972 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.536 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:14.961 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.540 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:14.965 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.547 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:14.989 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.551 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:14.976 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.555 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:14.980 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.556 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:15.002 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.556 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:15.001 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.568 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:14.992 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.571 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:15.016 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.572 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:15.019 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.583 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:15.007 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.599 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:15.036 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.605 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:15.042 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.606 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:15.057 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.614 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:15.051 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.620 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:15.057 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.621 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:15.072 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.635 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:15.068 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.649 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:15.099 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.650 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:15.083 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.664 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:15.114 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:23.842 INFO:tasks.ceph.osd.15.trial192.stderr:2026-02-26T02:46:23.837+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:23.885 INFO:tasks.ceph.osd.9.trial130.stderr:2026-02-26T02:46:23.880+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:23.897 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:46:23.891+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:23.921 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:46:23.916+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:23.923 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-26T02:46:23.918+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:23.926 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-26T02:46:23.923+0000 a699640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2026-02-26T02:46:24.073 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:46:24.068+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.081 INFO:tasks.ceph.osd.7.trial192.stderr:2026-02-26T02:46:24.076+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.086 INFO:tasks.ceph.osd.3.trial192.stderr:2026-02-26T02:46:24.082+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.107 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:46:24.102+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.112 INFO:tasks.ceph.osd.1.trial130.stderr:2026-02-26T02:46:24.106+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.115 INFO:tasks.ceph.osd.1.trial130.stderr:2026-02-26T02:46:24.113+0000 a699640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2026-02-26T02:46:24.119 INFO:tasks.ceph.osd.11.trial192.stderr:2026-02-26T02:46:24.114+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.149 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:46:24.143+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.152 INFO:tasks.ceph.osd.6.trial161.stderr:2026-02-26T02:46:24.146+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.167 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:46:24.162+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.199 INFO:tasks.ceph.osd.14.trial161.stderr:2026-02-26T02:46:24.192+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:24.209 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:46:24.204+0000 77b8940 -1 Falling back to public interface 2026-02-26T02:46:26.296 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:26.599 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:46:26.599 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:26.610 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:46:28.685 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:20.118 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.715 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:20.137 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.743 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:20.186 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.766 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:20.222 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.773 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:20.229 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.903 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:20.344 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.923 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:20.359 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.923 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:20.360 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.931 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:20.377 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.932 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:20.377 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.967 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:20.392 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.997 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:20.422 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:28.998 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:20.449 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.006 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:20.439 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.025 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:20.458 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.031 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:20.482 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.038 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:20.463 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.056 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:20.479 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.062 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:20.506 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.091 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:20.547 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.113 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:20.568 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.222 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:20.664 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.246 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:20.683 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.250 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:20.686 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.259 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:20.704 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.259 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:20.705 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.287 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:20.712 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.311 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:20.744 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.316 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:20.767 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.336 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:20.758 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.342 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:20.785 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.346 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:20.771 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.355 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:20.788 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.357 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:20.807 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.367 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:20.791 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.395 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:20.851 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.401 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:20.856 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.518 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:20.960 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.526 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:20.963 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.538 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:20.984 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.551 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:20.987 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.559 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:21.004 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.561 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:20.986 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.586 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:21.018 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.603 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:21.025 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.607 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:21.050 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.617 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:21.068 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.633 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:21.058 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.634 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:21.066 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.649 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:21.073 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.671 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:21.122 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.676 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:21.131 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.686 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:21.142 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.789 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:21.226 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.793 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:21.234 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.812 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:21.258 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.825 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:21.261 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.831 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:21.256 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.838 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:21.283 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.865 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:21.299 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.866 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:21.288 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.873 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:21.316 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.897 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:21.322 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.897 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:21.330 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.899 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:21.349 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.919 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:21.343 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.939 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:21.394 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.956 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:21.407 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:29.968 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:21.424 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.052 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:21.489 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.066 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:21.508 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.083 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:21.528 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.094 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:21.519 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.099 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:21.535 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.113 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:21.558 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.129 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:21.551 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.139 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:21.582 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.140 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:21.573 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.165 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:21.590 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.170 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:21.603 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.173 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:21.624 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.191 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:21.615 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.211 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:21.666 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.248 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:21.699 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.264 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:21.720 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.317 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:21.753 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.351 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:21.792 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.357 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:21.782 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.358 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:21.804 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.373 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:21.810 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.389 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:21.834 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.392 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:21.814 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.405 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:21.848 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.418 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:21.851 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.428 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:21.853 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.439 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:21.872 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.449 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:21.899 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.456 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:21.880 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.481 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:21.936 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.523 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:21.973 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.541 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:21.996 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.581 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:22.017 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.620 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:22.045 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.624 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:22.070 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.628 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:22.070 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.647 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:22.083 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.660 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:22.082 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.670 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:22.115 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.677 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:22.120 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.697 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:22.122 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.699 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:22.132 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.713 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:22.146 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.721 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:22.145 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.730 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:22.180 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.751 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:22.206 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.797 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:22.247 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.830 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:22.287 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.847 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:22.284 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.883 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:22.308 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.888 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:22.334 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.911 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:22.352 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.923 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:22.345 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.925 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:22.361 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.948 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:22.391 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.953 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:22.398 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.960 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:22.385 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.982 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:22.415 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.982 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:22.416 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:30.983 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:22.408 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.005 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:22.455 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.028 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:22.483 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.070 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:22.521 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.110 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:22.547 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.113 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:22.569 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.146 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:22.571 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.152 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:22.598 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.189 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:22.630 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.198 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:22.635 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.227 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:22.652 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.227 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:22.672 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.245 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:22.678 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.266 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:22.690 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.283 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:22.733 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.292 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:22.714 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.320 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:22.762 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.325 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:22.748 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.349 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:22.799 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.349 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:22.772 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.355 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:22.798 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.376 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:22.798 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.377 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:22.819 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.380 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:22.802 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.381 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:22.814 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.398 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:22.841 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.402 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:22.845 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.404 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:22.859 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.424 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:22.856 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.461 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:22.894 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.501 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:22.938 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.501 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:22.934 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.505 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:22.939 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.506 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:22.962 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.516 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:22.941 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.525 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:22.971 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.535 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:22.991 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.544 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:22.981 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.557 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:23.013 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.574 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:23.011 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.585 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:23.027 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.591 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:23.047 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.595 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:23.051 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.598 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:23.035 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.599 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:23.023 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.602 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:23.040 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.604 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:23.041 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.622 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:23.055 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.626 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:23.068 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.627 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:23.071 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.644 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:23.068 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.669 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:23.102 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.670 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:23.112 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.672 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:23.118 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.675 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:23.126 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.689 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:23.113 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.690 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:23.132 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.694 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:23.149 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.695 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:23.137 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.698 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:23.143 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.703 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:23.136 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.707 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:23.131 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.724 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:23.179 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.731 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:23.155 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.736 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:23.160 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.736 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:23.169 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.740 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:23.185 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.740 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:23.173 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.745 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:23.189 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.755 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:23.205 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.765 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:23.220 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.770 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:23.225 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.803 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:23.228 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.805 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:23.255 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.816 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:23.262 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.831 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:23.281 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.833 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:23.257 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.845 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:23.291 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.864 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:23.314 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.868 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:23.319 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.869 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:23.294 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.874 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:23.299 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.885 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:23.331 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.890 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:23.336 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.893 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:23.330 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.896 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:23.321 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.929 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:23.366 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.942 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:23.367 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.958 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:23.395 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.960 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:23.411 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.962 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:23.399 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.984 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:23.435 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.989 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:23.415 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:31.994 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:23.419 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:32.009 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:23.459 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:32.014 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:23.464 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:34.219 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:34.508 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:46:34.509 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:34.517 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:46:42.127 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:42.410 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:46:42.411 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:42.422 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:46:43.040 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:34.463 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.156 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:34.599 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.192 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:34.625 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.284 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:34.740 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.285 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:34.722 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.437 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:34.870 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.472 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:34.913 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.484 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:34.908 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.529 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:34.974 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.552 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:35.007 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.559 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:35.010 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.625 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:35.061 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.632 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:35.057 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.653 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:35.099 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.692 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:35.142 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:43.758 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:35.183 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.776 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:37.198 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.799 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:37.221 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.802 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:37.224 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.802 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:37.235 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.824 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:37.257 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.827 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:37.260 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.878 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:37.321 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.883 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:37.339 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.902 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:37.345 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.905 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:37.348 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.908 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:37.364 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.910 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:37.367 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:45.967 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:37.404 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.006 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:37.443 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.008 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:37.445 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.095 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:37.545 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.120 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:37.561 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.125 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:37.550 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.127 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:37.577 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.128 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:37.573 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.130 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:37.580 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.153 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:37.578 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.156 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:37.579 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.156 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:37.581 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.159 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:37.609 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.160 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:37.601 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.162 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:37.604 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.163 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:37.608 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.166 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:37.611 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.173 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:37.606 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.183 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:37.634 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.186 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:37.637 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.198 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:37.622 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.200 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:37.624 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.212 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:37.645 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.215 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:37.648 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.231 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:37.686 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.250 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:37.687 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.255 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:37.710 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.258 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:37.713 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.275 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:37.712 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.278 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:37.715 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.371 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:37.817 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.395 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:37.841 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.398 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:37.844 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.464 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:37.889 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.496 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:37.921 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:46.498 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:37.924 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.480 INFO:tasks.ceph.osd.15.trial192.stderr:==00:00:00:38.902 45537== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.495 INFO:tasks.ceph.osd.9.trial130.stderr:==00:00:00:38.938 44676== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.532 INFO:tasks.ceph.osd.10.trial161.stderr:==00:00:00:38.965 44868== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.695 INFO:tasks.ceph.osd.0.trial093.stderr:==00:00:00:39.152 45496== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.712 INFO:tasks.ceph.osd.12.trial093.stderr:==00:00:00:39.162 45511== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.814 INFO:tasks.ceph.osd.14.trial161.stderr:==00:00:00:39.247 44867== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.826 INFO:tasks.ceph.osd.6.trial161.stderr:==00:00:00:39.264 44865== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.832 INFO:tasks.ceph.osd.4.trial093.stderr:==00:00:00:39.288 45498== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.846 INFO:tasks.ceph.osd.7.trial192.stderr:==00:00:00:39.271 45535== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.854 INFO:tasks.ceph.osd.11.trial192.stderr:==00:00:00:39.278 45536== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.860 INFO:tasks.ceph.osd.13.trial130.stderr:==00:00:00:39.302 44677== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.967 INFO:tasks.ceph.osd.5.trial130.stderr:==00:00:00:39.412 44675== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:47.991 INFO:tasks.ceph.osd.2.trial161.stderr:==00:00:00:39.427 44866== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:48.001 INFO:tasks.ceph.osd.8.trial093.stderr:==00:00:00:39.451 45506== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:48.174 INFO:tasks.ceph.osd.1.trial130.stderr:==00:00:00:39.620 44674== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:48.309 INFO:tasks.ceph.osd.3.trial192.stderr:==00:00:00:39.734 45534== Warning: unimplemented fcntl command: 1038 2026-02-26T02:46:50.031 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:50.321 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:46:50.321 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:50.332 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:46:56.372 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:01:22.027 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.401 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:01:22.056 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.422 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:01:22.074 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.424 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:01:22.044 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.451 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:01:22.103 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.453 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:01:22.073 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.531 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:01:22.186 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.572 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:01:22.192 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:56.573 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:01:22.226 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:46:57.946 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:46:58.234 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:46:58.234 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:46:58.246 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:47:05.858 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:06.145 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:47:06.145 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:06.156 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:47:13.769 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:14.068 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:47:14.069 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:14.079 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:47:16.378 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:01:42.033 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.382 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:01:42.037 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.402 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:01:42.057 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.411 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:01:42.063 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.412 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:01:42.064 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.415 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:01:42.035 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.417 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:01:42.037 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.429 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:01:42.082 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:16.435 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:01:42.055 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:21.694 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:22.004 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:47:22.005 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:22.017 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:47:29.630 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:29.932 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:47:29.932 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:29.944 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:47:36.410 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:02.065 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.411 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:02.067 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.419 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:02.074 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.437 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:02.057 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.440 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:02.093 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.441 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:02.061 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.441 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:02.093 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.448 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:02.067 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:36.448 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:02.100 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:37.557 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:37.845 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:47:37.846 INFO:teuthology.misc.health.trial093.stdout:{"epoch":18,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:46:08.473714+0000","last_up_change":"0.000000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:37.853 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-26T02:47:39.163 INFO:tasks.ceph.osd.15.trial192.stderr:2026-02-26T02:47:39.159+0000 77b8940 -1 osd.15 0 log_to_monitors true 2026-02-26T02:47:39.271 INFO:tasks.ceph.osd.7.trial192.stderr:2026-02-26T02:47:39.265+0000 77b8940 -1 osd.7 0 log_to_monitors true 2026-02-26T02:47:39.272 INFO:tasks.ceph.osd.11.trial192.stderr:2026-02-26T02:47:39.268+0000 77b8940 -1 osd.11 0 log_to_monitors true 2026-02-26T02:47:39.558 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:39.553+0000 77b8940 -1 osd.10 0 log_to_monitors true 2026-02-26T02:47:39.597 INFO:tasks.ceph.osd.14.trial161.stderr:2026-02-26T02:47:39.592+0000 77b8940 -1 osd.14 0 log_to_monitors true 2026-02-26T02:47:39.742 INFO:tasks.ceph.osd.9.trial130.stderr:2026-02-26T02:47:39.738+0000 77b8940 -1 osd.9 0 log_to_monitors true 2026-02-26T02:47:39.748 INFO:tasks.ceph.osd.6.trial161.stderr:2026-02-26T02:47:39.743+0000 77b8940 -1 osd.6 0 log_to_monitors true 2026-02-26T02:47:39.749 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:39.745+0000 77b8940 -1 osd.12 0 log_to_monitors true 2026-02-26T02:47:39.799 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:39.794+0000 77b8940 -1 osd.2 0 log_to_monitors true 2026-02-26T02:47:39.896 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:39.892+0000 77b8940 -1 osd.0 0 log_to_monitors true 2026-02-26T02:47:39.964 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-26T02:47:39.959+0000 77b8940 -1 osd.4 0 log_to_monitors true 2026-02-26T02:47:40.046 INFO:tasks.ceph.osd.3.trial192.stderr:2026-02-26T02:47:40.040+0000 77b8940 -1 osd.3 0 log_to_monitors true 2026-02-26T02:47:40.259 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:40.255+0000 77b8940 -1 osd.8 0 log_to_monitors true 2026-02-26T02:47:40.332 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:40.328+0000 77b8940 -1 osd.5 0 log_to_monitors true 2026-02-26T02:47:40.414 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:40.411+0000 77b8940 -1 osd.13 0 log_to_monitors true 2026-02-26T02:47:40.418 INFO:tasks.ceph.osd.1.trial130.stderr:2026-02-26T02:47:40.415+0000 77b8940 -1 osd.1 0 log_to_monitors true 2026-02-26T02:47:41.623 INFO:tasks.ceph.osd.7.trial192.stderr:2026-02-26T02:47:41.620+0000 d6b1640 -1 osd.7 0 waiting for initial osdmap 2026-02-26T02:47:41.641 INFO:tasks.ceph.osd.11.trial192.stderr:2026-02-26T02:47:41.637+0000 d6b1640 -1 osd.11 0 waiting for initial osdmap 2026-02-26T02:47:41.660 INFO:tasks.ceph.osd.9.trial130.stderr:2026-02-26T02:47:41.657+0000 d6b1640 -1 osd.9 0 waiting for initial osdmap 2026-02-26T02:47:41.686 INFO:tasks.ceph.osd.14.trial161.stderr:2026-02-26T02:47:41.681+0000 d6b1640 -1 osd.14 0 waiting for initial osdmap 2026-02-26T02:47:41.686 INFO:tasks.ceph.osd.15.trial192.stderr:2026-02-26T02:47:41.682+0000 d6b1640 -1 osd.15 0 waiting for initial osdmap 2026-02-26T02:47:41.727 INFO:tasks.ceph.osd.6.trial161.stderr:2026-02-26T02:47:41.722+0000 ce9e640 -1 osd.6 0 waiting for initial osdmap 2026-02-26T02:47:41.833 INFO:tasks.ceph.osd.11.trial192.stderr:2026-02-26T02:47:41.825+0000 11c76640 -1 osd.11 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:41.839 INFO:tasks.ceph.osd.7.trial192.stderr:2026-02-26T02:47:41.832+0000 11c76640 -1 osd.7 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:41.857 INFO:tasks.ceph.osd.9.trial130.stderr:2026-02-26T02:47:41.849+0000 11c76640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:41.864 INFO:tasks.ceph.osd.15.trial192.stderr:2026-02-26T02:47:41.856+0000 11c76640 -1 osd.15 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:41.866 INFO:tasks.ceph.osd.14.trial161.stderr:2026-02-26T02:47:41.857+0000 11c76640 -1 osd.14 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:41.932 INFO:tasks.ceph.osd.6.trial161.stderr:2026-02-26T02:47:41.923+0000 11c76640 -1 osd.6 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:42.661 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-26T02:47:42.657+0000 d6b1640 -1 osd.4 0 waiting for initial osdmap 2026-02-26T02:47:42.664 INFO:tasks.ceph.osd.3.trial192.stderr:2026-02-26T02:47:42.660+0000 d6b1640 -1 osd.3 0 waiting for initial osdmap 2026-02-26T02:47:42.668 INFO:tasks.ceph.osd.1.trial130.stderr:2026-02-26T02:47:42.665+0000 d6b1640 -1 osd.1 0 waiting for initial osdmap 2026-02-26T02:47:42.874 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-26T02:47:42.866+0000 11c76640 -1 osd.4 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:42.883 INFO:tasks.ceph.osd.3.trial192.stderr:2026-02-26T02:47:42.875+0000 11c76640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:42.905 INFO:tasks.ceph.osd.1.trial130.stderr:2026-02-26T02:47:42.897+0000 11c76640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:45.141 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.134+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.222 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.179+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.253 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.197+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.255 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.251+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 3 2026-02-26T02:47:45.268 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.264+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.284 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.280+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.290 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.265+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.291 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.276+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.297 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.275+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.302 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.292+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.303 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.288+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.303 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.295+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.315 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.300+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.320 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.299+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.324 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.312+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.332 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.324+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.336 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.322+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.338 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.330+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.340 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.301+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 2 2026-02-26T02:47:45.341 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.310+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.343 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.338+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2026-02-26T02:47:45.348 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.340+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.351 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.337+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.362 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.359+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.365 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.361+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.374 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.326+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.375 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.368+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.378 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.352+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.382 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.373+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.383 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.380+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.395 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.381+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.398 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.366+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.402 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.394+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.408 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.380+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.409 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.406+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 2 2026-02-26T02:47:45.410 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.371+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.410 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.377+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.411 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.400+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.415 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.396+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.422 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.408+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.428 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.383+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.429 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.420+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.430 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.408+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.434 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.425+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.435 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.418+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.440 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.426+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.446 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.431+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.458 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.443+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.465 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:45.471 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.450+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.478 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.458+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 3 2026-02-26T02:47:45.478 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.455+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.485 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.476+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.486 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.413+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.487 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.427+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.497 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.494+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2026-02-26T02:47:45.499 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.438+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.499 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.475+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.500 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.484+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 2 2026-02-26T02:47:45.503 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.495+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.503 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.493+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.510 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.502+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.511 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.508+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.513 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.498+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 2 2026-02-26T02:47:45.513 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.505+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2026-02-26T02:47:45.523 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.510+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.524 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.479+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.532 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.511+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.532 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.524+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.535 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.520+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.537 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.520+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.548 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.509+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.549 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.534+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.550 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.530+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.554 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.532+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.555 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.538+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.559 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.551+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.564 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.548+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.564 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.562+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.569 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.556+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.581 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.566+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.582 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.558+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.582 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.579+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.590 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.512+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.596 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.593+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.605 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.547+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.606 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.588+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.610 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.578+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.610 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.593+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.611 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.604+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.613 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.608+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.617 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.608+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.619 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.615+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.623 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.610+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.628 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.626+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.635 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.620+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.640 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:45.632+0000 77b8940 -1 bdev(0x16f085c0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-26T02:47:45.647 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.615+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.656 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.653+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.663 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.632+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.673 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.669+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.686 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.672+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.698 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.661+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.706 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.684+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.707 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.690+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.715 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.704+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.724 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.668+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.728 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.713+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.729 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.726+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.737 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.711+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.748 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.696+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.749 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.722+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.749 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.740+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.749 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.735+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.749 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.746+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.750 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.736+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.750 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.746+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.764 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.746+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.768 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:45.747+0000 77b8940 -1 bdev(0x16f01e50 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-26T02:47:45.769 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.760+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 1 2026-02-26T02:47:45.779 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:47:45.779 INFO:teuthology.misc.health.trial093.stdout:{"epoch":23,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:47:44.757288+0000","last_up_change":"2026-02-26T02:47:43.631487+0000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T02:47:43.283460+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":16.670000076293945,"score_stable":16.670000076293945,"optimal_score":0.059999998658895493,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6811","nonce":2110814708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6813","nonce":2110814708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6815","nonce":2110814708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6814","nonce":2110814708}]},"public_addr":"10.20.193.130:6811/2110814708","cluster_addr":"10.20.193.130:6813/2110814708","heartbeat_back_addr":"10.20.193.130:6815/2110814708","heartbeat_front_addr":"10.20.193.130:6814/2110814708","state":["exists","up"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6808","nonce":1838066642}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6810","nonce":1838066642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6812","nonce":1838066642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6811","nonce":1838066642}]},"public_addr":"10.20.193.192:6808/1838066642","cluster_addr":"10.20.193.192:6810/1838066642","heartbeat_back_addr":"10.20.193.192:6812/1838066642","heartbeat_front_addr":"10.20.193.192:6811/1838066642","state":["exists","up"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":2379549259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":2379549259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":2379549259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":2379549259}]},"public_addr":"10.20.193.93:6803/2379549259","cluster_addr":"10.20.193.93:6805/2379549259","heartbeat_back_addr":"10.20.193.93:6807/2379549259","heartbeat_front_addr":"10.20.193.93:6806/2379549259","state":["exists","up"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6806","nonce":329633094}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6809","nonce":329633094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6811","nonce":329633094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6810","nonce":329633094}]},"public_addr":"10.20.193.161:6806/329633094","cluster_addr":"10.20.193.161:6809/329633094","heartbeat_back_addr":"10.20.193.161:6811/329633094","heartbeat_front_addr":"10.20.193.161:6810/329633094","state":["exists","up"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6805","nonce":1343240239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6806","nonce":1343240239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6809","nonce":1343240239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6807","nonce":1343240239}]},"public_addr":"10.20.193.192:6805/1343240239","cluster_addr":"10.20.193.192:6806/1343240239","heartbeat_back_addr":"10.20.193.192:6809/1343240239","heartbeat_front_addr":"10.20.193.192:6807/1343240239","state":["exists","up"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6800","nonce":1345968556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6801","nonce":1345968556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6803","nonce":1345968556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6802","nonce":1345968556}]},"public_addr":"10.20.193.130:6800/1345968556","cluster_addr":"10.20.193.130:6801/1345968556","heartbeat_back_addr":"10.20.193.130:6803/1345968556","heartbeat_front_addr":"10.20.193.130:6802/1345968556","state":["exists","up"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6813","nonce":2609613895}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6814","nonce":2609613895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6816","nonce":2609613895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6815","nonce":2609613895}]},"public_addr":"10.20.193.192:6813/2609613895","cluster_addr":"10.20.193.192:6814/2609613895","heartbeat_back_addr":"10.20.193.192:6816/2609613895","heartbeat_front_addr":"10.20.193.192:6815/2609613895","state":["exists","up"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6812","nonce":912549195}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6813","nonce":912549195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6815","nonce":912549195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6814","nonce":912549195}]},"public_addr":"10.20.193.161:6812/912549195","cluster_addr":"10.20.193.161:6813/912549195","heartbeat_back_addr":"10.20.193.161:6815/912549195","heartbeat_front_addr":"10.20.193.161:6814/912549195","state":["exists","up"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6801","nonce":929821092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6802","nonce":929821092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6804","nonce":929821092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6803","nonce":929821092}]},"public_addr":"10.20.193.192:6801/929821092","cluster_addr":"10.20.193.192:6802/929821092","heartbeat_back_addr":"10.20.193.192:6804/929821092","heartbeat_front_addr":"10.20.193.192:6803/929821092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.437982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.345874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.095843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.642232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.159302+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.655964+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.011968+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.526700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:45.782 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:45.771+0000 77b8940 -1 bdev(0x16f09e70 /var/lib/ceph/osd/ceph-10/block) aio_submit retries 4 2026-02-26T02:47:45.787 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.762+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.789 DEBUG:teuthology.misc:9 of 16 OSDs are up 2026-02-26T02:47:45.804 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.767+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:45.805 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:45.785+0000 77b8940 -1 bdev(0x1977e050 /var/lib/ceph/osd/ceph-12/block) aio_submit retries 1 2026-02-26T02:47:46.069 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:46.063+0000 d6b1640 -1 osd.2 0 waiting for initial osdmap 2026-02-26T02:47:46.219 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.196+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-26T02:47:46.220 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.207+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.221 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.218+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.221 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.219+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.238 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.220+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.239 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.226+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.243 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:46.239+0000 d6b1640 -1 osd.0 0 waiting for initial osdmap 2026-02-26T02:47:46.245 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.237+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.256 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.253+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.262 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.243+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.269 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.232+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.274 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.261+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.281 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.268+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.285 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.273+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.288 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:46.284+0000 ce9e640 -1 osd.10 0 waiting for initial osdmap 2026-02-26T02:47:46.300 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.279+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.302 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.289+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.312 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:47:46.303+0000 15c7e640 -1 osd.2 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:46.314 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.301+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.324 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:46.320+0000 ce9e640 -1 osd.12 0 waiting for initial osdmap 2026-02-26T02:47:46.329 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.323+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.334 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.297+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.349 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.339+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.355 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.347+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.360 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.328+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-26T02:47:46.361 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.313+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.367 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.353+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.372 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.359+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.373 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.365+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.383 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.360+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 3 2026-02-26T02:47:46.383 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.375+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.391 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.382+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.403 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.371+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.403 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.402+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.414 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.413+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.415 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.387+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.416 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.411+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.428 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.413+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.428 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.415+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.429 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.416+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.441 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.428+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.452 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.426+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.452 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.431+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.456 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.451+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 3 2026-02-26T02:47:46.456 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.449+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.472 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.437+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-26T02:47:46.472 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.450+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.485 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.456+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.488 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.458+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.489 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.471+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.494 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.486+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.494 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.492+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.501 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.484+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.501 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.488+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.504 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:47:46.495+0000 15c7e640 -1 osd.0 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:46.509 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.498+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.519 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.501+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.520 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.500+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.520 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.507+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.521 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.507+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.522 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:47:46.513+0000 15c7e640 -1 osd.10 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:46.525 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.518+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.526 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.518+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.540 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.538+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.553 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.525+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.561 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.519+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.561 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.533+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.563 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.560+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 4 2026-02-26T02:47:46.566 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.549+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 3 2026-02-26T02:47:46.567 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.559+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.568 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.564+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.578 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.573+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.584 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:47:46.576+0000 15c7e640 -1 osd.12 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:46.586 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.561+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.594 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.565+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.604 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.602+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 5 2026-02-26T02:47:46.624 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.573+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.637 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.610+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.638 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.637+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-26T02:47:46.644 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.585+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.658 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.636+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.666 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.593+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.666 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.620+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.666 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.623+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.667 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.664+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.676 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.665+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.681 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.654+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.689 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.675+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.693 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.679+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.696 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.694+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 3 2026-02-26T02:47:46.699 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.692+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.713 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.668+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 6 2026-02-26T02:47:46.714 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.693+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.719 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.698+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-26T02:47:46.721 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.711+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.724 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:46.721+0000 77b8940 -1 bdev(0x16f125c0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 3 2026-02-26T02:47:46.727 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.713+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 3 2026-02-26T02:47:46.737 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:46.731+0000 77b8940 -1 bdev(0x197e3650 /var/lib/ceph/osd/ceph-8/block) aio_submit retries 1 2026-02-26T02:47:46.740 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.727+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.746 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.739+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.752 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.745+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:46.760 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:46.751+0000 77b8940 -1 bdev(0x16f11fb0 /var/lib/ceph/osd/ceph-13/block) aio_submit retries 1 2026-02-26T02:47:47.158 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:47.155+0000 d6b1640 -1 osd.5 0 waiting for initial osdmap 2026-02-26T02:47:47.189 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:47.184+0000 ce9e640 -1 osd.8 0 waiting for initial osdmap 2026-02-26T02:47:47.271 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:47.268+0000 d6b1640 -1 osd.13 0 waiting for initial osdmap 2026-02-26T02:47:47.392 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:47:47.384+0000 15c7e640 -1 osd.5 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:47.447 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:47:47.438+0000 15c7e640 -1 osd.8 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:47.505 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:47:47.496+0000 15c7e640 -1 osd.13 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-26T02:47:53.398 DEBUG:teuthology.orchestra.run.trial093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:53.702 INFO:teuthology.misc.health.trial093.stdout: 2026-02-26T02:47:53.703 INFO:teuthology.misc.health.trial093.stdout:{"epoch":27,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:47:48.996518+0000","last_up_change":"2026-02-26T02:47:47.928586+0000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T02:47:43.283460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":3205567943}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":3205567943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":3205567943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":3205567943}]},"public_addr":"10.20.193.93:6800/3205567943","cluster_addr":"10.20.193.93:6801/3205567943","heartbeat_back_addr":"10.20.193.93:6804/3205567943","heartbeat_front_addr":"10.20.193.93:6802/3205567943","state":["exists","up"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6811","nonce":2110814708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6813","nonce":2110814708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6815","nonce":2110814708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6814","nonce":2110814708}]},"public_addr":"10.20.193.130:6811/2110814708","cluster_addr":"10.20.193.130:6813/2110814708","heartbeat_back_addr":"10.20.193.130:6815/2110814708","heartbeat_front_addr":"10.20.193.130:6814/2110814708","state":["exists","up"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6804","nonce":1511765103}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6805","nonce":1511765103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6808","nonce":1511765103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6807","nonce":1511765103}]},"public_addr":"10.20.193.161:6804/1511765103","cluster_addr":"10.20.193.161:6805/1511765103","heartbeat_back_addr":"10.20.193.161:6808/1511765103","heartbeat_front_addr":"10.20.193.161:6807/1511765103","state":["exists","up"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6808","nonce":1838066642}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6810","nonce":1838066642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6812","nonce":1838066642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6811","nonce":1838066642}]},"public_addr":"10.20.193.192:6808/1838066642","cluster_addr":"10.20.193.192:6810/1838066642","heartbeat_back_addr":"10.20.193.192:6812/1838066642","heartbeat_front_addr":"10.20.193.192:6811/1838066642","state":["exists","up"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":2379549259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":2379549259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":2379549259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":2379549259}]},"public_addr":"10.20.193.93:6803/2379549259","cluster_addr":"10.20.193.93:6805/2379549259","heartbeat_back_addr":"10.20.193.93:6807/2379549259","heartbeat_front_addr":"10.20.193.93:6806/2379549259","state":["exists","up"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6808","nonce":2730554355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6809","nonce":2730554355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6812","nonce":2730554355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6810","nonce":2730554355}]},"public_addr":"10.20.193.130:6808/2730554355","cluster_addr":"10.20.193.130:6809/2730554355","heartbeat_back_addr":"10.20.193.130:6812/2730554355","heartbeat_front_addr":"10.20.193.130:6810/2730554355","state":["exists","up"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6806","nonce":329633094}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6809","nonce":329633094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6811","nonce":329633094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6810","nonce":329633094}]},"public_addr":"10.20.193.161:6806/329633094","cluster_addr":"10.20.193.161:6809/329633094","heartbeat_back_addr":"10.20.193.161:6811/329633094","heartbeat_front_addr":"10.20.193.161:6810/329633094","state":["exists","up"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6805","nonce":1343240239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6806","nonce":1343240239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6809","nonce":1343240239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6807","nonce":1343240239}]},"public_addr":"10.20.193.192:6805/1343240239","cluster_addr":"10.20.193.192:6806/1343240239","heartbeat_back_addr":"10.20.193.192:6809/1343240239","heartbeat_front_addr":"10.20.193.192:6807/1343240239","state":["exists","up"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":4039757268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":4039757268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":4039757268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":4039757268}]},"public_addr":"10.20.193.93:6808/4039757268","cluster_addr":"10.20.193.93:6809/4039757268","heartbeat_back_addr":"10.20.193.93:6811/4039757268","heartbeat_front_addr":"10.20.193.93:6810/4039757268","state":["exists","up"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6800","nonce":1345968556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6801","nonce":1345968556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6803","nonce":1345968556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6802","nonce":1345968556}]},"public_addr":"10.20.193.130:6800/1345968556","cluster_addr":"10.20.193.130:6801/1345968556","heartbeat_back_addr":"10.20.193.130:6803/1345968556","heartbeat_front_addr":"10.20.193.130:6802/1345968556","state":["exists","up"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6800","nonce":1687791223}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6801","nonce":1687791223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6803","nonce":1687791223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6802","nonce":1687791223}]},"public_addr":"10.20.193.161:6800/1687791223","cluster_addr":"10.20.193.161:6801/1687791223","heartbeat_back_addr":"10.20.193.161:6803/1687791223","heartbeat_front_addr":"10.20.193.161:6802/1687791223","state":["exists","up"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6813","nonce":2609613895}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6814","nonce":2609613895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6816","nonce":2609613895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6815","nonce":2609613895}]},"public_addr":"10.20.193.192:6813/2609613895","cluster_addr":"10.20.193.192:6814/2609613895","heartbeat_back_addr":"10.20.193.192:6816/2609613895","heartbeat_front_addr":"10.20.193.192:6815/2609613895","state":["exists","up"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":2330002550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":2330002550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":2330002550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":2330002550}]},"public_addr":"10.20.193.93:6812/2330002550","cluster_addr":"10.20.193.93:6813/2330002550","heartbeat_back_addr":"10.20.193.93:6815/2330002550","heartbeat_front_addr":"10.20.193.93:6814/2330002550","state":["exists","up"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6804","nonce":767940315}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6805","nonce":767940315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6807","nonce":767940315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6806","nonce":767940315}]},"public_addr":"10.20.193.130:6804/767940315","cluster_addr":"10.20.193.130:6805/767940315","heartbeat_back_addr":"10.20.193.130:6807/767940315","heartbeat_front_addr":"10.20.193.130:6806/767940315","state":["exists","up"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6812","nonce":912549195}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6813","nonce":912549195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6815","nonce":912549195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6814","nonce":912549195}]},"public_addr":"10.20.193.161:6812/912549195","cluster_addr":"10.20.193.161:6813/912549195","heartbeat_back_addr":"10.20.193.161:6815/912549195","heartbeat_front_addr":"10.20.193.161:6814/912549195","state":["exists","up"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6801","nonce":929821092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6802","nonce":929821092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6804","nonce":929821092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6803","nonce":929821092}]},"public_addr":"10.20.193.192:6801/929821092","cluster_addr":"10.20.193.192:6802/929821092","heartbeat_back_addr":"10.20.193.192:6804/929821092","heartbeat_front_addr":"10.20.193.192:6803/929821092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.243844+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.836784+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167459+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.437982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.345874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.701133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.095843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.642232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.678718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.159302+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.953509+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.655964+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167304+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.766889+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.011968+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.526700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:53.712 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-26T02:47:53.712 INFO:tasks.ceph:Creating RBD pool 2026-02-26T02:47:53.712 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-26T02:47:54.687 INFO:teuthology.orchestra.run.trial093.stderr:pool 'rbd' created 2026-02-26T02:47:54.699 DEBUG:teuthology.orchestra.run.trial093:> rbd --cluster ceph pool init rbd 2026-02-26T02:47:56.436 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:22.092 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.439 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:22.094 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.465 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:22.118 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.466 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:22.121 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.467 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:22.087 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.467 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:22.120 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.468 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:22.088 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.493 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:22.145 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:56.495 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:22.115 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:47:59.036 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-26T02:47:59.036 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-26T02:47:59.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-26T02:47:59.036 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-26T02:47:59.037 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-26T02:47:59.385 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:47:59.393 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6800","nonce":2108352258}]},"active_addr":"10.20.193.192:6800/2108352258","active_change":"2026-02-26T02:46:05.002843+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.192:0","nonce":2953709841}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.192:0","nonce":2946256756}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.192:0","nonce":2696650054}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.192:0","nonce":487242256}]}]} 2026-02-26T02:47:59.395 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-26T02:47:59.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-26T02:47:59.396 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T02:47:59.682 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:47:59.682 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":32,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:47:58.849879+0000","last_up_change":"2026-02-26T02:47:47.928586+0000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T02:47:43.283460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-26T02:47:53.985488+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.0399999618530273,"score_stable":6.0399999618530273,"optimal_score":0.56000000238418579,"raw_score_acting":3.380000114440918,"raw_score_stable":3.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":3205567943}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":3205567943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":3205567943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":3205567943}]},"public_addr":"10.20.193.93:6800/3205567943","cluster_addr":"10.20.193.93:6801/3205567943","heartbeat_back_addr":"10.20.193.93:6804/3205567943","heartbeat_front_addr":"10.20.193.93:6802/3205567943","state":["exists","up"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6811","nonce":2110814708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6813","nonce":2110814708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6815","nonce":2110814708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6814","nonce":2110814708}]},"public_addr":"10.20.193.130:6811/2110814708","cluster_addr":"10.20.193.130:6813/2110814708","heartbeat_back_addr":"10.20.193.130:6815/2110814708","heartbeat_front_addr":"10.20.193.130:6814/2110814708","state":["exists","up"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6804","nonce":1511765103}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6805","nonce":1511765103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6808","nonce":1511765103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6807","nonce":1511765103}]},"public_addr":"10.20.193.161:6804/1511765103","cluster_addr":"10.20.193.161:6805/1511765103","heartbeat_back_addr":"10.20.193.161:6808/1511765103","heartbeat_front_addr":"10.20.193.161:6807/1511765103","state":["exists","up"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6808","nonce":1838066642}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6810","nonce":1838066642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6812","nonce":1838066642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6811","nonce":1838066642}]},"public_addr":"10.20.193.192:6808/1838066642","cluster_addr":"10.20.193.192:6810/1838066642","heartbeat_back_addr":"10.20.193.192:6812/1838066642","heartbeat_front_addr":"10.20.193.192:6811/1838066642","state":["exists","up"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":2379549259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":2379549259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":2379549259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":2379549259}]},"public_addr":"10.20.193.93:6803/2379549259","cluster_addr":"10.20.193.93:6805/2379549259","heartbeat_back_addr":"10.20.193.93:6807/2379549259","heartbeat_front_addr":"10.20.193.93:6806/2379549259","state":["exists","up"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6808","nonce":2730554355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6809","nonce":2730554355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6812","nonce":2730554355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6810","nonce":2730554355}]},"public_addr":"10.20.193.130:6808/2730554355","cluster_addr":"10.20.193.130:6809/2730554355","heartbeat_back_addr":"10.20.193.130:6812/2730554355","heartbeat_front_addr":"10.20.193.130:6810/2730554355","state":["exists","up"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6806","nonce":329633094}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6809","nonce":329633094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6811","nonce":329633094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6810","nonce":329633094}]},"public_addr":"10.20.193.161:6806/329633094","cluster_addr":"10.20.193.161:6809/329633094","heartbeat_back_addr":"10.20.193.161:6811/329633094","heartbeat_front_addr":"10.20.193.161:6810/329633094","state":["exists","up"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6805","nonce":1343240239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6806","nonce":1343240239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6809","nonce":1343240239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6807","nonce":1343240239}]},"public_addr":"10.20.193.192:6805/1343240239","cluster_addr":"10.20.193.192:6806/1343240239","heartbeat_back_addr":"10.20.193.192:6809/1343240239","heartbeat_front_addr":"10.20.193.192:6807/1343240239","state":["exists","up"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":4039757268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":4039757268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":4039757268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":4039757268}]},"public_addr":"10.20.193.93:6808/4039757268","cluster_addr":"10.20.193.93:6809/4039757268","heartbeat_back_addr":"10.20.193.93:6811/4039757268","heartbeat_front_addr":"10.20.193.93:6810/4039757268","state":["exists","up"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6800","nonce":1345968556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6801","nonce":1345968556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6803","nonce":1345968556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6802","nonce":1345968556}]},"public_addr":"10.20.193.130:6800/1345968556","cluster_addr":"10.20.193.130:6801/1345968556","heartbeat_back_addr":"10.20.193.130:6803/1345968556","heartbeat_front_addr":"10.20.193.130:6802/1345968556","state":["exists","up"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6800","nonce":1687791223}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6801","nonce":1687791223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6803","nonce":1687791223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6802","nonce":1687791223}]},"public_addr":"10.20.193.161:6800/1687791223","cluster_addr":"10.20.193.161:6801/1687791223","heartbeat_back_addr":"10.20.193.161:6803/1687791223","heartbeat_front_addr":"10.20.193.161:6802/1687791223","state":["exists","up"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6813","nonce":2609613895}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6814","nonce":2609613895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6816","nonce":2609613895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6815","nonce":2609613895}]},"public_addr":"10.20.193.192:6813/2609613895","cluster_addr":"10.20.193.192:6814/2609613895","heartbeat_back_addr":"10.20.193.192:6816/2609613895","heartbeat_front_addr":"10.20.193.192:6815/2609613895","state":["exists","up"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":2330002550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":2330002550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":2330002550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":2330002550}]},"public_addr":"10.20.193.93:6812/2330002550","cluster_addr":"10.20.193.93:6813/2330002550","heartbeat_back_addr":"10.20.193.93:6815/2330002550","heartbeat_front_addr":"10.20.193.93:6814/2330002550","state":["exists","up"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6804","nonce":767940315}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6805","nonce":767940315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6807","nonce":767940315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6806","nonce":767940315}]},"public_addr":"10.20.193.130:6804/767940315","cluster_addr":"10.20.193.130:6805/767940315","heartbeat_back_addr":"10.20.193.130:6807/767940315","heartbeat_front_addr":"10.20.193.130:6806/767940315","state":["exists","up"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6812","nonce":912549195}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6813","nonce":912549195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6815","nonce":912549195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6814","nonce":912549195}]},"public_addr":"10.20.193.161:6812/912549195","cluster_addr":"10.20.193.161:6813/912549195","heartbeat_back_addr":"10.20.193.161:6815/912549195","heartbeat_front_addr":"10.20.193.161:6814/912549195","state":["exists","up"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6801","nonce":929821092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6802","nonce":929821092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6804","nonce":929821092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6803","nonce":929821092}]},"public_addr":"10.20.193.192:6801/929821092","cluster_addr":"10.20.193.192:6802/929821092","heartbeat_back_addr":"10.20.193.192:6804/929821092","heartbeat_front_addr":"10.20.193.192:6803/929821092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.243844+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.836784+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167459+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.437982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.345874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.701133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.095843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.642232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.678718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.159302+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.953509+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.655964+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167304+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.766889+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.011968+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.526700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:47:59.694 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-26T02:47:59.695 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T02:48:00.007 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:00.007 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":32,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:47:58.849879+0000","last_up_change":"2026-02-26T02:47:47.928586+0000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T02:47:43.283460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-26T02:47:53.985488+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.0399999618530273,"score_stable":6.0399999618530273,"optimal_score":0.56000000238418579,"raw_score_acting":3.380000114440918,"raw_score_stable":3.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":3205567943}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":3205567943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":3205567943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":3205567943}]},"public_addr":"10.20.193.93:6800/3205567943","cluster_addr":"10.20.193.93:6801/3205567943","heartbeat_back_addr":"10.20.193.93:6804/3205567943","heartbeat_front_addr":"10.20.193.93:6802/3205567943","state":["exists","up"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6811","nonce":2110814708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6813","nonce":2110814708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6815","nonce":2110814708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6814","nonce":2110814708}]},"public_addr":"10.20.193.130:6811/2110814708","cluster_addr":"10.20.193.130:6813/2110814708","heartbeat_back_addr":"10.20.193.130:6815/2110814708","heartbeat_front_addr":"10.20.193.130:6814/2110814708","state":["exists","up"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6804","nonce":1511765103}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6805","nonce":1511765103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6808","nonce":1511765103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6807","nonce":1511765103}]},"public_addr":"10.20.193.161:6804/1511765103","cluster_addr":"10.20.193.161:6805/1511765103","heartbeat_back_addr":"10.20.193.161:6808/1511765103","heartbeat_front_addr":"10.20.193.161:6807/1511765103","state":["exists","up"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6808","nonce":1838066642}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6810","nonce":1838066642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6812","nonce":1838066642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6811","nonce":1838066642}]},"public_addr":"10.20.193.192:6808/1838066642","cluster_addr":"10.20.193.192:6810/1838066642","heartbeat_back_addr":"10.20.193.192:6812/1838066642","heartbeat_front_addr":"10.20.193.192:6811/1838066642","state":["exists","up"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":2379549259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":2379549259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":2379549259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":2379549259}]},"public_addr":"10.20.193.93:6803/2379549259","cluster_addr":"10.20.193.93:6805/2379549259","heartbeat_back_addr":"10.20.193.93:6807/2379549259","heartbeat_front_addr":"10.20.193.93:6806/2379549259","state":["exists","up"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6808","nonce":2730554355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6809","nonce":2730554355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6812","nonce":2730554355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6810","nonce":2730554355}]},"public_addr":"10.20.193.130:6808/2730554355","cluster_addr":"10.20.193.130:6809/2730554355","heartbeat_back_addr":"10.20.193.130:6812/2730554355","heartbeat_front_addr":"10.20.193.130:6810/2730554355","state":["exists","up"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6806","nonce":329633094}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6809","nonce":329633094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6811","nonce":329633094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6810","nonce":329633094}]},"public_addr":"10.20.193.161:6806/329633094","cluster_addr":"10.20.193.161:6809/329633094","heartbeat_back_addr":"10.20.193.161:6811/329633094","heartbeat_front_addr":"10.20.193.161:6810/329633094","state":["exists","up"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6805","nonce":1343240239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6806","nonce":1343240239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6809","nonce":1343240239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6807","nonce":1343240239}]},"public_addr":"10.20.193.192:6805/1343240239","cluster_addr":"10.20.193.192:6806/1343240239","heartbeat_back_addr":"10.20.193.192:6809/1343240239","heartbeat_front_addr":"10.20.193.192:6807/1343240239","state":["exists","up"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":4039757268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":4039757268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":4039757268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":4039757268}]},"public_addr":"10.20.193.93:6808/4039757268","cluster_addr":"10.20.193.93:6809/4039757268","heartbeat_back_addr":"10.20.193.93:6811/4039757268","heartbeat_front_addr":"10.20.193.93:6810/4039757268","state":["exists","up"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6800","nonce":1345968556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6801","nonce":1345968556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6803","nonce":1345968556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6802","nonce":1345968556}]},"public_addr":"10.20.193.130:6800/1345968556","cluster_addr":"10.20.193.130:6801/1345968556","heartbeat_back_addr":"10.20.193.130:6803/1345968556","heartbeat_front_addr":"10.20.193.130:6802/1345968556","state":["exists","up"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6800","nonce":1687791223}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6801","nonce":1687791223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6803","nonce":1687791223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6802","nonce":1687791223}]},"public_addr":"10.20.193.161:6800/1687791223","cluster_addr":"10.20.193.161:6801/1687791223","heartbeat_back_addr":"10.20.193.161:6803/1687791223","heartbeat_front_addr":"10.20.193.161:6802/1687791223","state":["exists","up"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6813","nonce":2609613895}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6814","nonce":2609613895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6816","nonce":2609613895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6815","nonce":2609613895}]},"public_addr":"10.20.193.192:6813/2609613895","cluster_addr":"10.20.193.192:6814/2609613895","heartbeat_back_addr":"10.20.193.192:6816/2609613895","heartbeat_front_addr":"10.20.193.192:6815/2609613895","state":["exists","up"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":2330002550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":2330002550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":2330002550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":2330002550}]},"public_addr":"10.20.193.93:6812/2330002550","cluster_addr":"10.20.193.93:6813/2330002550","heartbeat_back_addr":"10.20.193.93:6815/2330002550","heartbeat_front_addr":"10.20.193.93:6814/2330002550","state":["exists","up"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6804","nonce":767940315}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6805","nonce":767940315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6807","nonce":767940315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6806","nonce":767940315}]},"public_addr":"10.20.193.130:6804/767940315","cluster_addr":"10.20.193.130:6805/767940315","heartbeat_back_addr":"10.20.193.130:6807/767940315","heartbeat_front_addr":"10.20.193.130:6806/767940315","state":["exists","up"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6812","nonce":912549195}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6813","nonce":912549195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6815","nonce":912549195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6814","nonce":912549195}]},"public_addr":"10.20.193.161:6812/912549195","cluster_addr":"10.20.193.161:6813/912549195","heartbeat_back_addr":"10.20.193.161:6815/912549195","heartbeat_front_addr":"10.20.193.161:6814/912549195","state":["exists","up"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6801","nonce":929821092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6802","nonce":929821092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6804","nonce":929821092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6803","nonce":929821092}]},"public_addr":"10.20.193.192:6801/929821092","cluster_addr":"10.20.193.192:6802/929821092","heartbeat_back_addr":"10.20.193.192:6804/929821092","heartbeat_front_addr":"10.20.193.192:6803/929821092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.243844+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.836784+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167459+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.437982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.345874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.701133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.095843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.642232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.678718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.159302+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.953509+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.655964+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167304+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.766889+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.011968+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.526700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:48:00.019 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-26T02:48:00.019 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-26T02:48:00.020 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-26T02:48:00.020 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-26T02:48:00.021 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-26T02:48:00.021 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-26T02:48:00.022 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-26T02:48:00.022 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-26T02:48:00.023 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-26T02:48:00.023 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-26T02:48:00.024 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-26T02:48:00.024 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-26T02:48:00.025 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-26T02:48:00.025 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-26T02:48:00.025 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-26T02:48:00.026 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-26T02:48:00.243 INFO:teuthology.orchestra.run.trial093.stdout:90194313222 2026-02-26T02:48:00.243 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-26T02:48:00.250 INFO:teuthology.orchestra.run.trial093.stdout:94489280518 2026-02-26T02:48:00.250 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-26T02:48:00.257 INFO:teuthology.orchestra.run.trial093.stdout:107374182405 2026-02-26T02:48:00.258 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-26T02:48:00.264 INFO:teuthology.orchestra.run.trial093.stdout:107374182405 2026-02-26T02:48:00.264 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-26T02:48:00.267 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:00.268 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-26T02:48:00.280 INFO:teuthology.orchestra.run.trial093.stdout:111669149702 2026-02-26T02:48:00.281 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-26T02:48:00.296 INFO:teuthology.orchestra.run.trial093.stdout:107374182404 2026-02-26T02:48:00.296 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-26T02:48:00.307 INFO:teuthology.orchestra.run.trial093.stdout:111669149700 2026-02-26T02:48:00.307 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-26T02:48:00.309 INFO:teuthology.orchestra.run.trial093.stdout:107374182404 2026-02-26T02:48:00.309 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-26T02:48:00.315 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:00.316 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-26T02:48:00.324 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:00.324 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-26T02:48:00.332 INFO:teuthology.orchestra.run.trial093.stdout:94489280518 2026-02-26T02:48:00.332 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-26T02:48:00.334 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:00.334 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-26T02:48:00.336 INFO:teuthology.orchestra.run.trial093.stdout:94489280519 2026-02-26T02:48:00.336 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-26T02:48:00.342 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:00.342 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-26T02:48:00.366 INFO:teuthology.orchestra.run.trial093.stdout:111669149702 2026-02-26T02:48:00.366 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-26T02:48:00.829 INFO:teuthology.orchestra.run.trial093.stdout:94489280516 2026-02-26T02:48:00.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.3 2026-02-26T02:48:00.844 INFO:teuthology.orchestra.run.trial093.stdout:90194313220 2026-02-26T02:48:00.848 INFO:teuthology.orchestra.run.trial093.stdout:111669149701 2026-02-26T02:48:00.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.14 2026-02-26T02:48:00.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.5 2026-02-26T02:48:00.882 INFO:teuthology.orchestra.run.trial093.stdout:107374182404 2026-02-26T02:48:00.885 INFO:teuthology.orchestra.run.trial093.stdout:90194313220 2026-02-26T02:48:00.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182404 for osd.0 2026-02-26T02:48:00.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.11 2026-02-26T02:48:00.944 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:00.952 INFO:teuthology.orchestra.run.trial093.stdout:111669149699 2026-02-26T02:48:00.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313221 for osd.7 2026-02-26T02:48:00.958 INFO:teuthology.orchestra.run.trial093.stdout:94489280517 2026-02-26T02:48:00.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149700 got 111669149699 for osd.13 2026-02-26T02:48:00.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280519 got 94489280517 for osd.1 2026-02-26T02:48:01.035 INFO:teuthology.orchestra.run.trial093.stdout:90194313220 2026-02-26T02:48:01.037 INFO:teuthology.orchestra.run.trial093.stdout:107374182403 2026-02-26T02:48:01.041 INFO:teuthology.orchestra.run.trial093.stdout:90194313220 2026-02-26T02:48:01.043 INFO:teuthology.orchestra.run.trial093.stdout:94489280516 2026-02-26T02:48:01.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.6 2026-02-26T02:48:01.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182404 got 107374182403 for osd.2 2026-02-26T02:48:01.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.15 2026-02-26T02:48:01.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.4 2026-02-26T02:48:01.068 INFO:teuthology.orchestra.run.trial093.stdout:107374182404 2026-02-26T02:48:01.071 INFO:teuthology.orchestra.run.trial093.stdout:107374182403 2026-02-26T02:48:01.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182404 for osd.10 2026-02-26T02:48:01.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182404 got 107374182403 for osd.12 2026-02-26T02:48:01.128 INFO:teuthology.orchestra.run.trial093.stdout:111669149701 2026-02-26T02:48:01.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.8 2026-02-26T02:48:01.159 INFO:teuthology.orchestra.run.trial093.stdout:90194313220 2026-02-26T02:48:01.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.9 2026-02-26T02:48:01.842 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-26T02:48:01.855 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-26T02:48:01.861 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-26T02:48:01.895 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-26T02:48:01.896 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-26T02:48:01.958 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-26T02:48:01.965 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-26T02:48:01.970 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-26T02:48:02.047 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-26T02:48:02.048 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-26T02:48:02.053 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-26T02:48:02.054 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-26T02:48:02.080 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-26T02:48:02.082 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-26T02:48:02.141 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-26T02:48:02.171 INFO:teuthology.orchestra.run.trial093.stdout:90194313220 2026-02-26T02:48:02.171 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-26T02:48:02.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.14 2026-02-26T02:48:02.273 INFO:teuthology.orchestra.run.trial093.stdout:107374182404 2026-02-26T02:48:02.275 INFO:teuthology.orchestra.run.trial093.stdout:94489280516 2026-02-26T02:48:02.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182404 for osd.0 2026-02-26T02:48:02.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280516 for osd.3 2026-02-26T02:48:02.357 INFO:teuthology.orchestra.run.trial093.stdout:90194313220 2026-02-26T02:48:02.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.11 2026-02-26T02:48:02.385 INFO:teuthology.orchestra.run.trial093.stdout:111669149701 2026-02-26T02:48:02.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.5 2026-02-26T02:48:02.479 INFO:teuthology.orchestra.run.trial093.stdout:111669149700 2026-02-26T02:48:02.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149700 got 111669149700 for osd.13 2026-02-26T02:48:02.491 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:02.507 INFO:teuthology.orchestra.run.trial093.stdout:90194313222 2026-02-26T02:48:02.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313222 for osd.7 2026-02-26T02:48:02.518 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:02.595 INFO:teuthology.orchestra.run.trial093.stdout:94489280519 2026-02-26T02:48:02.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280519 got 94489280519 for osd.1 2026-02-26T02:48:02.606 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:02.894 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:02.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.15 2026-02-26T02:48:02.905 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:02.906 INFO:teuthology.orchestra.run.trial093.stdout:111669149702 2026-02-26T02:48:02.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149702 for osd.8 2026-02-26T02:48:02.915 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.008 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:03.011 INFO:teuthology.orchestra.run.trial093.stdout:107374182404 2026-02-26T02:48:03.012 INFO:teuthology.orchestra.run.trial093.stdout:94489280518 2026-02-26T02:48:03.013 INFO:teuthology.orchestra.run.trial093.stdout:107374182404 2026-02-26T02:48:03.016 INFO:teuthology.orchestra.run.trial093.stdout:107374182405 2026-02-26T02:48:03.019 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:03.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.6 2026-02-26T02:48:03.021 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.4 2026-02-26T02:48:03.023 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182404 got 107374182404 for osd.12 2026-02-26T02:48:03.024 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182404 got 107374182404 for osd.2 2026-02-26T02:48:03.026 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182405 for osd.10 2026-02-26T02:48:03.028 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.9 2026-02-26T02:48:03.030 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.183 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-26T02:48:03.285 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-26T02:48:03.287 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-26T02:48:03.368 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-26T02:48:03.397 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-26T02:48:03.578 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:03.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.14 2026-02-26T02:48:03.589 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.596 INFO:teuthology.orchestra.run.trial093.stdout:107374182405 2026-02-26T02:48:03.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182405 for osd.0 2026-02-26T02:48:03.609 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.652 INFO:teuthology.orchestra.run.trial093.stdout:90194313221 2026-02-26T02:48:03.659 INFO:teuthology.orchestra.run.trial093.stdout:94489280518 2026-02-26T02:48:03.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.11 2026-02-26T02:48:03.662 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.3 2026-02-26T02:48:03.670 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.684 INFO:teuthology.orchestra.run.trial093.stdout:111669149702 2026-02-26T02:48:03.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149702 for osd.5 2026-02-26T02:48:03.695 DEBUG:teuthology.parallel:result is None 2026-02-26T02:48:03.695 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-26T02:48:03.696 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T02:48:04.006 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:04.006 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-26T02:48:04.015 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2026-02-26T02:48:03.116174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":436524,"kb_used_data":5060,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509512916,"statfs":{"total":1546188226560,"available":1545741225984,"internally_reserved":0,"allocated":5181440,"data_stored":2820276,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":25505,"internal_metadata":441424991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.339960"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.023069+0000","last_change":"2026-02-26T02:47:59.026201+0000","last_active":"2026-02-26T02:47:59.023069+0000","last_peered":"2026-02-26T02:47:59.023069+0000","last_clean":"2026-02-26T02:47:59.023069+0000","last_became_active":"2026-02-26T02:47:57.173989+0000","last_became_peered":"2026-02-26T02:47:57.173989+0000","last_unstale":"2026-02-26T02:47:59.023069+0000","last_undegraded":"2026-02-26T02:47:59.023069+0000","last_fullsized":"2026-02-26T02:47:59.023069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:12:37.304094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040112822999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.036557+0000","last_change":"2026-02-26T02:47:59.057491+0000","last_active":"2026-02-26T02:47:59.036557+0000","last_peered":"2026-02-26T02:47:59.036557+0000","last_clean":"2026-02-26T02:47:59.036557+0000","last_became_active":"2026-02-26T02:47:55.910369+0000","last_became_peered":"2026-02-26T02:47:55.910369+0000","last_unstale":"2026-02-26T02:47:59.036557+0000","last_undegraded":"2026-02-26T02:47:59.036557+0000","last_fullsized":"2026-02-26T02:47:59.036557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T06:33:07.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034663316,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.234151+0000","last_change":"2026-02-26T02:47:59.253229+0000","last_active":"2026-02-26T02:47:59.234151+0000","last_peered":"2026-02-26T02:47:59.234151+0000","last_clean":"2026-02-26T02:47:59.234151+0000","last_became_active":"2026-02-26T02:47:56.652518+0000","last_became_peered":"2026-02-26T02:47:56.652518+0000","last_unstale":"2026-02-26T02:47:59.234151+0000","last_undegraded":"2026-02-26T02:47:59.234151+0000","last_fullsized":"2026-02-26T02:47:59.234151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:41:01.948058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032313311999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.249213+0000","last_change":"2026-02-26T02:47:59.249213+0000","last_active":"2026-02-26T02:47:59.249213+0000","last_peered":"2026-02-26T02:47:59.249213+0000","last_clean":"2026-02-26T02:47:59.249213+0000","last_became_active":"2026-02-26T02:47:55.938167+0000","last_became_peered":"2026-02-26T02:47:55.938167+0000","last_unstale":"2026-02-26T02:47:59.249213+0000","last_undegraded":"2026-02-26T02:47:59.249213+0000","last_fullsized":"2026-02-26T02:47:59.249213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:49:29.252756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031891388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.018080+0000","last_change":"2026-02-26T02:47:59.018080+0000","last_active":"2026-02-26T02:47:59.018080+0000","last_peered":"2026-02-26T02:47:59.018080+0000","last_clean":"2026-02-26T02:47:59.018080+0000","last_became_active":"2026-02-26T02:47:57.060001+0000","last_became_peered":"2026-02-26T02:47:57.060001+0000","last_unstale":"2026-02-26T02:47:59.018080+0000","last_undegraded":"2026-02-26T02:47:59.018080+0000","last_fullsized":"2026-02-26T02:47:59.018080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T10:10:50.898162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046366546000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.233977+0000","last_change":"2026-02-26T02:47:59.253290+0000","last_active":"2026-02-26T02:47:59.233977+0000","last_peered":"2026-02-26T02:47:59.233977+0000","last_clean":"2026-02-26T02:47:59.233977+0000","last_became_active":"2026-02-26T02:47:55.901979+0000","last_became_peered":"2026-02-26T02:47:55.901979+0000","last_unstale":"2026-02-26T02:47:59.233977+0000","last_undegraded":"2026-02-26T02:47:59.233977+0000","last_fullsized":"2026-02-26T02:47:59.233977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:43:54.801868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032069750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:58.989379+0000","last_change":"2026-02-26T02:47:59.022310+0000","last_active":"2026-02-26T02:47:58.989379+0000","last_peered":"2026-02-26T02:47:58.989379+0000","last_clean":"2026-02-26T02:47:58.989379+0000","last_became_active":"2026-02-26T02:47:57.137850+0000","last_became_peered":"2026-02-26T02:47:57.137850+0000","last_unstale":"2026-02-26T02:47:58.989379+0000","last_undegraded":"2026-02-26T02:47:58.989379+0000","last_fullsized":"2026-02-26T02:47:58.989379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T14:36:08.922833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059900058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"29'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.561577+0000","last_change":"2026-02-26T02:47:59.579526+0000","last_active":"2026-02-26T02:47:59.561577+0000","last_peered":"2026-02-26T02:47:59.561577+0000","last_clean":"2026-02-26T02:47:59.561577+0000","last_became_active":"2026-02-26T02:47:56.597889+0000","last_became_peered":"2026-02-26T02:47:56.597889+0000","last_unstale":"2026-02-26T02:47:59.561577+0000","last_undegraded":"2026-02-26T02:47:59.561577+0000","last_fullsized":"2026-02-26T02:47:59.561577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:44.686179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026549789000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"27'32","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.545284+0000","last_change":"2026-02-26T02:47:48.922725+0000","last_active":"2026-02-26T02:47:59.545284+0000","last_peered":"2026-02-26T02:47:59.545284+0000","last_clean":"2026-02-26T02:47:59.545284+0000","last_became_active":"2026-02-26T02:47:48.639409+0000","last_became_peered":"2026-02-26T02:47:48.639409+0000","last_unstale":"2026-02-26T02:47:59.545284+0000","last_undegraded":"2026-02-26T02:47:59.545284+0000","last_fullsized":"2026-02-26T02:47:59.545284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_clean_scrub_stamp":"2026-02-26T02:47:43.631487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:05:25.388360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":795680,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":26,"seq":111669149700,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27284,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,8,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":26,"seq":111669149702,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":323584,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":26,"seq":111669149702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":307200,"data_stored":119693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":21,"seq":90194313223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,4,6,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":323584,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,4,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":356352,"data_stored":524831,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,6,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,4,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":524831,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":25,"seq":107374182406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":25,"seq":107374182406,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,3,4,5,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":25,"seq":107374182405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T02:48:04.015 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T02:48:04.283 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:04.283 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-26T02:48:04.291 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2026-02-26T02:48:03.116174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":436524,"kb_used_data":5060,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509512916,"statfs":{"total":1546188226560,"available":1545741225984,"internally_reserved":0,"allocated":5181440,"data_stored":2820276,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":25505,"internal_metadata":441424991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.339960"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.023069+0000","last_change":"2026-02-26T02:47:59.026201+0000","last_active":"2026-02-26T02:47:59.023069+0000","last_peered":"2026-02-26T02:47:59.023069+0000","last_clean":"2026-02-26T02:47:59.023069+0000","last_became_active":"2026-02-26T02:47:57.173989+0000","last_became_peered":"2026-02-26T02:47:57.173989+0000","last_unstale":"2026-02-26T02:47:59.023069+0000","last_undegraded":"2026-02-26T02:47:59.023069+0000","last_fullsized":"2026-02-26T02:47:59.023069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:12:37.304094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040112822999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.036557+0000","last_change":"2026-02-26T02:47:59.057491+0000","last_active":"2026-02-26T02:47:59.036557+0000","last_peered":"2026-02-26T02:47:59.036557+0000","last_clean":"2026-02-26T02:47:59.036557+0000","last_became_active":"2026-02-26T02:47:55.910369+0000","last_became_peered":"2026-02-26T02:47:55.910369+0000","last_unstale":"2026-02-26T02:47:59.036557+0000","last_undegraded":"2026-02-26T02:47:59.036557+0000","last_fullsized":"2026-02-26T02:47:59.036557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T06:33:07.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034663316,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.234151+0000","last_change":"2026-02-26T02:47:59.253229+0000","last_active":"2026-02-26T02:47:59.234151+0000","last_peered":"2026-02-26T02:47:59.234151+0000","last_clean":"2026-02-26T02:47:59.234151+0000","last_became_active":"2026-02-26T02:47:56.652518+0000","last_became_peered":"2026-02-26T02:47:56.652518+0000","last_unstale":"2026-02-26T02:47:59.234151+0000","last_undegraded":"2026-02-26T02:47:59.234151+0000","last_fullsized":"2026-02-26T02:47:59.234151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:41:01.948058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032313311999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.249213+0000","last_change":"2026-02-26T02:47:59.249213+0000","last_active":"2026-02-26T02:47:59.249213+0000","last_peered":"2026-02-26T02:47:59.249213+0000","last_clean":"2026-02-26T02:47:59.249213+0000","last_became_active":"2026-02-26T02:47:55.938167+0000","last_became_peered":"2026-02-26T02:47:55.938167+0000","last_unstale":"2026-02-26T02:47:59.249213+0000","last_undegraded":"2026-02-26T02:47:59.249213+0000","last_fullsized":"2026-02-26T02:47:59.249213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:49:29.252756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031891388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.018080+0000","last_change":"2026-02-26T02:47:59.018080+0000","last_active":"2026-02-26T02:47:59.018080+0000","last_peered":"2026-02-26T02:47:59.018080+0000","last_clean":"2026-02-26T02:47:59.018080+0000","last_became_active":"2026-02-26T02:47:57.060001+0000","last_became_peered":"2026-02-26T02:47:57.060001+0000","last_unstale":"2026-02-26T02:47:59.018080+0000","last_undegraded":"2026-02-26T02:47:59.018080+0000","last_fullsized":"2026-02-26T02:47:59.018080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T10:10:50.898162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046366546000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.233977+0000","last_change":"2026-02-26T02:47:59.253290+0000","last_active":"2026-02-26T02:47:59.233977+0000","last_peered":"2026-02-26T02:47:59.233977+0000","last_clean":"2026-02-26T02:47:59.233977+0000","last_became_active":"2026-02-26T02:47:55.901979+0000","last_became_peered":"2026-02-26T02:47:55.901979+0000","last_unstale":"2026-02-26T02:47:59.233977+0000","last_undegraded":"2026-02-26T02:47:59.233977+0000","last_fullsized":"2026-02-26T02:47:59.233977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:43:54.801868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032069750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:58.989379+0000","last_change":"2026-02-26T02:47:59.022310+0000","last_active":"2026-02-26T02:47:58.989379+0000","last_peered":"2026-02-26T02:47:58.989379+0000","last_clean":"2026-02-26T02:47:58.989379+0000","last_became_active":"2026-02-26T02:47:57.137850+0000","last_became_peered":"2026-02-26T02:47:57.137850+0000","last_unstale":"2026-02-26T02:47:58.989379+0000","last_undegraded":"2026-02-26T02:47:58.989379+0000","last_fullsized":"2026-02-26T02:47:58.989379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T14:36:08.922833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059900058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"29'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.561577+0000","last_change":"2026-02-26T02:47:59.579526+0000","last_active":"2026-02-26T02:47:59.561577+0000","last_peered":"2026-02-26T02:47:59.561577+0000","last_clean":"2026-02-26T02:47:59.561577+0000","last_became_active":"2026-02-26T02:47:56.597889+0000","last_became_peered":"2026-02-26T02:47:56.597889+0000","last_unstale":"2026-02-26T02:47:59.561577+0000","last_undegraded":"2026-02-26T02:47:59.561577+0000","last_fullsized":"2026-02-26T02:47:59.561577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:44.686179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026549789000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"27'32","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-26T02:47:59.545284+0000","last_change":"2026-02-26T02:47:48.922725+0000","last_active":"2026-02-26T02:47:59.545284+0000","last_peered":"2026-02-26T02:47:59.545284+0000","last_clean":"2026-02-26T02:47:59.545284+0000","last_became_active":"2026-02-26T02:47:48.639409+0000","last_became_peered":"2026-02-26T02:47:48.639409+0000","last_unstale":"2026-02-26T02:47:59.545284+0000","last_undegraded":"2026-02-26T02:47:59.545284+0000","last_fullsized":"2026-02-26T02:47:59.545284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_clean_scrub_stamp":"2026-02-26T02:47:43.631487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:05:25.388360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":795680,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":26,"seq":111669149700,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27284,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,8,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":26,"seq":111669149702,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":323584,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":26,"seq":111669149702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":307200,"data_stored":119693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":21,"seq":90194313223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,4,6,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":323584,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,4,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":356352,"data_stored":524831,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,6,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,4,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":524831,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":25,"seq":107374182406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":25,"seq":107374182406,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,3,4,5,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":25,"seq":107374182405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27276,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":319488,"data_stored":126991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T02:48:04.292 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-26T02:48:04.292 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-26T02:48:04.293 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-26T02:48:04.293 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:04.583 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:04.583 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:07.593 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:07.884 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:07.884 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:10.894 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:11.188 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:11.188 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:14.200 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:14.493 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:14.493 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:16.453 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:42.108 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.480 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:42.133 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.482 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:42.134 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.483 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:42.103 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.483 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:42.137 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.484 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:42.104 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.494 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:02:42.149 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.495 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:02:42.115 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:16.495 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:02:42.147 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:17.504 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:17.796 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:17.796 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:20.807 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:21.106 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:21.106 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:24.117 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:24.405 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:24.405 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:27.415 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:27.711 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:27.711 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:30.723 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:31.017 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:31.018 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:34.029 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:34.326 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:34.326 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:36.506 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:02.161 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.507 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:02.162 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.515 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:02.171 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.532 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:02.185 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.533 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:02.154 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.534 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:02.186 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.534 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:02.155 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.542 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:02.163 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:36.547 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:02.199 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:37.336 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:37.631 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:37.631 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:40.640 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:40.928 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:40.928 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:43.939 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:44.222 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:44.222 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:47.232 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:47.519 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:47.519 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:50.530 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:50.822 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:50.822 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:53.832 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:54.122 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:54.122 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:48:56.536 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:22.191 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.538 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:22.194 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.547 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:22.203 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.564 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:22.217 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.565 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:22.186 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.567 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:22.219 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.567 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:22.188 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.576 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:22.197 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:56.577 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:22.229 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:48:57.133 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:48:57.429 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:48:57.429 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:00.440 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:00.733 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:00.733 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:03.743 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:04.030 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:04.030 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:07.040 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:07.327 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:07.327 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:10.339 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:10.626 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:10.626 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:13.638 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:13.937 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:13.937 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:16.563 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:42.218 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.564 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:42.220 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.572 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:03:42.227 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.591 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:42.212 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.592 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:42.243 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.592 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:42.213 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.593 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:42.244 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.600 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:03:42.221 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.600 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:03:42.252 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:16.948 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:17.257 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:17.257 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:20.267 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:20.554 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:20.554 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:23.564 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:23.855 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:23.855 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:26.865 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:27.164 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:27.164 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:30.175 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:30.473 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:30.473 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:33.483 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:33.774 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:33.774 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:36.587 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:04:02.242 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.588 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:04:02.243 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.596 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:04:02.251 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.613 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:04:02.235 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.614 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:04:02.236 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.615 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:04:02.267 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.616 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:04:02.269 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.625 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:04:02.246 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.627 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:04:02.279 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:49:36.786 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:37.078 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:37.079 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:40.089 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:40.376 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:40.377 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:43.387 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:43.682 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:43.682 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:46.695 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:46.980 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:46.980 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:49.992 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:50.281 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:50.281 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:53.292 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:53.586 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:53.586 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:56.596 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:49:56.884 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:49:56.884 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:49:59.894 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:00.219 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:00.220 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:03.230 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:03.520 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:03.520 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:06.532 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:06.825 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:06.825 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:09.836 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:10.128 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:10.129 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:13.140 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:13.427 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:13.427 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:16.437 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:16.639 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:04:42.294 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.668 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:04:42.323 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.683 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:04:42.338 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.693 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:04:42.346 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.694 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:04:42.347 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.695 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:04:42.317 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.696 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:04:42.318 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.707 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:04:42.359 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.708 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:04:42.330 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:16.742 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:16.742 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:19.754 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:20.042 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:20.042 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:23.051 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:23.341 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:23.341 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:26.350 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:26.640 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:26.641 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:29.651 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:29.941 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:29.942 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:32.952 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:33.257 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:33.257 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:36.268 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:36.558 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:36.558 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:39.568 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:39.857 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:39.858 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:41.696 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:07.351 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.697 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:07.353 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.706 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:07.362 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.725 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:07.347 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.726 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:07.378 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.726 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:07.348 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.727 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:07.378 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.735 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:07.387 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:41.735 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:07.357 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:50:42.869 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:43.164 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:43.164 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:46.175 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:46.468 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:46.468 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:49.479 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:49.769 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:49.769 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:52.779 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:53.105 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:53.105 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:56.116 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:56.405 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:56.405 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:50:59.415 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:50:59.708 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:50:59.708 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:01.720 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:27.376 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.722 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:27.378 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.730 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:27.386 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.751 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:27.373 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.751 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:27.404 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.752 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:27.374 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.752 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:27.405 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.760 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:27.382 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:01.761 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:27.413 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:02.718 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:03.002 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:03.003 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:06.014 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:06.299 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:06.299 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:09.309 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:09.598 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:09.598 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:12.608 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:12.914 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:12.915 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:15.927 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:16.252 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:16.252 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:19.264 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:19.555 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:19.555 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:21.745 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:47.400 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.747 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:47.403 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.749 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:47.401 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.750 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:47.402 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.756 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:05:47.411 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.759 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:05:47.411 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.774 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:47.396 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.775 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:47.397 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:21.784 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:05:47.406 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:22.564 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:22.859 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:22.859 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:25.871 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:26.160 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:26.160 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:29.171 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:29.453 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:29.453 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:32.463 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:32.750 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:32.751 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:35.760 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:36.057 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:36.058 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:39.070 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:39.366 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:39.367 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:41.745 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:07.400 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.772 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:07.424 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.772 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:07.428 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.774 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:07.395 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.774 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:07.426 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.775 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:07.397 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.782 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:07.437 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.782 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:07.434 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:41.783 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:07.405 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:51:42.378 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:42.671 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:42.671 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:45.681 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:45.968 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:45.968 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:48.978 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:49.272 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:49.272 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:52.282 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:52.570 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:52.570 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:55.580 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:55.870 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:55.870 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:51:58.880 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:51:59.172 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:51:59.173 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:01.796 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:27.451 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.799 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:27.454 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.807 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:27.462 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.825 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:27.477 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.827 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:27.479 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.827 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:27.449 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.828 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:27.450 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.835 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:27.487 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:01.836 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:27.458 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:02.183 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:02.479 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:02.479 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:05.489 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:05.779 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:05.779 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:08.788 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:09.112 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:09.112 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:12.123 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:12.414 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:12.414 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:15.425 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:15.715 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:15.715 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:18.724 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:19.020 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:19.020 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:21.800 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:47.455 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.826 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:47.478 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.826 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:47.482 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.828 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:47.480 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.834 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:06:47.490 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.835 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:06:47.488 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.853 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:47.475 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.854 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:47.476 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:21.863 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:06:47.485 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:22.029 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:22.319 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:22.319 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:25.329 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:25.619 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:25.619 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:28.630 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:28.922 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:28.922 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:31.931 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:32.218 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:32.218 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:35.227 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:35.516 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:35.516 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:38.527 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:38.812 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:38.813 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:41.822 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:41.852 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:07.507 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.853 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:07.509 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.863 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:07.518 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.881 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:07.533 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.882 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:07.534 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.883 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:07.505 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.884 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:07.506 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.890 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:07.542 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:41.892 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:07.514 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:52:42.136 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:42.136 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:45.147 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:45.434 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:45.434 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:48.444 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:48.730 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:48.730 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:51.740 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:52.033 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:52.033 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:55.044 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:55.338 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:55.338 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:52:58.348 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:52:58.641 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:52:58.642 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:53:01.651 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:53:01.880 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:27.536 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.881 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:27.537 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.890 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:27.546 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.908 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:27.560 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.909 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:27.561 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.910 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:27.532 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.911 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:27.533 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.917 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:27.569 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.920 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:27.542 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:01.947 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:01.947 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:53:04.959 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-26T02:53:05.249 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:05.249 INFO:teuthology.orchestra.run.trial093.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"14 OSD(s) experiencing slow operations in BlueStore","count":14},"muted":false}},"mutes":[]} 2026-02-26T02:53:05.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-26T02:53:05.258 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T02:53:05.529 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:05.530 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-26T02:53:05.537 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2026-02-26T02:53:05.166215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":436688,"kb_used_data":5264,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509512752,"statfs":{"total":1546188226560,"available":1545741058048,"internally_reserved":0,"allocated":5390336,"data_stored":2938486,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":25505,"internal_metadata":441424991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002187"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:08.457502+0000","last_change":"2026-02-26T02:47:59.026201+0000","last_active":"2026-02-26T02:50:08.457502+0000","last_peered":"2026-02-26T02:50:08.457502+0000","last_clean":"2026-02-26T02:50:08.457502+0000","last_became_active":"2026-02-26T02:47:57.173989+0000","last_became_peered":"2026-02-26T02:47:57.173989+0000","last_unstale":"2026-02-26T02:50:08.457502+0000","last_undegraded":"2026-02-26T02:50:08.457502+0000","last_fullsized":"2026-02-26T02:50:08.457502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:12:37.304094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040112822999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:07.711925+0000","last_change":"2026-02-26T02:47:59.057491+0000","last_active":"2026-02-26T02:50:07.711925+0000","last_peered":"2026-02-26T02:50:07.711925+0000","last_clean":"2026-02-26T02:50:07.711925+0000","last_became_active":"2026-02-26T02:47:55.910369+0000","last_became_peered":"2026-02-26T02:47:55.910369+0000","last_unstale":"2026-02-26T02:50:07.711925+0000","last_undegraded":"2026-02-26T02:50:07.711925+0000","last_fullsized":"2026-02-26T02:50:07.711925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T06:33:07.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034663316,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.780519+0000","last_change":"2026-02-26T02:47:59.253229+0000","last_active":"2026-02-26T02:50:02.780519+0000","last_peered":"2026-02-26T02:50:02.780519+0000","last_clean":"2026-02-26T02:50:02.780519+0000","last_became_active":"2026-02-26T02:47:56.652518+0000","last_became_peered":"2026-02-26T02:47:56.652518+0000","last_unstale":"2026-02-26T02:50:02.780519+0000","last_undegraded":"2026-02-26T02:50:02.780519+0000","last_fullsized":"2026-02-26T02:50:02.780519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:41:01.948058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032313311999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:04.705706+0000","last_change":"2026-02-26T02:47:59.249213+0000","last_active":"2026-02-26T02:50:04.705706+0000","last_peered":"2026-02-26T02:50:04.705706+0000","last_clean":"2026-02-26T02:50:04.705706+0000","last_became_active":"2026-02-26T02:47:55.938167+0000","last_became_peered":"2026-02-26T02:47:55.938167+0000","last_unstale":"2026-02-26T02:50:04.705706+0000","last_undegraded":"2026-02-26T02:50:04.705706+0000","last_fullsized":"2026-02-26T02:50:04.705706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:49:29.252756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031891388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:03.455486+0000","last_change":"2026-02-26T02:47:59.018080+0000","last_active":"2026-02-26T02:50:03.455486+0000","last_peered":"2026-02-26T02:50:03.455486+0000","last_clean":"2026-02-26T02:50:03.455486+0000","last_became_active":"2026-02-26T02:47:57.060001+0000","last_became_peered":"2026-02-26T02:47:57.060001+0000","last_unstale":"2026-02-26T02:50:03.455486+0000","last_undegraded":"2026-02-26T02:50:03.455486+0000","last_fullsized":"2026-02-26T02:50:03.455486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T10:10:50.898162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046366546000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.745172+0000","last_change":"2026-02-26T02:47:59.253290+0000","last_active":"2026-02-26T02:50:02.745172+0000","last_peered":"2026-02-26T02:50:02.745172+0000","last_clean":"2026-02-26T02:50:02.745172+0000","last_became_active":"2026-02-26T02:47:55.901979+0000","last_became_peered":"2026-02-26T02:47:55.901979+0000","last_unstale":"2026-02-26T02:50:02.745172+0000","last_undegraded":"2026-02-26T02:50:02.745172+0000","last_fullsized":"2026-02-26T02:50:02.745172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:43:54.801868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032069750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:58.453302+0000","last_change":"2026-02-26T02:47:59.022310+0000","last_active":"2026-02-26T02:49:58.453302+0000","last_peered":"2026-02-26T02:49:58.453302+0000","last_clean":"2026-02-26T02:49:58.453302+0000","last_became_active":"2026-02-26T02:47:57.137850+0000","last_became_peered":"2026-02-26T02:47:57.137850+0000","last_unstale":"2026-02-26T02:49:58.453302+0000","last_undegraded":"2026-02-26T02:49:58.453302+0000","last_fullsized":"2026-02-26T02:49:58.453302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T14:36:08.922833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059900058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.784964+0000","last_change":"2026-02-26T02:47:59.579526+0000","last_active":"2026-02-26T02:50:02.784964+0000","last_peered":"2026-02-26T02:50:02.784964+0000","last_clean":"2026-02-26T02:50:02.784964+0000","last_became_active":"2026-02-26T02:47:56.597889+0000","last_became_peered":"2026-02-26T02:47:56.597889+0000","last_unstale":"2026-02-26T02:50:02.784964+0000","last_undegraded":"2026-02-26T02:50:02.784964+0000","last_fullsized":"2026-02-26T02:50:02.784964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:44.686179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026549789000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"27'32","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:47.778765+0000","last_change":"2026-02-26T02:47:48.922725+0000","last_active":"2026-02-26T02:49:47.778765+0000","last_peered":"2026-02-26T02:49:47.778765+0000","last_clean":"2026-02-26T02:49:47.778765+0000","last_became_active":"2026-02-26T02:47:48.639409+0000","last_became_peered":"2026-02-26T02:47:48.639409+0000","last_unstale":"2026-02-26T02:49:47.778765+0000","last_undegraded":"2026-02-26T02:49:47.778765+0000","last_fullsized":"2026-02-26T02:49:47.778765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_clean_scrub_stamp":"2026-02-26T02:47:43.631487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:05:25.388360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":795680,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":26,"seq":111669149761,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,8,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":26,"seq":111669149763,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":21,"seq":90194313283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,4,6,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,4,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,6,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":21,"seq":90194313283,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,4,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":25,"seq":107374182466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":25,"seq":107374182466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,3,4,5,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":25,"seq":107374182465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T02:53:05.539 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T02:53:05.807 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:05.807 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-26T02:53:05.815 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2026-02-26T02:53:05.166215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":436688,"kb_used_data":5264,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509512752,"statfs":{"total":1546188226560,"available":1545741058048,"internally_reserved":0,"allocated":5390336,"data_stored":2938486,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":25505,"internal_metadata":441424991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002187"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:08.457502+0000","last_change":"2026-02-26T02:47:59.026201+0000","last_active":"2026-02-26T02:50:08.457502+0000","last_peered":"2026-02-26T02:50:08.457502+0000","last_clean":"2026-02-26T02:50:08.457502+0000","last_became_active":"2026-02-26T02:47:57.173989+0000","last_became_peered":"2026-02-26T02:47:57.173989+0000","last_unstale":"2026-02-26T02:50:08.457502+0000","last_undegraded":"2026-02-26T02:50:08.457502+0000","last_fullsized":"2026-02-26T02:50:08.457502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:12:37.304094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040112822999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:07.711925+0000","last_change":"2026-02-26T02:47:59.057491+0000","last_active":"2026-02-26T02:50:07.711925+0000","last_peered":"2026-02-26T02:50:07.711925+0000","last_clean":"2026-02-26T02:50:07.711925+0000","last_became_active":"2026-02-26T02:47:55.910369+0000","last_became_peered":"2026-02-26T02:47:55.910369+0000","last_unstale":"2026-02-26T02:50:07.711925+0000","last_undegraded":"2026-02-26T02:50:07.711925+0000","last_fullsized":"2026-02-26T02:50:07.711925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T06:33:07.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034663316,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.780519+0000","last_change":"2026-02-26T02:47:59.253229+0000","last_active":"2026-02-26T02:50:02.780519+0000","last_peered":"2026-02-26T02:50:02.780519+0000","last_clean":"2026-02-26T02:50:02.780519+0000","last_became_active":"2026-02-26T02:47:56.652518+0000","last_became_peered":"2026-02-26T02:47:56.652518+0000","last_unstale":"2026-02-26T02:50:02.780519+0000","last_undegraded":"2026-02-26T02:50:02.780519+0000","last_fullsized":"2026-02-26T02:50:02.780519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:41:01.948058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032313311999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:04.705706+0000","last_change":"2026-02-26T02:47:59.249213+0000","last_active":"2026-02-26T02:50:04.705706+0000","last_peered":"2026-02-26T02:50:04.705706+0000","last_clean":"2026-02-26T02:50:04.705706+0000","last_became_active":"2026-02-26T02:47:55.938167+0000","last_became_peered":"2026-02-26T02:47:55.938167+0000","last_unstale":"2026-02-26T02:50:04.705706+0000","last_undegraded":"2026-02-26T02:50:04.705706+0000","last_fullsized":"2026-02-26T02:50:04.705706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:49:29.252756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031891388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:03.455486+0000","last_change":"2026-02-26T02:47:59.018080+0000","last_active":"2026-02-26T02:50:03.455486+0000","last_peered":"2026-02-26T02:50:03.455486+0000","last_clean":"2026-02-26T02:50:03.455486+0000","last_became_active":"2026-02-26T02:47:57.060001+0000","last_became_peered":"2026-02-26T02:47:57.060001+0000","last_unstale":"2026-02-26T02:50:03.455486+0000","last_undegraded":"2026-02-26T02:50:03.455486+0000","last_fullsized":"2026-02-26T02:50:03.455486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T10:10:50.898162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046366546000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.745172+0000","last_change":"2026-02-26T02:47:59.253290+0000","last_active":"2026-02-26T02:50:02.745172+0000","last_peered":"2026-02-26T02:50:02.745172+0000","last_clean":"2026-02-26T02:50:02.745172+0000","last_became_active":"2026-02-26T02:47:55.901979+0000","last_became_peered":"2026-02-26T02:47:55.901979+0000","last_unstale":"2026-02-26T02:50:02.745172+0000","last_undegraded":"2026-02-26T02:50:02.745172+0000","last_fullsized":"2026-02-26T02:50:02.745172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:43:54.801868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032069750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:58.453302+0000","last_change":"2026-02-26T02:47:59.022310+0000","last_active":"2026-02-26T02:49:58.453302+0000","last_peered":"2026-02-26T02:49:58.453302+0000","last_clean":"2026-02-26T02:49:58.453302+0000","last_became_active":"2026-02-26T02:47:57.137850+0000","last_became_peered":"2026-02-26T02:47:57.137850+0000","last_unstale":"2026-02-26T02:49:58.453302+0000","last_undegraded":"2026-02-26T02:49:58.453302+0000","last_fullsized":"2026-02-26T02:49:58.453302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T14:36:08.922833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059900058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.784964+0000","last_change":"2026-02-26T02:47:59.579526+0000","last_active":"2026-02-26T02:50:02.784964+0000","last_peered":"2026-02-26T02:50:02.784964+0000","last_clean":"2026-02-26T02:50:02.784964+0000","last_became_active":"2026-02-26T02:47:56.597889+0000","last_became_peered":"2026-02-26T02:47:56.597889+0000","last_unstale":"2026-02-26T02:50:02.784964+0000","last_undegraded":"2026-02-26T02:50:02.784964+0000","last_fullsized":"2026-02-26T02:50:02.784964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:44.686179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026549789000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"27'32","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:47.778765+0000","last_change":"2026-02-26T02:47:48.922725+0000","last_active":"2026-02-26T02:49:47.778765+0000","last_peered":"2026-02-26T02:49:47.778765+0000","last_clean":"2026-02-26T02:49:47.778765+0000","last_became_active":"2026-02-26T02:47:48.639409+0000","last_became_peered":"2026-02-26T02:47:48.639409+0000","last_unstale":"2026-02-26T02:49:47.778765+0000","last_undegraded":"2026-02-26T02:49:47.778765+0000","last_fullsized":"2026-02-26T02:49:47.778765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_clean_scrub_stamp":"2026-02-26T02:47:43.631487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:05:25.388360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":795680,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":26,"seq":111669149761,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,8,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":26,"seq":111669149763,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":21,"seq":90194313283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,4,6,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,4,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,6,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":21,"seq":90194313283,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,4,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":25,"seq":107374182466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":25,"seq":107374182466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,3,4,5,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":25,"seq":107374182465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T02:53:05.816 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-26T02:53:05.816 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T02:53:06.131 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:06.131 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-26T02:53:06.140 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2026-02-26T02:53:05.166215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":436688,"kb_used_data":5264,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509512752,"statfs":{"total":1546188226560,"available":1545741058048,"internally_reserved":0,"allocated":5390336,"data_stored":2938486,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":25505,"internal_metadata":441424991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002187"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:08.457502+0000","last_change":"2026-02-26T02:47:59.026201+0000","last_active":"2026-02-26T02:50:08.457502+0000","last_peered":"2026-02-26T02:50:08.457502+0000","last_clean":"2026-02-26T02:50:08.457502+0000","last_became_active":"2026-02-26T02:47:57.173989+0000","last_became_peered":"2026-02-26T02:47:57.173989+0000","last_unstale":"2026-02-26T02:50:08.457502+0000","last_undegraded":"2026-02-26T02:50:08.457502+0000","last_fullsized":"2026-02-26T02:50:08.457502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:12:37.304094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040112822999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:07.711925+0000","last_change":"2026-02-26T02:47:59.057491+0000","last_active":"2026-02-26T02:50:07.711925+0000","last_peered":"2026-02-26T02:50:07.711925+0000","last_clean":"2026-02-26T02:50:07.711925+0000","last_became_active":"2026-02-26T02:47:55.910369+0000","last_became_peered":"2026-02-26T02:47:55.910369+0000","last_unstale":"2026-02-26T02:50:07.711925+0000","last_undegraded":"2026-02-26T02:50:07.711925+0000","last_fullsized":"2026-02-26T02:50:07.711925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T06:33:07.449459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034663316,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.780519+0000","last_change":"2026-02-26T02:47:59.253229+0000","last_active":"2026-02-26T02:50:02.780519+0000","last_peered":"2026-02-26T02:50:02.780519+0000","last_clean":"2026-02-26T02:50:02.780519+0000","last_became_active":"2026-02-26T02:47:56.652518+0000","last_became_peered":"2026-02-26T02:47:56.652518+0000","last_unstale":"2026-02-26T02:50:02.780519+0000","last_undegraded":"2026-02-26T02:50:02.780519+0000","last_fullsized":"2026-02-26T02:50:02.780519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:41:01.948058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032313311999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:04.705706+0000","last_change":"2026-02-26T02:47:59.249213+0000","last_active":"2026-02-26T02:50:04.705706+0000","last_peered":"2026-02-26T02:50:04.705706+0000","last_clean":"2026-02-26T02:50:04.705706+0000","last_became_active":"2026-02-26T02:47:55.938167+0000","last_became_peered":"2026-02-26T02:47:55.938167+0000","last_unstale":"2026-02-26T02:50:04.705706+0000","last_undegraded":"2026-02-26T02:50:04.705706+0000","last_fullsized":"2026-02-26T02:50:04.705706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:49:29.252756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031891388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:03.455486+0000","last_change":"2026-02-26T02:47:59.018080+0000","last_active":"2026-02-26T02:50:03.455486+0000","last_peered":"2026-02-26T02:50:03.455486+0000","last_clean":"2026-02-26T02:50:03.455486+0000","last_became_active":"2026-02-26T02:47:57.060001+0000","last_became_peered":"2026-02-26T02:47:57.060001+0000","last_unstale":"2026-02-26T02:50:03.455486+0000","last_undegraded":"2026-02-26T02:50:03.455486+0000","last_fullsized":"2026-02-26T02:50:03.455486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T10:10:50.898162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046366546000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.745172+0000","last_change":"2026-02-26T02:47:59.253290+0000","last_active":"2026-02-26T02:50:02.745172+0000","last_peered":"2026-02-26T02:50:02.745172+0000","last_clean":"2026-02-26T02:50:02.745172+0000","last_became_active":"2026-02-26T02:47:55.901979+0000","last_became_peered":"2026-02-26T02:47:55.901979+0000","last_unstale":"2026-02-26T02:50:02.745172+0000","last_undegraded":"2026-02-26T02:50:02.745172+0000","last_fullsized":"2026-02-26T02:50:02.745172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:43:54.801868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032069750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:58.453302+0000","last_change":"2026-02-26T02:47:59.022310+0000","last_active":"2026-02-26T02:49:58.453302+0000","last_peered":"2026-02-26T02:49:58.453302+0000","last_clean":"2026-02-26T02:49:58.453302+0000","last_became_active":"2026-02-26T02:47:57.137850+0000","last_became_peered":"2026-02-26T02:47:57.137850+0000","last_unstale":"2026-02-26T02:49:58.453302+0000","last_undegraded":"2026-02-26T02:49:58.453302+0000","last_fullsized":"2026-02-26T02:49:58.453302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T14:36:08.922833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059900058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.784964+0000","last_change":"2026-02-26T02:47:59.579526+0000","last_active":"2026-02-26T02:50:02.784964+0000","last_peered":"2026-02-26T02:50:02.784964+0000","last_clean":"2026-02-26T02:50:02.784964+0000","last_became_active":"2026-02-26T02:47:56.597889+0000","last_became_peered":"2026-02-26T02:47:56.597889+0000","last_unstale":"2026-02-26T02:50:02.784964+0000","last_undegraded":"2026-02-26T02:50:02.784964+0000","last_fullsized":"2026-02-26T02:50:02.784964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:44.686179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026549789000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"27'32","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:47.778765+0000","last_change":"2026-02-26T02:47:48.922725+0000","last_active":"2026-02-26T02:49:47.778765+0000","last_peered":"2026-02-26T02:49:47.778765+0000","last_clean":"2026-02-26T02:49:47.778765+0000","last_became_active":"2026-02-26T02:47:48.639409+0000","last_became_peered":"2026-02-26T02:47:48.639409+0000","last_unstale":"2026-02-26T02:49:47.778765+0000","last_undegraded":"2026-02-26T02:49:47.778765+0000","last_fullsized":"2026-02-26T02:49:47.778765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_clean_scrub_stamp":"2026-02-26T02:47:43.631487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:05:25.388360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":795680,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":26,"seq":111669149761,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,8,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":26,"seq":111669149763,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":21,"seq":90194313283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,4,6,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":21,"seq":90194313282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,4,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":21,"seq":90194313283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,6,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":21,"seq":90194313283,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,4,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280579,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":25,"seq":107374182466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":25,"seq":107374182466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,3,4,5,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":25,"seq":107374182465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T02:53:06.141 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-26T02:53:06.433 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:06.433 INFO:teuthology.orchestra.run.trial093.stdout:{"epoch":33,"fsid":"51abe019-1bbf-44c1-9d15-783dc1e2d8fe","created":"2026-02-26T02:46:02.377843+0000","modified":"2026-02-26T02:48:06.417973+0000","last_up_change":"2026-02-26T02:47:47.928586+0000","last_in_change":"2026-02-26T02:46:08.473714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-26T02:47:43.283460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-26T02:47:53.985488+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.0399999618530273,"score_stable":6.0399999618530273,"optimal_score":0.56000000238418579,"raw_score_acting":3.380000114440918,"raw_score_stable":3.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"404d926b-352a-4df2-bf26-b477aa215897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6800","nonce":3205567943}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6801","nonce":3205567943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6804","nonce":3205567943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6802","nonce":3205567943}]},"public_addr":"10.20.193.93:6800/3205567943","cluster_addr":"10.20.193.93:6801/3205567943","heartbeat_back_addr":"10.20.193.93:6804/3205567943","heartbeat_front_addr":"10.20.193.93:6802/3205567943","state":["exists","up"]},{"osd":1,"uuid":"497fd582-3ad5-417b-89e0-aeaf8287719c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6811","nonce":2110814708}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6813","nonce":2110814708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6815","nonce":2110814708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6814","nonce":2110814708}]},"public_addr":"10.20.193.130:6811/2110814708","cluster_addr":"10.20.193.130:6813/2110814708","heartbeat_back_addr":"10.20.193.130:6815/2110814708","heartbeat_front_addr":"10.20.193.130:6814/2110814708","state":["exists","up"]},{"osd":2,"uuid":"9a3f8e33-a0c2-441e-8af1-1d27e26aa6e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6804","nonce":1511765103}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6805","nonce":1511765103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6808","nonce":1511765103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6807","nonce":1511765103}]},"public_addr":"10.20.193.161:6804/1511765103","cluster_addr":"10.20.193.161:6805/1511765103","heartbeat_back_addr":"10.20.193.161:6808/1511765103","heartbeat_front_addr":"10.20.193.161:6807/1511765103","state":["exists","up"]},{"osd":3,"uuid":"de2c8cb9-692e-4401-8813-3cf3630a7aa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6808","nonce":1838066642}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6810","nonce":1838066642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6812","nonce":1838066642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6811","nonce":1838066642}]},"public_addr":"10.20.193.192:6808/1838066642","cluster_addr":"10.20.193.192:6810/1838066642","heartbeat_back_addr":"10.20.193.192:6812/1838066642","heartbeat_front_addr":"10.20.193.192:6811/1838066642","state":["exists","up"]},{"osd":4,"uuid":"a1820965-5ca7-4bea-b1cf-00d0317666e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6803","nonce":2379549259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6805","nonce":2379549259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6807","nonce":2379549259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6806","nonce":2379549259}]},"public_addr":"10.20.193.93:6803/2379549259","cluster_addr":"10.20.193.93:6805/2379549259","heartbeat_back_addr":"10.20.193.93:6807/2379549259","heartbeat_front_addr":"10.20.193.93:6806/2379549259","state":["exists","up"]},{"osd":5,"uuid":"d11da9b1-8e64-43fd-bdf8-c569d3a5a4ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6808","nonce":2730554355}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6809","nonce":2730554355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6812","nonce":2730554355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6810","nonce":2730554355}]},"public_addr":"10.20.193.130:6808/2730554355","cluster_addr":"10.20.193.130:6809/2730554355","heartbeat_back_addr":"10.20.193.130:6812/2730554355","heartbeat_front_addr":"10.20.193.130:6810/2730554355","state":["exists","up"]},{"osd":6,"uuid":"e07bf7ca-4e5c-444d-a678-65722974523f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6806","nonce":329633094}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6809","nonce":329633094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6811","nonce":329633094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6810","nonce":329633094}]},"public_addr":"10.20.193.161:6806/329633094","cluster_addr":"10.20.193.161:6809/329633094","heartbeat_back_addr":"10.20.193.161:6811/329633094","heartbeat_front_addr":"10.20.193.161:6810/329633094","state":["exists","up"]},{"osd":7,"uuid":"0c86bf69-7e41-41f9-8bd3-ad9543511125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6805","nonce":1343240239}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6806","nonce":1343240239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6809","nonce":1343240239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6807","nonce":1343240239}]},"public_addr":"10.20.193.192:6805/1343240239","cluster_addr":"10.20.193.192:6806/1343240239","heartbeat_back_addr":"10.20.193.192:6809/1343240239","heartbeat_front_addr":"10.20.193.192:6807/1343240239","state":["exists","up"]},{"osd":8,"uuid":"c583fa19-de28-4762-abae-f907b377a097","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6808","nonce":4039757268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6809","nonce":4039757268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6811","nonce":4039757268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6810","nonce":4039757268}]},"public_addr":"10.20.193.93:6808/4039757268","cluster_addr":"10.20.193.93:6809/4039757268","heartbeat_back_addr":"10.20.193.93:6811/4039757268","heartbeat_front_addr":"10.20.193.93:6810/4039757268","state":["exists","up"]},{"osd":9,"uuid":"970a9421-71ca-45bb-b4ae-daa96cf2fe6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6800","nonce":1345968556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6801","nonce":1345968556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6803","nonce":1345968556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6802","nonce":1345968556}]},"public_addr":"10.20.193.130:6800/1345968556","cluster_addr":"10.20.193.130:6801/1345968556","heartbeat_back_addr":"10.20.193.130:6803/1345968556","heartbeat_front_addr":"10.20.193.130:6802/1345968556","state":["exists","up"]},{"osd":10,"uuid":"7d80ac94-36d5-49dc-899e-47611779e28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6800","nonce":1687791223}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6801","nonce":1687791223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6803","nonce":1687791223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6802","nonce":1687791223}]},"public_addr":"10.20.193.161:6800/1687791223","cluster_addr":"10.20.193.161:6801/1687791223","heartbeat_back_addr":"10.20.193.161:6803/1687791223","heartbeat_front_addr":"10.20.193.161:6802/1687791223","state":["exists","up"]},{"osd":11,"uuid":"721b6dbe-034f-4007-a813-f07f236c58c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6813","nonce":2609613895}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6814","nonce":2609613895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6816","nonce":2609613895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6815","nonce":2609613895}]},"public_addr":"10.20.193.192:6813/2609613895","cluster_addr":"10.20.193.192:6814/2609613895","heartbeat_back_addr":"10.20.193.192:6816/2609613895","heartbeat_front_addr":"10.20.193.192:6815/2609613895","state":["exists","up"]},{"osd":12,"uuid":"57b55b92-e8d8-41e7-8241-5b99537e7838","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6812","nonce":2330002550}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6813","nonce":2330002550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6815","nonce":2330002550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.93:6814","nonce":2330002550}]},"public_addr":"10.20.193.93:6812/2330002550","cluster_addr":"10.20.193.93:6813/2330002550","heartbeat_back_addr":"10.20.193.93:6815/2330002550","heartbeat_front_addr":"10.20.193.93:6814/2330002550","state":["exists","up"]},{"osd":13,"uuid":"7de2d75f-7e3b-4e73-8fe2-ebc0e446251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6804","nonce":767940315}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6805","nonce":767940315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6807","nonce":767940315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.130:6806","nonce":767940315}]},"public_addr":"10.20.193.130:6804/767940315","cluster_addr":"10.20.193.130:6805/767940315","heartbeat_back_addr":"10.20.193.130:6807/767940315","heartbeat_front_addr":"10.20.193.130:6806/767940315","state":["exists","up"]},{"osd":14,"uuid":"d655aa42-f167-4fbc-8090-83210d67d598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6812","nonce":912549195}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6813","nonce":912549195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6815","nonce":912549195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.161:6814","nonce":912549195}]},"public_addr":"10.20.193.161:6812/912549195","cluster_addr":"10.20.193.161:6813/912549195","heartbeat_back_addr":"10.20.193.161:6815/912549195","heartbeat_front_addr":"10.20.193.161:6814/912549195","state":["exists","up"]},{"osd":15,"uuid":"989afadd-acc4-423e-8e15-9cc96c658d1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6801","nonce":929821092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6802","nonce":929821092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6804","nonce":929821092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.192:6803","nonce":929821092}]},"public_addr":"10.20.193.192:6801/929821092","cluster_addr":"10.20.193.192:6802/929821092","heartbeat_back_addr":"10.20.193.192:6804/929821092","heartbeat_front_addr":"10.20.193.192:6803/929821092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.243844+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.836784+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167459+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.437982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.345874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.701133+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.095843+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.642232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.678718+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.159302+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.953509+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.655964+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.167304+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.766889+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:41.011968+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-26T02:47:40.526700+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-26T02:53:07.445 INFO:tasks.ceph:Scrubbing osd.0 2026-02-26T02:53:07.446 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:07.565 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:07.565 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:07.565 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:07.572 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-26T02:53:07.840 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 0 to deep-scrub 2026-02-26T02:53:07.850 INFO:tasks.ceph:Scrubbing osd.4 2026-02-26T02:53:07.850 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:07.968 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:07.968 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:07.969 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:07.977 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-26T02:53:08.241 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 4 to deep-scrub 2026-02-26T02:53:08.251 INFO:tasks.ceph:Scrubbing osd.8 2026-02-26T02:53:08.252 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:08.368 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:08.369 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:08.369 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:08.377 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-26T02:53:08.645 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 8 to deep-scrub 2026-02-26T02:53:08.654 INFO:tasks.ceph:Scrubbing osd.12 2026-02-26T02:53:08.655 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:08.772 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:08.773 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:08.773 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:08.781 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-26T02:53:09.057 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 12 to deep-scrub 2026-02-26T02:53:09.067 INFO:tasks.ceph:Scrubbing osd.1 2026-02-26T02:53:09.067 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:09.184 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:09.184 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:09.184 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:09.193 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-26T02:53:09.458 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 1 to deep-scrub 2026-02-26T02:53:09.467 INFO:tasks.ceph:Scrubbing osd.5 2026-02-26T02:53:09.467 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:09.587 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:09.587 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:09.587 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:09.594 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-26T02:53:09.869 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 5 to deep-scrub 2026-02-26T02:53:09.877 INFO:tasks.ceph:Scrubbing osd.9 2026-02-26T02:53:09.878 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:09.994 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:09.995 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:09.995 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:10.002 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-26T02:53:10.281 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 9 to deep-scrub 2026-02-26T02:53:10.290 INFO:tasks.ceph:Scrubbing osd.13 2026-02-26T02:53:10.290 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:10.409 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:10.409 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:10.410 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:10.417 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-26T02:53:10.684 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 13 to deep-scrub 2026-02-26T02:53:10.695 INFO:tasks.ceph:Scrubbing osd.2 2026-02-26T02:53:10.695 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:10.814 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:10.814 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:10.814 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:10.822 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-26T02:53:11.093 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 2 to deep-scrub 2026-02-26T02:53:11.104 INFO:tasks.ceph:Scrubbing osd.6 2026-02-26T02:53:11.104 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:11.224 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:11.224 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:11.224 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:11.232 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-26T02:53:11.498 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 6 to deep-scrub 2026-02-26T02:53:11.507 INFO:tasks.ceph:Scrubbing osd.10 2026-02-26T02:53:11.507 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:11.626 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:11.626 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:11.626 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:11.633 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-26T02:53:11.895 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 10 to deep-scrub 2026-02-26T02:53:11.903 INFO:tasks.ceph:Scrubbing osd.14 2026-02-26T02:53:11.904 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:12.022 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:12.022 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:12.022 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:12.030 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-26T02:53:12.298 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 14 to deep-scrub 2026-02-26T02:53:12.309 INFO:tasks.ceph:Scrubbing osd.3 2026-02-26T02:53:12.309 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:12.430 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:12.430 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:12.430 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:12.438 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-26T02:53:12.706 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 3 to deep-scrub 2026-02-26T02:53:12.716 INFO:tasks.ceph:Scrubbing osd.7 2026-02-26T02:53:12.716 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:12.834 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:12.834 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:12.834 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:12.841 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-26T02:53:13.115 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 7 to deep-scrub 2026-02-26T02:53:13.124 INFO:tasks.ceph:Scrubbing osd.11 2026-02-26T02:53:13.125 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:13.244 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:13.244 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:13.244 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:13.252 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-26T02:53:13.517 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 11 to deep-scrub 2026-02-26T02:53:13.526 INFO:tasks.ceph:Scrubbing osd.15 2026-02-26T02:53:13.526 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-26T02:53:13.644 INFO:teuthology.orchestra.run.trial093.stdout:{ 2026-02-26T02:53:13.644 INFO:teuthology.orchestra.run.trial093.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-26T02:53:13.644 INFO:teuthology.orchestra.run.trial093.stdout:} 2026-02-26T02:53:13.653 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-26T02:53:13.924 INFO:teuthology.orchestra.run.trial093.stderr:instructed osd(s) 15 to deep-scrub 2026-02-26T02:53:13.933 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T02:53:14.198 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:14.199 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-26T02:53:14.207 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2026-02-26T02:53:13.167338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":436680,"kb_used_data":5264,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509512760,"statfs":{"total":1546188226560,"available":1545741066240,"internally_reserved":0,"allocated":5390336,"data_stored":2938486,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":25505,"internal_metadata":441424991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001870"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:08.457502+0000","last_change":"2026-02-26T02:47:59.026201+0000","last_active":"2026-02-26T02:50:08.457502+0000","last_peered":"2026-02-26T02:50:08.457502+0000","last_clean":"2026-02-26T02:50:08.457502+0000","last_became_active":"2026-02-26T02:47:57.173989+0000","last_became_peered":"2026-02-26T02:47:57.173989+0000","last_unstale":"2026-02-26T02:50:08.457502+0000","last_undegraded":"2026-02-26T02:50:08.457502+0000","last_fullsized":"2026-02-26T02:50:08.457502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T09:12:37.304094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040112822999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:10.980964+0000","last_change":"2026-02-26T02:53:10.983628+0000","last_active":"2026-02-26T02:53:10.980964+0000","last_peered":"2026-02-26T02:53:10.980964+0000","last_clean":"2026-02-26T02:53:10.980964+0000","last_became_active":"2026-02-26T02:47:55.910369+0000","last_became_peered":"2026-02-26T02:47:55.910369+0000","last_unstale":"2026-02-26T02:53:10.980964+0000","last_undegraded":"2026-02-26T02:53:10.980964+0000","last_fullsized":"2026-02-26T02:53:10.980964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:10.978148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:10.978148+0000","last_clean_scrub_stamp":"2026-02-26T02:53:10.978148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T07:59:46.915049+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0.034663316,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:11.991462+0000","last_change":"2026-02-26T02:53:11.994406+0000","last_active":"2026-02-26T02:53:11.991462+0000","last_peered":"2026-02-26T02:53:11.991462+0000","last_clean":"2026-02-26T02:53:11.991462+0000","last_became_active":"2026-02-26T02:47:56.652518+0000","last_became_peered":"2026-02-26T02:47:56.652518+0000","last_unstale":"2026-02-26T02:53:11.991462+0000","last_undegraded":"2026-02-26T02:53:11.991462+0000","last_fullsized":"2026-02-26T02:53:11.991462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:11.988188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:11.988188+0000","last_clean_scrub_stamp":"2026-02-26T02:53:11.988188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T08:48:23.156130+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0.032313311999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:52:09.756854+0000","last_change":"2026-02-26T02:47:59.249213+0000","last_active":"2026-02-26T02:52:09.756854+0000","last_peered":"2026-02-26T02:52:09.756854+0000","last_clean":"2026-02-26T02:52:09.756854+0000","last_became_active":"2026-02-26T02:47:55.938167+0000","last_became_peered":"2026-02-26T02:47:55.938167+0000","last_unstale":"2026-02-26T02:52:09.756854+0000","last_undegraded":"2026-02-26T02:52:09.756854+0000","last_fullsized":"2026-02-26T02:52:09.756854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031891388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:03.455486+0000","last_change":"2026-02-26T02:47:59.018080+0000","last_active":"2026-02-26T02:50:03.455486+0000","last_peered":"2026-02-26T02:50:03.455486+0000","last_clean":"2026-02-26T02:50:03.455486+0000","last_became_active":"2026-02-26T02:47:57.060001+0000","last_became_peered":"2026-02-26T02:47:57.060001+0000","last_unstale":"2026-02-26T02:50:03.455486+0000","last_undegraded":"2026-02-26T02:50:03.455486+0000","last_fullsized":"2026-02-26T02:50:03.455486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T10:10:50.898162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046366546000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.745172+0000","last_change":"2026-02-26T02:47:59.253290+0000","last_active":"2026-02-26T02:50:02.745172+0000","last_peered":"2026-02-26T02:50:02.745172+0000","last_clean":"2026-02-26T02:50:02.745172+0000","last_became_active":"2026-02-26T02:47:55.901979+0000","last_became_peered":"2026-02-26T02:47:55.901979+0000","last_unstale":"2026-02-26T02:50:02.745172+0000","last_undegraded":"2026-02-26T02:50:02.745172+0000","last_fullsized":"2026-02-26T02:50:02.745172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:43:54.801868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032069750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:58.453302+0000","last_change":"2026-02-26T02:47:59.022310+0000","last_active":"2026-02-26T02:49:58.453302+0000","last_peered":"2026-02-26T02:49:58.453302+0000","last_clean":"2026-02-26T02:49:58.453302+0000","last_became_active":"2026-02-26T02:47:57.137850+0000","last_became_peered":"2026-02-26T02:47:57.137850+0000","last_unstale":"2026-02-26T02:49:58.453302+0000","last_undegraded":"2026-02-26T02:49:58.453302+0000","last_fullsized":"2026-02-26T02:49:58.453302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T14:36:08.922833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059900058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:50:02.784964+0000","last_change":"2026-02-26T02:47:59.579526+0000","last_active":"2026-02-26T02:50:02.784964+0000","last_peered":"2026-02-26T02:50:02.784964+0000","last_clean":"2026-02-26T02:50:02.784964+0000","last_became_active":"2026-02-26T02:47:56.597889+0000","last_became_peered":"2026-02-26T02:47:56.597889+0000","last_unstale":"2026-02-26T02:50:02.784964+0000","last_undegraded":"2026-02-26T02:50:02.784964+0000","last_fullsized":"2026-02-26T02:50:02.784964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:54.600720+0000","last_clean_scrub_stamp":"2026-02-26T02:47:54.600720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:01:44.686179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026549789000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"27'32","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:49:47.778765+0000","last_change":"2026-02-26T02:47:48.922725+0000","last_active":"2026-02-26T02:49:47.778765+0000","last_peered":"2026-02-26T02:49:47.778765+0000","last_clean":"2026-02-26T02:49:47.778765+0000","last_became_active":"2026-02-26T02:47:48.639409+0000","last_became_peered":"2026-02-26T02:47:48.639409+0000","last_unstale":"2026-02-26T02:49:47.778765+0000","last_undegraded":"2026-02-26T02:49:47.778765+0000","last_fullsized":"2026-02-26T02:49:47.778765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:47:43.631487+0000","last_clean_scrub_stamp":"2026-02-26T02:47:43.631487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:05:25.388360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":795680,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":26,"seq":111669149762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,8,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":26,"seq":111669149764,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":26,"seq":111669149764,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":21,"seq":90194313285,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":21,"seq":90194313285,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,4,6,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":21,"seq":90194313284,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,4,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":21,"seq":90194313285,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,6,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":21,"seq":90194313285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280582,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":21,"seq":90194313284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,4,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":25,"seq":107374182468,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":25,"seq":107374182468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,3,4,5,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":25,"seq":107374182467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T02:53:14.210 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-26T02:47:54.600720+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=47, tm_sec=54, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T02:53:14.211 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-26T02:47:54.600720+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=47, tm_sec=54, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T02:53:14.211 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-26T02:47:54.600720+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=47, tm_sec=54, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T02:53:14.211 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-26T02:47:54.600720+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=47, tm_sec=54, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T02:53:14.211 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-26T02:47:54.600720+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=47, tm_sec=54, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T02:53:14.211 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-26T02:47:54.600720+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=47, tm_sec=54, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T02:53:14.211 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-26T02:47:43.631487+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=47, tm_sec=43, tm_wday=3, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=26, tm_hour=2, tm_min=53, tm_sec=6, tm_wday=3, tm_yday=57, tm_isdst=0) 2026-02-26T02:53:14.211 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-26T02:53:21.906 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:47.561 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.907 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:47.560 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.908 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:47.564 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.909 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:47.561 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.917 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:07:47.572 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.917 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:07:47.569 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.934 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:47.555 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.935 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:47.557 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:21.943 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:07:47.565 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:34.212 DEBUG:teuthology.orchestra.run.trial093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-26T02:53:34.496 INFO:teuthology.orchestra.run.trial093.stdout: 2026-02-26T02:53:34.496 INFO:teuthology.orchestra.run.trial093.stderr:dumped all 2026-02-26T02:53:34.505 INFO:teuthology.orchestra.run.trial093.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2026-02-26T02:53:33.170715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":10,"kb":1509949440,"kb_used":436656,"kb_used_data":5264,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509512784,"statfs":{"total":1546188226560,"available":1545741090816,"internally_reserved":0,"allocated":5390336,"data_stored":2938486,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":25505,"internal_metadata":441424991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002135"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:10.770029+0000","last_change":"2026-02-26T02:53:10.770352+0000","last_active":"2026-02-26T02:53:10.770029+0000","last_peered":"2026-02-26T02:53:10.770029+0000","last_clean":"2026-02-26T02:53:10.770029+0000","last_became_active":"2026-02-26T02:47:57.173989+0000","last_became_peered":"2026-02-26T02:47:57.173989+0000","last_unstale":"2026-02-26T02:53:10.770029+0000","last_undegraded":"2026-02-26T02:53:10.770029+0000","last_fullsized":"2026-02-26T02:53:10.770029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:10.768055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:10.768055+0000","last_clean_scrub_stamp":"2026-02-26T02:53:10.768055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:03:17.510490+0000","scrub_duration":80,"objects_trimmed":0,"snaptrim_duration":0.040112822999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:10.980964+0000","last_change":"2026-02-26T02:53:10.983628+0000","last_active":"2026-02-26T02:53:10.980964+0000","last_peered":"2026-02-26T02:53:10.980964+0000","last_clean":"2026-02-26T02:53:10.980964+0000","last_became_active":"2026-02-26T02:47:55.910369+0000","last_became_peered":"2026-02-26T02:47:55.910369+0000","last_unstale":"2026-02-26T02:53:10.980964+0000","last_undegraded":"2026-02-26T02:53:10.980964+0000","last_fullsized":"2026-02-26T02:53:10.980964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:10.978148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:10.978148+0000","last_clean_scrub_stamp":"2026-02-26T02:53:10.978148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T07:59:46.915049+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0.034663316,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:11.991462+0000","last_change":"2026-02-26T02:53:11.994406+0000","last_active":"2026-02-26T02:53:11.991462+0000","last_peered":"2026-02-26T02:53:11.991462+0000","last_clean":"2026-02-26T02:53:11.991462+0000","last_became_active":"2026-02-26T02:47:56.652518+0000","last_became_peered":"2026-02-26T02:47:56.652518+0000","last_unstale":"2026-02-26T02:53:11.991462+0000","last_undegraded":"2026-02-26T02:53:11.991462+0000","last_fullsized":"2026-02-26T02:53:11.991462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:11.988188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:11.988188+0000","last_clean_scrub_stamp":"2026-02-26T02:53:11.988188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T08:48:23.156130+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0.032313311999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:10.029582+0000","last_change":"2026-02-26T02:53:10.034767+0000","last_active":"2026-02-26T02:53:10.029582+0000","last_peered":"2026-02-26T02:53:10.029582+0000","last_clean":"2026-02-26T02:53:10.029582+0000","last_became_active":"2026-02-26T02:47:55.938167+0000","last_became_peered":"2026-02-26T02:47:55.938167+0000","last_unstale":"2026-02-26T02:53:10.029582+0000","last_undegraded":"2026-02-26T02:53:10.029582+0000","last_fullsized":"2026-02-26T02:53:10.029582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:10.027387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:10.027387+0000","last_clean_scrub_stamp":"2026-02-26T02:53:10.027387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:23:44.183671+0000","scrub_duration":134,"objects_trimmed":0,"snaptrim_duration":0.031891388,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:08.996975+0000","last_change":"2026-02-26T02:53:09.002240+0000","last_active":"2026-02-26T02:53:08.996975+0000","last_peered":"2026-02-26T02:53:08.996975+0000","last_clean":"2026-02-26T02:53:08.996975+0000","last_became_active":"2026-02-26T02:47:57.060001+0000","last_became_peered":"2026-02-26T02:47:57.060001+0000","last_unstale":"2026-02-26T02:53:08.996975+0000","last_undegraded":"2026-02-26T02:53:08.996975+0000","last_fullsized":"2026-02-26T02:53:08.996975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2026-02-26T02:53:08.993798+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2026-02-26T02:53:08.993798+0000","last_clean_scrub_stamp":"2026-02-26T02:53:08.993798+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:10:06.272365+0000","scrub_duration":258,"objects_trimmed":0,"snaptrim_duration":0.046366546000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:14.525979+0000","last_change":"2026-02-26T02:53:14.530968+0000","last_active":"2026-02-26T02:53:14.525979+0000","last_peered":"2026-02-26T02:53:14.525979+0000","last_clean":"2026-02-26T02:53:14.525979+0000","last_became_active":"2026-02-26T02:47:55.901979+0000","last_became_peered":"2026-02-26T02:47:55.901979+0000","last_unstale":"2026-02-26T02:53:14.525979+0000","last_undegraded":"2026-02-26T02:53:14.525979+0000","last_fullsized":"2026-02-26T02:53:14.525979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:14.523517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:14.523517+0000","last_clean_scrub_stamp":"2026-02-26T02:53:14.523517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T13:44:29.564416+0000","scrub_duration":146,"objects_trimmed":0,"snaptrim_duration":0.032069750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:09.775360+0000","last_change":"2026-02-26T02:53:09.775728+0000","last_active":"2026-02-26T02:53:09.775360+0000","last_peered":"2026-02-26T02:53:09.775360+0000","last_clean":"2026-02-26T02:53:09.775360+0000","last_became_active":"2026-02-26T02:47:57.137850+0000","last_became_peered":"2026-02-26T02:47:57.137850+0000","last_unstale":"2026-02-26T02:53:09.775360+0000","last_undegraded":"2026-02-26T02:53:09.775360+0000","last_fullsized":"2026-02-26T02:53:09.775360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-26T02:53:09.773552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-26T02:53:09.773552+0000","last_clean_scrub_stamp":"2026-02-26T02:53:09.773552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:11:14.557892+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0.059900058999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:15.077964+0000","last_change":"2026-02-26T02:53:15.078335+0000","last_active":"2026-02-26T02:53:15.077964+0000","last_peered":"2026-02-26T02:53:15.077964+0000","last_clean":"2026-02-26T02:53:15.077964+0000","last_became_active":"2026-02-26T02:47:56.597889+0000","last_became_peered":"2026-02-26T02:47:56.597889+0000","last_unstale":"2026-02-26T02:53:15.077964+0000","last_undegraded":"2026-02-26T02:53:15.077964+0000","last_fullsized":"2026-02-26T02:53:15.077964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2026-02-26T02:53:15.076338+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2026-02-26T02:53:15.076338+0000","last_clean_scrub_stamp":"2026-02-26T02:53:15.076338+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T08:43:09.009086+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0.026549789000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"33'34","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-26T02:53:14.274263+0000","last_change":"2026-02-26T02:53:14.277107+0000","last_active":"2026-02-26T02:53:14.274263+0000","last_peered":"2026-02-26T02:53:14.274263+0000","last_clean":"2026-02-26T02:53:14.274263+0000","last_became_active":"2026-02-26T02:47:48.639409+0000","last_became_peered":"2026-02-26T02:47:48.639409+0000","last_unstale":"2026-02-26T02:53:14.274263+0000","last_undegraded":"2026-02-26T02:53:14.274263+0000","last_fullsized":"2026-02-26T02:53:14.274263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2026-02-26T02:53:14.271599+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2026-02-26T02:53:14.271599+0000","last_clean_scrub_stamp":"2026-02-26T02:53:14.271599+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T06:59:07.421598+0000","scrub_duration":279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":328192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":795680,"data_compressed":1456,"data_compressed_allocated":49152,"data_compressed_original":778240,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":13,"up_from":26,"seq":111669149766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,8,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 13 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":26,"seq":111669149768,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":5,"up_from":26,"seq":111669149768,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":21,"seq":90194313289,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":21,"seq":90194313289,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,4,6,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":21,"seq":90194313288,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":335872,"data_stored":133942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,4,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":21,"seq":90194313289,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,4,6,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":21,"seq":90194313289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":1,"up_from":22,"seq":94489280586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,4,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 1 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":15,"up_from":21,"seq":90194313288,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,4,6,7,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182471,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":368640,"data_stored":531763,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,5,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 4 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":0,"up_from":25,"seq":107374182472,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":25,"seq":107374182472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[2,3,4,5,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 10 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":12,"up_from":25,"seq":107374182471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":133923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":397840,"data_compressed":728,"data_compressed_allocated":24576,"data_compressed_original":389120,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-26T02:53:34.508 DEBUG:teuthology.orchestra.run.trial093:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-26T02:53:34.841 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-26T02:53:34.843 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-26T02:53:34.843 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-26T02:53:34.843 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-26T02:53:34.843 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:53:34.849 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:53:34.843+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 45481) UID: 0 2026-02-26T02:53:34.851 INFO:tasks.ceph.osd.0.trial093.stderr:2026-02-26T02:53:34.844+0000 c69d640 -1 osd.0 33 *** Got signal Terminated *** 2026-02-26T02:53:40.945 INFO:tasks.ceph.osd.0:Stopped 2026-02-26T02:53:40.945 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-26T02:53:40.945 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:53:40.952 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-26T02:53:40.946+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 45482) UID: 0 2026-02-26T02:53:40.952 INFO:tasks.ceph.osd.4.trial093.stderr:2026-02-26T02:53:40.946+0000 c69d640 -1 osd.4 35 *** Got signal Terminated *** 2026-02-26T02:53:41.922 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:07.577 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.949 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:07.602 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.950 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:07.605 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.951 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:07.604 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.959 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:07.615 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.960 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:07.613 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.980 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:07.602 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.981 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:07.603 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:41.990 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:07.612 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:53:42.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-26T02:53:47.047 INFO:tasks.ceph.osd.4:Stopped 2026-02-26T02:53:47.047 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-26T02:53:47.047 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:53:47.055 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:53:47.048+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 45487) UID: 0 2026-02-26T02:53:47.055 INFO:tasks.ceph.osd.8.trial093.stderr:2026-02-26T02:53:47.049+0000 c69d640 -1 osd.8 36 *** Got signal Terminated *** 2026-02-26T02:53:49.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-26T02:53:53.149 INFO:tasks.ceph.osd.8:Stopped 2026-02-26T02:53:53.149 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-26T02:53:53.150 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:53:53.157 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:53:53.151+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 45489) UID: 0 2026-02-26T02:53:53.157 INFO:tasks.ceph.osd.12.trial093.stderr:2026-02-26T02:53:53.151+0000 c69d640 -1 osd.12 38 *** Got signal Terminated *** 2026-02-26T02:53:59.251 INFO:tasks.ceph.osd.12:Stopped 2026-02-26T02:53:59.251 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-26T02:53:59.251 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:53:59.259 INFO:tasks.ceph.osd.1.trial130.stderr:2026-02-26T02:53:59.253+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 44664) UID: 0 2026-02-26T02:53:59.259 INFO:tasks.ceph.osd.1.trial130.stderr:2026-02-26T02:53:59.254+0000 c69d640 -1 osd.1 39 *** Got signal Terminated *** 2026-02-26T02:54:01.948 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:27.603 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:01.974 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:27.629 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:01.975 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:27.627 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:01.978 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:27.630 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:01.984 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:27.639 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:01.988 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:27.640 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:01.999 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:27.621 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:02.001 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:27.623 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:02.011 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:27.633 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:05.352 INFO:tasks.ceph.osd.1:Stopped 2026-02-26T02:54:05.352 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-26T02:54:05.352 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:05.360 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:54:05.354+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 44667) UID: 0 2026-02-26T02:54:05.360 INFO:tasks.ceph.osd.5.trial130.stderr:2026-02-26T02:54:05.354+0000 c69d640 -1 osd.5 41 *** Got signal Terminated *** 2026-02-26T02:54:16.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2026-02-26T02:54:17.556 INFO:tasks.ceph.osd.5:Stopped 2026-02-26T02:54:17.556 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-26T02:54:17.556 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:17.563 INFO:tasks.ceph.osd.9.trial130.stderr:2026-02-26T02:54:17.557+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 44670) UID: 0 2026-02-26T02:54:17.564 INFO:tasks.ceph.osd.9.trial130.stderr:2026-02-26T02:54:17.557+0000 c69d640 -1 osd.9 43 *** Got signal Terminated *** 2026-02-26T02:54:22.034 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:47.689 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.035 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:47.691 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.044 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:08:47.700 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.060 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:47.712 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.061 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:47.713 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.062 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:47.683 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.063 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:47.684 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.069 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:08:47.722 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.072 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:08:47.694 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:22.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2026-02-26T02:54:22.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2026-02-26T02:54:23.657 INFO:tasks.ceph.osd.9:Stopped 2026-02-26T02:54:23.658 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-26T02:54:23.658 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:23.665 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:54:23.659+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 44672) UID: 0 2026-02-26T02:54:23.665 INFO:tasks.ceph.osd.13.trial130.stderr:2026-02-26T02:54:23.660+0000 c69d640 -1 osd.13 45 *** Got signal Terminated *** 2026-02-26T02:54:28.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-26T02:54:28.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2026-02-26T02:54:29.759 INFO:tasks.ceph.osd.13:Stopped 2026-02-26T02:54:29.759 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-26T02:54:29.759 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:29.767 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:54:29.761+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 44855) UID: 0 2026-02-26T02:54:29.767 INFO:tasks.ceph.osd.2.trial161.stderr:2026-02-26T02:54:29.761+0000 c69d640 -1 osd.2 46 *** Got signal Terminated *** 2026-02-26T02:54:35.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-26T02:54:35.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-26T02:54:35.861 INFO:tasks.ceph.osd.2:Stopped 2026-02-26T02:54:35.862 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-26T02:54:35.862 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:35.869 INFO:tasks.ceph.osd.6.trial161.stderr:2026-02-26T02:54:35.863+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 44857) UID: 0 2026-02-26T02:54:35.869 INFO:tasks.ceph.osd.6.trial161.stderr:2026-02-26T02:54:35.864+0000 c69d640 -1 osd.6 48 *** Got signal Terminated *** 2026-02-26T02:54:41.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2026-02-26T02:54:41.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-26T02:54:41.963 INFO:tasks.ceph.osd.6:Stopped 2026-02-26T02:54:41.963 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-26T02:54:41.964 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:41.971 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:54:41.965+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 44861) UID: 0 2026-02-26T02:54:41.971 INFO:tasks.ceph.osd.10.trial161.stderr:2026-02-26T02:54:41.965+0000 c69d640 -1 osd.10 49 *** Got signal Terminated *** 2026-02-26T02:54:42.040 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:09:07.695 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.065 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:09:07.717 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.066 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:09:07.720 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.066 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:09:07.718 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.074 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:09:07.730 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.076 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:09:07.728 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.090 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:09:07.712 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.091 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:09:07.713 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:42.101 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:09:07.722 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:54:47.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-26T02:54:47.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2026-02-26T02:54:48.066 INFO:tasks.ceph.osd.10:Stopped 2026-02-26T02:54:48.066 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-26T02:54:48.066 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:48.074 INFO:tasks.ceph.osd.14.trial161.stderr:2026-02-26T02:54:48.067+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 44863) UID: 0 2026-02-26T02:54:48.074 INFO:tasks.ceph.osd.14.trial161.stderr:2026-02-26T02:54:48.067+0000 c69d640 -1 osd.14 50 *** Got signal Terminated *** 2026-02-26T02:54:53.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-26T02:54:54.200 INFO:tasks.ceph.osd.14:Stopped 2026-02-26T02:54:54.201 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-26T02:54:54.201 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:54:54.223 INFO:tasks.ceph.osd.3.trial192.stderr:2026-02-26T02:54:54.217+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 45524) UID: 0 2026-02-26T02:54:54.224 INFO:tasks.ceph.osd.3.trial192.stderr:2026-02-26T02:54:54.218+0000 c69d640 -1 osd.3 51 *** Got signal Terminated *** 2026-02-26T02:54:58.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-26T02:55:00.303 INFO:tasks.ceph.osd.3:Stopped 2026-02-26T02:55:00.303 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-26T02:55:00.303 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:00.311 INFO:tasks.ceph.osd.7.trial192.stderr:2026-02-26T02:55:00.305+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 45526) UID: 0 2026-02-26T02:55:00.311 INFO:tasks.ceph.osd.7.trial192.stderr:2026-02-26T02:55:00.305+0000 c69d640 -1 osd.7 51 *** Got signal Terminated *** 2026-02-26T02:55:02.070 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:09:27.725 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.094 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:09:27.747 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.095 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:09:27.750 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.096 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:09:27.748 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.104 INFO:tasks.ceph.mon.b.trial130.stderr:==00:00:09:27.757 44431== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.105 INFO:tasks.ceph.mon.a.trial093.stderr:==00:00:09:27.760 45143== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.120 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:09:27.741 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.120 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:09:27.742 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:02.130 INFO:tasks.ceph.mon.c.trial161.stderr:==00:00:09:27.752 44622== Warning: unimplemented fcntl command: 1036 2026-02-26T02:55:04.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-26T02:55:04.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-26T02:55:06.404 INFO:tasks.ceph.osd.7:Stopped 2026-02-26T02:55:06.405 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-26T02:55:06.405 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:06.413 INFO:tasks.ceph.osd.11.trial192.stderr:2026-02-26T02:55:06.406+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 45530) UID: 0 2026-02-26T02:55:06.413 INFO:tasks.ceph.osd.11.trial192.stderr:2026-02-26T02:55:06.407+0000 c69d640 -1 osd.11 51 *** Got signal Terminated *** 2026-02-26T02:55:10.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-26T02:55:12.506 INFO:tasks.ceph.osd.11:Stopped 2026-02-26T02:55:12.507 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-26T02:55:12.507 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:12.514 INFO:tasks.ceph.osd.15.trial192.stderr:2026-02-26T02:55:12.508+0000 c69d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 45532) UID: 0 2026-02-26T02:55:12.514 INFO:tasks.ceph.osd.15.trial192.stderr:2026-02-26T02:55:12.509+0000 c69d640 -1 osd.15 51 *** Got signal Terminated *** 2026-02-26T02:55:15.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-26T02:55:18.608 INFO:tasks.ceph.osd.15:Stopped 2026-02-26T02:55:18.609 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-26T02:55:18.609 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-26T02:55:18.609 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:18.638 INFO:tasks.ceph.mgr.y:Stopped 2026-02-26T02:55:18.638 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-26T02:55:18.638 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:18.638 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:55:18.637+0000 7f67432cd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 44464) UID: 0 2026-02-26T02:55:18.638 INFO:tasks.ceph.mgr.x.trial192.stderr:2026-02-26T02:55:18.637+0000 7f67432cd640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-26T02:55:18.672 INFO:tasks.ceph.mgr.x:Stopped 2026-02-26T02:55:18.672 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-26T02:55:18.673 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-26T02:55:18.673 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:18.687 INFO:tasks.ceph.mon.a.trial093.stderr:2026-02-26T02:55:18.679+0000 aca6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 45141) UID: 0 2026-02-26T02:55:18.688 INFO:tasks.ceph.mon.a.trial093.stderr:2026-02-26T02:55:18.679+0000 aca6640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-26T02:55:21.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-26T02:55:21.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-26T02:55:24.774 INFO:tasks.ceph.mon.a:Stopped 2026-02-26T02:55:24.774 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-26T02:55:24.774 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:24.782 INFO:tasks.ceph.mon.b.trial130.stderr:2026-02-26T02:55:24.776+0000 aca6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 44429) UID: 0 2026-02-26T02:55:24.783 INFO:tasks.ceph.mon.b.trial130.stderr:2026-02-26T02:55:24.776+0000 aca6640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-26T02:55:26.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-26T02:55:26.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-26T02:55:30.875 INFO:tasks.ceph.mon.b:Stopped 2026-02-26T02:55:30.876 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-26T02:55:30.876 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-26T02:55:30.885 INFO:tasks.ceph.mon.c.trial161.stderr:2026-02-26T02:55:30.877+0000 aca6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 44620) UID: 0 2026-02-26T02:55:30.886 INFO:tasks.ceph.mon.c.trial161.stderr:2026-02-26T02:55:30.878+0000 aca6640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-26T02:55:31.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-26T02:55:36.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-26T02:55:36.978 INFO:tasks.ceph.mon.c:Stopped 2026-02-26T02:55:36.978 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-26T02:55:36.979 DEBUG:teuthology.orchestra.run.trial093:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-26T02:55:37.007 INFO:teuthology.orchestra.run.trial093.stdout:2026-02-26T02:47:43.630099+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-26T02:55:37.009 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2026-02-26T02:55:37.009 DEBUG:teuthology.orchestra.run.trial093:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-26T02:55:37.076 DEBUG:teuthology.orchestra.run.trial093:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-26T02:55:37.141 DEBUG:teuthology.orchestra.run.trial093:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-26T02:55:37.207 INFO:teuthology.orchestra.run.trial093.stdout:2026-02-26T02:47:43.630099+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-26T02:55:37.208 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:55:37.209 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-26T02:55:37.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:55:37.277 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-26T02:55:37.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:55:37.350 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-26T02:55:37.417 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:55:37.417 DEBUG:teuthology.orchestra.run.trial093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-26T02:55:37.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:55:37.484 DEBUG:teuthology.orchestra.run.trial130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-26T02:55:37.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:55:37.524 DEBUG:teuthology.orchestra.run.trial130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-26T02:55:37.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:55:37.599 DEBUG:teuthology.orchestra.run.trial130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-26T02:55:37.715 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:55:37.716 DEBUG:teuthology.orchestra.run.trial130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-26T02:55:37.759 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:55:37.760 DEBUG:teuthology.orchestra.run.trial161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-26T02:55:37.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:55:37.794 DEBUG:teuthology.orchestra.run.trial161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-26T02:55:37.870 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:55:37.870 DEBUG:teuthology.orchestra.run.trial161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-26T02:55:37.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:55:37.939 DEBUG:teuthology.orchestra.run.trial161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-26T02:55:38.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:55:38.058 DEBUG:teuthology.orchestra.run.trial192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-26T02:55:38.092 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:55:38.093 DEBUG:teuthology.orchestra.run.trial192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-26T02:55:38.165 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:55:38.165 DEBUG:teuthology.orchestra.run.trial192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-26T02:55:38.234 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:55:38.235 DEBUG:teuthology.orchestra.run.trial192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-26T02:55:38.304 INFO:tasks.ceph:Archiving mon data... 2026-02-26T02:55:38.306 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/data/mon.a.tgz 2026-02-26T02:55:38.306 DEBUG:teuthology.orchestra.run.trial093:> mktemp 2026-02-26T02:55:38.323 INFO:teuthology.orchestra.run.trial093.stdout:/tmp/tmp.KCMQs5XyhY 2026-02-26T02:55:38.323 DEBUG:teuthology.orchestra.run.trial093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KCMQs5XyhY 2026-02-26T02:55:38.431 DEBUG:teuthology.orchestra.run.trial093:> sudo chmod 0666 /tmp/tmp.KCMQs5XyhY 2026-02-26T02:55:38.514 DEBUG:teuthology.orchestra.remote:trial093:/tmp/tmp.KCMQs5XyhY is 400KB 2026-02-26T02:55:38.612 DEBUG:teuthology.orchestra.run.trial093:> rm -fr /tmp/tmp.KCMQs5XyhY 2026-02-26T02:55:38.629 DEBUG:teuthology.misc:Transferring archived files from trial130:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/data/mon.b.tgz 2026-02-26T02:55:38.629 DEBUG:teuthology.orchestra.run.trial130:> mktemp 2026-02-26T02:55:38.646 INFO:teuthology.orchestra.run.trial130.stdout:/tmp/tmp.vplhKm52Q7 2026-02-26T02:55:38.646 DEBUG:teuthology.orchestra.run.trial130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vplhKm52Q7 2026-02-26T02:55:38.755 DEBUG:teuthology.orchestra.run.trial130:> sudo chmod 0666 /tmp/tmp.vplhKm52Q7 2026-02-26T02:55:38.838 DEBUG:teuthology.orchestra.remote:trial130:/tmp/tmp.vplhKm52Q7 is 401KB 2026-02-26T02:55:38.928 DEBUG:teuthology.orchestra.run.trial130:> rm -fr /tmp/tmp.vplhKm52Q7 2026-02-26T02:55:38.945 DEBUG:teuthology.misc:Transferring archived files from trial161:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/data/mon.c.tgz 2026-02-26T02:55:38.946 DEBUG:teuthology.orchestra.run.trial161:> mktemp 2026-02-26T02:55:38.964 INFO:teuthology.orchestra.run.trial161.stdout:/tmp/tmp.Wcd3aPDd8A 2026-02-26T02:55:38.964 DEBUG:teuthology.orchestra.run.trial161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Wcd3aPDd8A 2026-02-26T02:55:39.074 DEBUG:teuthology.orchestra.run.trial161:> sudo chmod 0666 /tmp/tmp.Wcd3aPDd8A 2026-02-26T02:55:39.156 DEBUG:teuthology.orchestra.remote:trial161:/tmp/tmp.Wcd3aPDd8A is 401KB 2026-02-26T02:55:39.245 DEBUG:teuthology.orchestra.run.trial161:> rm -fr /tmp/tmp.Wcd3aPDd8A 2026-02-26T02:55:39.262 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-26T02:55:39.262 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-26T02:55:39.264 DEBUG:teuthology.orchestra.run.trial130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-26T02:55:39.266 DEBUG:teuthology.orchestra.run.trial161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-26T02:55:39.304 DEBUG:teuthology.orchestra.run.trial192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-26T02:55:39.568 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-26T02:55:40.077 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-26T02:55:40.078 INFO:tasks.ceph:Archiving crash dumps... 2026-02-26T02:55:40.080 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial093/crash 2026-02-26T02:55:40.081 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-26T02:55:40.109 DEBUG:teuthology.misc:Transferring archived files from trial130:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial130/crash 2026-02-26T02:55:40.111 DEBUG:teuthology.orchestra.run.trial130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-26T02:55:40.136 DEBUG:teuthology.misc:Transferring archived files from trial161:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial161/crash 2026-02-26T02:55:40.137 DEBUG:teuthology.orchestra.run.trial161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-26T02:55:40.163 DEBUG:teuthology.misc:Transferring archived files from trial192:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial192/crash 2026-02-26T02:55:40.164 DEBUG:teuthology.orchestra.run.trial192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-26T02:55:40.191 INFO:tasks.ceph:Compressing logs... 2026-02-26T02:55:40.192 DEBUG:teuthology.orchestra.run.trial093:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:40.194 DEBUG:teuthology.orchestra.run.trial130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:40.196 DEBUG:teuthology.orchestra.run.trial161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:40.208 DEBUG:teuthology.orchestra.run.trial192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:40.230 INFO:teuthology.orchestra.run.trial130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-26T02:55:40.231 INFO:teuthology.orchestra.run.trial130.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/ceph-osd.1.log: 90.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-26T02:55:40.232 INFO:teuthology.orchestra.run.trial130.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-26T02:55:40.245 INFO:teuthology.orchestra.run.trial161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-26T02:55:40.245 INFO:teuthology.orchestra.run.trial161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-26T02:55:40.245 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-26T02:55:40.245 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-26T02:55:40.245 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-26T02:55:40.246 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-26T02:55:40.247 INFO:teuthology.orchestra.run.trial161.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 90.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-26T02:55:40.247 INFO:teuthology.orchestra.run.trial161.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-26T02:55:40.261 INFO:teuthology.orchestra.run.trial130.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-26T02:55:40.261 INFO:teuthology.orchestra.run.trial130.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44810.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45407.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.44810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44810.log.gz 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45078.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.45078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.44611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-26T02:55:40.269 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 66.2% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.44658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45360.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44983.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45360.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45360.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.44983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44983.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45313.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44763.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45313.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44912.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.44763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44763.log.gz 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.44912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45125.log 2026-02-26T02:55:40.270 INFO:teuthology.orchestra.run.trial192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44912.log.gz 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45125.log.gz 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44716.log 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.45031.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2026-02-26T02:55:40.271 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-client.admin.44716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44716.log.gz 2026-02-26T02:55:40.277 INFO:teuthology.orchestra.run.trial130.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58597.log 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56832.log 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57911.log 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58597.log.gz 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56832.log.gz 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55411.log 2026-02-26T02:55:40.282 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57911.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53842.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55411.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57617.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54087.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53842.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50203.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57617.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54087.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54431.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50203.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50203.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55705.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54431.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51756.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55705.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50209.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50888.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51756.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50209.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49092.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49046.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50888.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49092.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49046.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51627.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58058.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51627.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51517.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58058.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57078.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52600.log 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51517.log.gz 2026-02-26T02:55:40.283 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57078.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55460.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56538.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52600.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55460.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55019.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56538.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55019.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54136.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51881.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54136.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56048.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51624.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51881.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56048.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55215.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51439.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51624.log: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51624.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52404.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51439.log: /var/log/ceph/ceph-client.admin.55215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51439.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54970.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55215.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52404.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53693.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54970.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53693.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58450.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58450.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51755.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50187.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51755.log.gz 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48954.log 2026-02-26T02:55:40.284 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50701.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50187.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.48954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48954.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51432.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56734.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50701.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51432.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56587.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46610.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56734.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56587.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50211.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46610.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58793.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51375.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50211.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58793.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56685.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55999.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51375.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56685.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51882.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51176.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55999.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51882.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45590.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55754.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51176.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45590.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57519.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55754.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50208.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58205.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57519.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50208.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55166.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58205.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55166.log.gz 2026-02-26T02:55:40.285 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53496.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52747.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53496.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52747.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49000.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz /var/log/ceph/ceph-client.admin.53545.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51883.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53545.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53545.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/valgrind/osd.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 65.7% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/valgrind/osd.12.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49443.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 65.7% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49443.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46657.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip/var/log/ceph/ceph-client.admin.49758.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57127.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.46657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46657.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54333.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56146.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57127.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54333.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55950.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56146.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56244.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55950.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50212.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56244.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50212.log.gz 2026-02-26T02:55:40.286 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51884.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51884.log: -- /var/log/ceph/ceph-client.admin.58646.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51884.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56783.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58646.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54676.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54382.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56783.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53940.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54676.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48903.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54382.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53940.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51626.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.48903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48903.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50817.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51626.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51522.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50817.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55509.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51522.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54774.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54480.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55509.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54774.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50180.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56881.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54480.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50180.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49660.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56881.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56980.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49660.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.49660.log.gz -5 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51069.log 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56980.log.gz 2026-02-26T02:55:40.287 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52895.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58695.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51069.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50175.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52895.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58695.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.58695.log.gz --verbose 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: -- /var/log/ceph/ceph-osd.4.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50175.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57960.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52300.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57960.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58889.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54578.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52300.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55901.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58889.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54284.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54578.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55901.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50174.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54284.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50174.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54872.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53989.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54872.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51018.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53989.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.53989.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57764.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57421.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51018.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57764.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57029.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57421.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49184.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57029.log.gz 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57274.log 2026-02-26T02:55:40.288 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50742.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49184.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57274.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56195.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57176.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50742.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56195.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53238.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50898.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57176.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53238.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51046.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55264.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50898.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50191.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51046.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58009.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55264.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50191.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50191.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58009.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.58009.log.gz -5 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50962.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57862.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50962.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50184.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52944.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57862.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53385.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50184.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 90.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57813.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52944.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52453.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53385.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57813.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53091.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55852.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52453.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53091.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57225.log 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55852.log.gz 2026-02-26T02:55:40.289 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51043.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57225.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53643.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51043.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55313.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53643.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53743.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55313.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.58401.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55313.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53743.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50648.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip/var/log/ceph/ceph-client.admin.58401.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54038.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58401.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50648.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51970.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57323.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54038.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51970.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54185.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55558.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57323.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54185.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52796.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55068.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55558.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52796.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56342.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50197.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55068.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56342.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54725.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56489.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50197.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54725.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55607.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56489.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55607.log.gz 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56636.log 2026-02-26T02:55:40.290 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53447.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56636.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52000.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56930.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53447.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52000.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53336.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57715.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56930.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53336.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53891.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57715.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53891.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49572.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.45716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56440.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49572.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56440.log: 90.9%gzip -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54529.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56440.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52845.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz -5 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50702.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54529.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38905.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50702.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52159.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58254.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph.tmp-client.admin.38905.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38905.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52159.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51037.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50201.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58254.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.51037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51037.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50195.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip/var/log/ceph/ceph-client.admin.50201.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55117.log 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50201.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50195.log.gz 2026-02-26T02:55:40.291 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57568.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55117.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58303.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55803.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57568.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58303.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58548.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50612.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55803.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58548.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52993.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58499.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50612.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52993.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54823.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52329.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58499.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54823.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56293.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55656.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52329.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56293.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56391.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.55656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58744.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55656.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56391.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54921.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57666.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58744.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54921.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54234.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58156.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57666.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54234.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52649.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58156.log.gz 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49595.log 2026-02-26T02:55:40.292 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52649.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53042.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49595.log: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49595.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58107.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53042.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53042.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58107.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52232.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53287.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52232.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54627.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53140.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53287.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.54627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54627.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58842.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57470.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53140.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58842.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53594.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57470.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56097.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53189.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53594.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.56097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56097.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52698.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53189.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52233.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52698.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49502.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.52233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52233.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57372.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.49502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49502.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.57372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58352.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57372.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.53792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50210.log 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.58352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58352.log.gz 2026-02-26T02:55:40.293 INFO:teuthology.orchestra.run.trial093.stderr:/var/log/ceph/ceph-client.admin.50210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50210.log.gz 2026-02-26T02:55:40.294 INFO:teuthology.orchestra.run.trial130.stderr: 90.4% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-26T02:55:40.294 INFO:teuthology.orchestra.run.trial161.stderr: 90.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-26T02:55:40.294 INFO:teuthology.orchestra.run.trial161.stderr: 90.5% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-26T02:55:40.294 INFO:teuthology.orchestra.run.trial161.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-26T02:55:40.295 INFO:teuthology.orchestra.run.trial093.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-26T02:55:40.295 INFO:teuthology.orchestra.run.trial161.stderr: 90.5% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-26T02:55:40.295 INFO:teuthology.orchestra.run.trial093.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-26T02:55:40.311 INFO:teuthology.orchestra.run.trial192.stderr:/var/log/ceph/ceph-osd.15.log: 90.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-26T02:55:40.317 INFO:teuthology.orchestra.run.trial192.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-26T02:55:40.322 INFO:teuthology.orchestra.run.trial192.stderr: 90.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-26T02:55:40.326 INFO:teuthology.orchestra.run.trial093.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-26T02:55:40.332 INFO:teuthology.orchestra.run.trial130.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-26T02:55:40.333 INFO:teuthology.orchestra.run.trial130.stderr: 2026-02-26T02:55:40.333 INFO:teuthology.orchestra.run.trial130.stderr:real 0m0.125s 2026-02-26T02:55:40.333 INFO:teuthology.orchestra.run.trial130.stderr:user 0m0.304s 2026-02-26T02:55:40.333 INFO:teuthology.orchestra.run.trial130.stderr:sys 0m0.038s 2026-02-26T02:55:40.334 INFO:teuthology.orchestra.run.trial192.stderr: 90.4% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-26T02:55:40.334 INFO:teuthology.orchestra.run.trial161.stderr: 89.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-26T02:55:40.336 INFO:teuthology.orchestra.run.trial161.stderr: 2026-02-26T02:55:40.336 INFO:teuthology.orchestra.run.trial161.stderr:real 0m0.114s 2026-02-26T02:55:40.336 INFO:teuthology.orchestra.run.trial161.stderr:user 0m0.330s 2026-02-26T02:55:40.336 INFO:teuthology.orchestra.run.trial161.stderr:sys 0m0.035s 2026-02-26T02:55:40.340 INFO:teuthology.orchestra.run.trial192.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-26T02:55:40.342 INFO:teuthology.orchestra.run.trial192.stderr: 2026-02-26T02:55:40.342 INFO:teuthology.orchestra.run.trial192.stderr:real 0m0.092s 2026-02-26T02:55:40.342 INFO:teuthology.orchestra.run.trial192.stderr:user 0m0.306s 2026-02-26T02:55:40.342 INFO:teuthology.orchestra.run.trial192.stderr:sys 0m0.038s 2026-02-26T02:55:40.437 INFO:teuthology.orchestra.run.trial093.stderr: 88.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-26T02:55:40.438 INFO:teuthology.orchestra.run.trial093.stderr: 2026-02-26T02:55:40.438 INFO:teuthology.orchestra.run.trial093.stderr:real 0m0.230s 2026-02-26T02:55:40.438 INFO:teuthology.orchestra.run.trial093.stderr:user 0m0.468s 2026-02-26T02:55:40.438 INFO:teuthology.orchestra.run.trial093.stderr:sys 0m0.110s 2026-02-26T02:55:40.439 INFO:tasks.ceph:Archiving logs... 2026-02-26T02:55:40.439 DEBUG:teuthology.misc:Transferring archived files from trial093:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial093/log 2026-02-26T02:55:40.441 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-26T02:55:40.645 DEBUG:teuthology.misc:Transferring archived files from trial130:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial130/log 2026-02-26T02:55:40.645 DEBUG:teuthology.orchestra.run.trial130:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-26T02:55:40.711 DEBUG:teuthology.misc:Transferring archived files from trial161:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial161/log 2026-02-26T02:55:40.712 DEBUG:teuthology.orchestra.run.trial161:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-26T02:55:40.786 DEBUG:teuthology.misc:Transferring archived files from trial192:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial192/log 2026-02-26T02:55:40.787 DEBUG:teuthology.orchestra.run.trial192:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-26T02:55:40.864 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6e3d0419ccca0e75a03e08feb708946e198236f4/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_8d724284d6d767af9ab8bf4bc6bd4e45f8502cb5/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-26T02:55:40.865 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-26T02:55:40.878 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-26T02:55:40.895 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-26T02:55:40.896 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-26T02:55:40.898 DEBUG:teuthology.orchestra.run.trial130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-26T02:55:40.900 DEBUG:teuthology.orchestra.run.trial161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-26T02:55:40.902 DEBUG:teuthology.orchestra.run.trial192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-26T02:55:41.196 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-26T02:55:41.208 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-26T02:55:41.208 DEBUG:teuthology.orchestra.run.trial093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:55:41.211 DEBUG:teuthology.orchestra.run.trial130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:55:41.213 DEBUG:teuthology.orchestra.run.trial161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:55:41.214 DEBUG:teuthology.orchestra.run.trial192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-26T02:55:41.225 INFO:teuthology.orchestra.run.trial093.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:55:41.228 INFO:teuthology.orchestra.run.trial130.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:55:41.229 INFO:teuthology.orchestra.run.trial161.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:55:41.230 INFO:teuthology.orchestra.run.trial192.stderr:bash: line 1: ntpq: command not found 2026-02-26T02:55:41.250 INFO:teuthology.orchestra.run.trial130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:55:41.250 INFO:teuthology.orchestra.run.trial130.stdout:=============================================================================== 2026-02-26T02:55:41.250 INFO:teuthology.orchestra.run.trial130.stdout:^* time.cloudflare.com 3 7 377 30 -95us[ -56us] +/- 6812us 2026-02-26T02:55:41.250 INFO:teuthology.orchestra.run.trial130.stdout:^- fairy0.mattnordhoffdns.n> 3 6 377 23 -599us[ -599us] +/- 33ms 2026-02-26T02:55:41.250 INFO:teuthology.orchestra.run.trial130.stdout:^- ntp.sfo.icanbwell.com 2 7 377 97 -1160us[-1123us] +/- 37ms 2026-02-26T02:55:41.250 INFO:teuthology.orchestra.run.trial130.stdout:^+ 107-172-222-7-host.coloc> 2 7 377 96 +482us[ +518us] +/- 13ms 2026-02-26T02:55:41.251 INFO:teuthology.orchestra.run.trial161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:55:41.251 INFO:teuthology.orchestra.run.trial161.stdout:=============================================================================== 2026-02-26T02:55:41.251 INFO:teuthology.orchestra.run.trial161.stdout:^+ dns-e.ns4v.icu 2 6 377 225 +3130us[+3055us] +/- 51ms 2026-02-26T02:55:41.251 INFO:teuthology.orchestra.run.trial161.stdout:^* 50-203-248-23-static.hfc> 2 6 377 160 +318us[ +250us] +/- 28ms 2026-02-26T02:55:41.251 INFO:teuthology.orchestra.run.trial161.stdout:^+ 172-104-28-175.ip.linode> 2 6 377 30 -4238us[-4238us] +/- 57ms 2026-02-26T02:55:41.251 INFO:teuthology.orchestra.run.trial161.stdout:^+ 23.186.168.130 2 7 375 290 +675us[ +463us] +/- 56ms 2026-02-26T02:55:41.251 INFO:teuthology.orchestra.run.trial093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:55:41.252 INFO:teuthology.orchestra.run.trial093.stdout:=============================================================================== 2026-02-26T02:55:41.252 INFO:teuthology.orchestra.run.trial093.stdout:^- 69-10-208-170.rainiercon> 2 6 377 96 -1282us[-1282us] +/- 80ms 2026-02-26T02:55:41.252 INFO:teuthology.orchestra.run.trial093.stdout:^- 170-187-147-56.ip.linode> 2 7 377 94 -9661us[-9661us] +/- 85ms 2026-02-26T02:55:41.252 INFO:teuthology.orchestra.run.trial093.stdout:^- kc1cloud.147.72.155.23.m> 3 6 377 29 -592us[ -592us] +/- 45ms 2026-02-26T02:55:41.252 INFO:teuthology.orchestra.run.trial093.stdout:^* 50.205.57.38 1 7 377 96 +22us[ +32us] +/- 4746us 2026-02-26T02:55:41.259 INFO:teuthology.orchestra.run.trial192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-26T02:55:41.259 INFO:teuthology.orchestra.run.trial192.stdout:=============================================================================== 2026-02-26T02:55:41.259 INFO:teuthology.orchestra.run.trial192.stdout:^- time.gslb.gravinoc.com 2 7 377 100 +2246us[+2004us] +/- 37ms 2026-02-26T02:55:41.259 INFO:teuthology.orchestra.run.trial192.stdout:^- ntp.maxhost.io 2 7 377 94 +83us[ -539ns] +/- 55ms 2026-02-26T02:55:41.259 INFO:teuthology.orchestra.run.trial192.stdout:^- 69.9.131.124 2 7 377 33 +6515us[+6401us] +/- 76ms 2026-02-26T02:55:41.259 INFO:teuthology.orchestra.run.trial192.stdout:^* ntp.nyc.icanbwell.com 2 6 377 32 +29us[ -86us] +/- 2486us 2026-02-26T02:55:41.259 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-26T02:55:41.271 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-26T02:55:41.272 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-26T02:55:41.284 DEBUG:teuthology.orchestra.run.trial093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-26T02:55:41.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-26T02:55:41.349 DEBUG:teuthology.orchestra.run.trial130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-26T02:55:41.405 DEBUG:teuthology.orchestra.run.trial161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-26T02:55:41.460 DEBUG:teuthology.orchestra.run.trial192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-26T02:55:41.513 DEBUG:teuthology.orchestra.run.trial093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:55:41.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:41.544 DEBUG:teuthology.orchestra.run.trial130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:55:41.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:41.576 DEBUG:teuthology.orchestra.run.trial161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:55:41.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:41.606 DEBUG:teuthology.orchestra.run.trial192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-26T02:55:41.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:41.633 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-26T02:55:41.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-26T02:55:41.674 INFO:teuthology.task.internal:Duration was 1249.040993 seconds 2026-02-26T02:55:41.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-26T02:55:41.688 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-26T02:55:41.688 DEBUG:teuthology.orchestra.run.trial093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-26T02:55:41.690 DEBUG:teuthology.orchestra.run.trial130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-26T02:55:41.692 DEBUG:teuthology.orchestra.run.trial161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-26T02:55:41.694 DEBUG:teuthology.orchestra.run.trial192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-26T02:55:41.727 INFO:teuthology.orchestra.run.trial093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:55:41.728 INFO:teuthology.orchestra.run.trial130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:55:41.730 INFO:teuthology.orchestra.run.trial192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:55:41.730 INFO:teuthology.orchestra.run.trial161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-26T02:55:42.218 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-26T02:55:42.218 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial093.front.sepia.ceph.com 2026-02-26T02:55:42.219 DEBUG:teuthology.orchestra.run.trial093:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-26T02:55:42.242 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial130.front.sepia.ceph.com 2026-02-26T02:55:42.242 DEBUG:teuthology.orchestra.run.trial130:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-26T02:55:42.262 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial161.front.sepia.ceph.com 2026-02-26T02:55:42.262 DEBUG:teuthology.orchestra.run.trial161:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-26T02:55:42.282 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial192.front.sepia.ceph.com 2026-02-26T02:55:42.282 DEBUG:teuthology.orchestra.run.trial192:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-26T02:55:42.302 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-26T02:55:42.303 DEBUG:teuthology.orchestra.run.trial093:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.305 DEBUG:teuthology.orchestra.run.trial130:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.307 DEBUG:teuthology.orchestra.run.trial161:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.325 DEBUG:teuthology.orchestra.run.trial192:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.403 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-26T02:55:42.403 DEBUG:teuthology.orchestra.run.trial093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:42.406 DEBUG:teuthology.orchestra.run.trial130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:42.407 DEBUG:teuthology.orchestra.run.trial161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:42.409 DEBUG:teuthology.orchestra.run.trial192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-26T02:55:42.427 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:55:42.427 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:55:42.427 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-26T02:55:42.427 INFO:teuthology.orchestra.run.trial093.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.428 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-26T02:55:42.428 INFO:teuthology.orchestra.run.trial130.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:55:42.429 INFO:teuthology.orchestra.run.trial130.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:55:42.429 INFO:teuthology.orchestra.run.trial130.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-26T02:55:42.429 INFO:teuthology.orchestra.run.trial130.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.429 INFO:teuthology.orchestra.run.trial130.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-26T02:55:42.430 INFO:teuthology.orchestra.run.trial161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:55:42.432 INFO:teuthology.orchestra.run.trial161.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:55:42.432 INFO:teuthology.orchestra.run.trial161.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.432 INFO:teuthology.orchestra.run.trial161.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-26T02:55:42.433 INFO:teuthology.orchestra.run.trial161.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-26T02:55:42.434 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-26T02:55:42.434 INFO:teuthology.orchestra.run.trial192.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-26T02:55:42.434 INFO:teuthology.orchestra.run.trial192.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-26T02:55:42.435 INFO:teuthology.orchestra.run.trial192.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-26T02:55:42.435 INFO:teuthology.orchestra.run.trial192.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-26T02:55:42.438 INFO:teuthology.orchestra.run.trial093.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-26T02:55:42.440 INFO:teuthology.orchestra.run.trial130.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-26T02:55:42.442 INFO:teuthology.orchestra.run.trial161.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-26T02:55:42.443 INFO:teuthology.orchestra.run.trial192.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-26T02:55:42.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-26T02:55:42.462 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-26T02:55:42.462 DEBUG:teuthology.orchestra.run.trial093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-26T02:55:42.505 DEBUG:teuthology.orchestra.run.trial130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-26T02:55:42.530 DEBUG:teuthology.orchestra.run.trial161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-26T02:55:42.557 DEBUG:teuthology.orchestra.run.trial192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-26T02:55:42.583 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-26T02:55:42.601 DEBUG:teuthology.orchestra.run.trial093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.603 DEBUG:teuthology.orchestra.run.trial130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.604 DEBUG:teuthology.orchestra.run.trial161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.606 DEBUG:teuthology.orchestra.run.trial192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.625 INFO:teuthology.orchestra.run.trial093.stdout:kernel.core_pattern = core 2026-02-26T02:55:42.626 INFO:teuthology.orchestra.run.trial130.stdout:kernel.core_pattern = core 2026-02-26T02:55:42.628 INFO:teuthology.orchestra.run.trial161.stdout:kernel.core_pattern = core 2026-02-26T02:55:42.649 INFO:teuthology.orchestra.run.trial192.stdout:kernel.core_pattern = core 2026-02-26T02:55:42.665 DEBUG:teuthology.orchestra.run.trial093:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:42.695 DEBUG:teuthology.orchestra.run.trial130:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:42.711 DEBUG:teuthology.orchestra.run.trial161:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:42.727 DEBUG:teuthology.orchestra.run.trial192:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-26T02:55:42.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-26T02:55:42.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-26T02:55:42.754 INFO:teuthology.task.internal:Transferring archived files... 2026-02-26T02:55:42.755 DEBUG:teuthology.misc:Transferring archived files from trial093:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial093 2026-02-26T02:55:42.756 DEBUG:teuthology.orchestra.run.trial093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-26T02:55:42.794 DEBUG:teuthology.misc:Transferring archived files from trial130:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial130 2026-02-26T02:55:42.795 DEBUG:teuthology.orchestra.run.trial130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-26T02:55:42.834 DEBUG:teuthology.misc:Transferring archived files from trial161:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial161 2026-02-26T02:55:42.835 DEBUG:teuthology.orchestra.run.trial161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-26T02:55:42.871 DEBUG:teuthology.misc:Transferring archived files from trial192:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-26_01:51:16-rados-wip-yuri9-testing-2026-02-25-1600-squid-distro-default-trial/71027/remote/trial192 2026-02-26T02:55:42.871 DEBUG:teuthology.orchestra.run.trial192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-26T02:55:42.908 INFO:teuthology.task.internal:Removing archive directory... 2026-02-26T02:55:42.909 DEBUG:teuthology.orchestra.run.trial093:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-26T02:55:42.912 DEBUG:teuthology.orchestra.run.trial130:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-26T02:55:42.914 DEBUG:teuthology.orchestra.run.trial161:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-26T02:55:42.917 DEBUG:teuthology.orchestra.run.trial192:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-26T02:55:42.956 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-26T02:55:42.978 INFO:teuthology.task.internal:Not uploading archives. 2026-02-26T02:55:42.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-26T02:55:42.995 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-26T02:55:42.995 DEBUG:teuthology.orchestra.run.trial093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-26T02:55:42.998 DEBUG:teuthology.orchestra.run.trial130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-26T02:55:43.001 DEBUG:teuthology.orchestra.run.trial161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-26T02:55:43.004 DEBUG:teuthology.orchestra.run.trial192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-26T02:55:43.013 INFO:teuthology.orchestra.run.trial093.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 02:55 /home/ubuntu/cephtest 2026-02-26T02:55:43.016 INFO:teuthology.orchestra.run.trial130.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 02:55 /home/ubuntu/cephtest 2026-02-26T02:55:43.020 INFO:teuthology.orchestra.run.trial161.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 02:55 /home/ubuntu/cephtest 2026-02-26T02:55:43.022 INFO:teuthology.orchestra.run.trial192.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 02:55 /home/ubuntu/cephtest 2026-02-26T02:55:43.022 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-26T02:55:43.039 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-26T02:55:43.079 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} duration: 1249.0409932136536 failure_reason: '"2026-02-26T02:47:43.630099+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 5 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-26T02:55:43.079 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-26T02:55:43.197 INFO:teuthology.run:FAIL