2026-02-22T22:25:43.604 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T22:25:43.619 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T22:25:43.696 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests conf/{disable-pool-app}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64238' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: client: rbd_persistent_cache_mode: ssd rbd_persistent_cache_path: /home/ubuntu/cephtest/rbd-pwl-cache rbd_persistent_cache_size: 5368709120 rbd_plugins: pwl_cache global: mon warn on pool no app: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - - mon.b - mgr.y - osd.2 - osd.3 - client.0 seed: 9196 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHxvfhS7LJFd8ddb+aGJNkc2CKs2nwKGhtxHDd52IbYWWiltp4EIrhWUJkdd5Uc88O+Fm/k4NYIjvlrd1gC1KTE= trial144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODLpM596NowJ+BkiyEsDK62abunHM2Y+M1mVyUW7/efC1wypLJt5km936vkRfXkMPlz7IZme/R9MYOj9AlX1TU= tasks: - install: null - ceph: null - exec: client.0: - mkdir /home/ubuntu/cephtest/tmpfs - mkdir /home/ubuntu/cephtest/rbd-pwl-cache - sudo mount -t tmpfs -o size=20G tmpfs /home/ubuntu/cephtest/tmpfs - truncate -s 20G /home/ubuntu/cephtest/tmpfs/loopfile - mkfs.ext4 /home/ubuntu/cephtest/tmpfs/loopfile - sudo mount -o loop /home/ubuntu/cephtest/tmpfs/loopfile /home/ubuntu/cephtest/rbd-pwl-cache - sudo chmod 777 /home/ubuntu/cephtest/rbd-pwl-cache - exec_on_cleanup: client.0: - sudo umount /home/ubuntu/cephtest/rbd-pwl-cache - sudo umount /home/ubuntu/cephtest/tmpfs - rm -rf /home/ubuntu/cephtest/rbd-pwl-cache - rm -rf /home/ubuntu/cephtest/tmpfs - qemu: client.0: cpus: 4 disks: 3 memory: 4096 test: qa/run_xfstests_qemu.sh type: block teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:38 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T22:25:43.696 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T22:25:43.697 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T22:25:43.697 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T22:25:43.702 INFO:teuthology.task.internal:Checking packages... 2026-02-22T22:25:43.702 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T22:25:43.702 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T22:25:43.702 INFO:teuthology.packaging:ref: None 2026-02-22T22:25:43.702 INFO:teuthology.packaging:tag: None 2026-02-22T22:25:43.702 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:25:43.702 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:25:43.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:25:43.826 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.gf90f4eae 2026-02-22T22:25:43.828 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T22:25:43.839 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T22:25:43.840 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T22:25:43.854 INFO:teuthology.task.internal:Saving configuration 2026-02-22T22:25:43.862 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T22:25:43.874 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T22:25:43.952 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial125.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 22:22:17.718490', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHxvfhS7LJFd8ddb+aGJNkc2CKs2nwKGhtxHDd52IbYWWiltp4EIrhWUJkdd5Uc88O+Fm/k4NYIjvlrd1gC1KTE='} 2026-02-22T22:25:44.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial144.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 22:22:17.719036', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODLpM596NowJ+BkiyEsDK62abunHM2Y+M1mVyUW7/efC1wypLJt5km936vkRfXkMPlz7IZme/R9MYOj9AlX1TU='} 2026-02-22T22:25:44.009 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T22:25:44.020 INFO:teuthology.task.internal:roles: ubuntu@trial125.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1'] 2026-02-22T22:25:44.020 INFO:teuthology.task.internal:roles: ubuntu@trial144.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0'] 2026-02-22T22:25:44.021 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T22:25:44.163 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7e503452c360>, signals=[15]) 2026-02-22T22:25:44.163 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T22:25:44.176 INFO:teuthology.task.internal:Opening connections... 2026-02-22T22:25:44.176 DEBUG:teuthology.task.internal:connecting to ubuntu@trial125.front.sepia.ceph.com 2026-02-22T22:25:44.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:25:44.241 DEBUG:teuthology.task.internal:connecting to ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:25:44.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:25:44.306 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T22:25:44.318 DEBUG:teuthology.orchestra.run.trial125:> uname -m 2026-02-22T22:25:44.334 INFO:teuthology.orchestra.run.trial125.stdout:x86_64 2026-02-22T22:25:44.334 DEBUG:teuthology.orchestra.run.trial125:> cat /etc/os-release 2026-02-22T22:25:44.389 INFO:teuthology.orchestra.run.trial125.stdout:NAME="CentOS Stream" 2026-02-22T22:25:44.389 INFO:teuthology.orchestra.run.trial125.stdout:VERSION="9" 2026-02-22T22:25:44.389 INFO:teuthology.orchestra.run.trial125.stdout:ID="centos" 2026-02-22T22:25:44.389 INFO:teuthology.orchestra.run.trial125.stdout:ID_LIKE="rhel fedora" 2026-02-22T22:25:44.389 INFO:teuthology.orchestra.run.trial125.stdout:VERSION_ID="9" 2026-02-22T22:25:44.389 INFO:teuthology.orchestra.run.trial125.stdout:PLATFORM_ID="platform:el9" 2026-02-22T22:25:44.389 INFO:teuthology.orchestra.run.trial125.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T22:25:44.390 INFO:teuthology.orchestra.run.trial125.stdout:ANSI_COLOR="0;31" 2026-02-22T22:25:44.390 INFO:teuthology.orchestra.run.trial125.stdout:LOGO="fedora-logo-icon" 2026-02-22T22:25:44.390 INFO:teuthology.orchestra.run.trial125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T22:25:44.390 INFO:teuthology.orchestra.run.trial125.stdout:HOME_URL="https://centos.org/" 2026-02-22T22:25:44.390 INFO:teuthology.orchestra.run.trial125.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T22:25:44.390 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T22:25:44.390 INFO:teuthology.orchestra.run.trial125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T22:25:44.390 INFO:teuthology.lock.ops:Updating trial125.front.sepia.ceph.com on lock server 2026-02-22T22:25:44.458 DEBUG:teuthology.orchestra.run.trial144:> uname -m 2026-02-22T22:25:44.474 INFO:teuthology.orchestra.run.trial144.stdout:x86_64 2026-02-22T22:25:44.474 DEBUG:teuthology.orchestra.run.trial144:> cat /etc/os-release 2026-02-22T22:25:44.529 INFO:teuthology.orchestra.run.trial144.stdout:NAME="CentOS Stream" 2026-02-22T22:25:44.529 INFO:teuthology.orchestra.run.trial144.stdout:VERSION="9" 2026-02-22T22:25:44.529 INFO:teuthology.orchestra.run.trial144.stdout:ID="centos" 2026-02-22T22:25:44.529 INFO:teuthology.orchestra.run.trial144.stdout:ID_LIKE="rhel fedora" 2026-02-22T22:25:44.529 INFO:teuthology.orchestra.run.trial144.stdout:VERSION_ID="9" 2026-02-22T22:25:44.529 INFO:teuthology.orchestra.run.trial144.stdout:PLATFORM_ID="platform:el9" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:ANSI_COLOR="0;31" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:LOGO="fedora-logo-icon" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:HOME_URL="https://centos.org/" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T22:25:44.530 INFO:teuthology.orchestra.run.trial144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T22:25:44.530 INFO:teuthology.lock.ops:Updating trial144.front.sepia.ceph.com on lock server 2026-02-22T22:25:44.590 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T22:25:44.603 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T22:25:44.618 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T22:25:44.618 DEBUG:teuthology.orchestra.run.trial125:> test '!' -e /home/ubuntu/cephtest 2026-02-22T22:25:44.620 DEBUG:teuthology.orchestra.run.trial144:> test '!' -e /home/ubuntu/cephtest 2026-02-22T22:25:44.634 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T22:25:44.646 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T22:25:44.646 DEBUG:teuthology.orchestra.run.trial125:> test -z $(ls -A /var/lib/ceph) 2026-02-22T22:25:44.675 DEBUG:teuthology.orchestra.run.trial144:> test -z $(ls -A /var/lib/ceph) 2026-02-22T22:25:44.691 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T22:25:44.849 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T22:25:44.871 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T22:25:44.871 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T22:25:44.871 DEBUG:teuthology.orchestra.run.trial125:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T22:25:44.871 DEBUG:teuthology.orchestra.run.trial144:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T22:25:44.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:25:44.886 DEBUG:teuthology.orchestra.run.trial144:> uname -r 2026-02-22T22:25:44.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:25:44.887 DEBUG:teuthology.orchestra.run.trial125:> uname -r 2026-02-22T22:25:44.942 INFO:teuthology.orchestra.run.trial144.stdout:5.14.0-681.el9.x86_64 2026-02-22T22:25:44.942 INFO:teuthology.task.kernel:Running kernel on trial144: 5.14.0-681.el9.x86_64 2026-02-22T22:25:44.942 DEBUG:teuthology.orchestra.run.trial144:> sudo yum install -y kernel 2026-02-22T22:25:44.943 INFO:teuthology.orchestra.run.trial125.stdout:5.14.0-681.el9.x86_64 2026-02-22T22:25:44.943 INFO:teuthology.task.kernel:Running kernel on trial125: 5.14.0-681.el9.x86_64 2026-02-22T22:25:44.943 DEBUG:teuthology.orchestra.run.trial125:> sudo yum install -y kernel 2026-02-22T22:25:46.971 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.9 MB 00:01 2026-02-22T22:25:47.750 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.9 MB 00:02 2026-02-22T22:25:50.243 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-22T22:25:50.290 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-22T22:25:53.622 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-22T22:25:53.848 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 7.8 MB 00:01 2026-02-22T22:25:54.544 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 20 kB 00:00 2026-02-22T22:25:55.202 INFO:teuthology.orchestra.run.trial144.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-22T22:25:55.587 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-22T22:25:57.469 INFO:teuthology.orchestra.run.trial125.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2026-02-22T22:25:58.438 INFO:teuthology.orchestra.run.trial144.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-22T22:25:59.451 INFO:teuthology.orchestra.run.trial144.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T22:25:59.451 INFO:teuthology.orchestra.run.trial144.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T22:25:59.470 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:25:59.471 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:25:59.471 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:25:59.495 DEBUG:teuthology.orchestra.run.trial144:> echo no | sudo yum reinstall kernel || true 2026-02-22T22:25:59.795 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 10:25:58 PM UTC. 2026-02-22T22:25:59.874 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:25:59.876 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:25:59.876 INFO:teuthology.orchestra.run.trial144.stdout: Package Architecture Version Repository Size 2026-02-22T22:25:59.876 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:25:59.876 INFO:teuthology.orchestra.run.trial144.stdout:Reinstalling: 2026-02-22T22:25:59.876 INFO:teuthology.orchestra.run.trial144.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T22:25:59.877 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:25:59.877 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:25:59.877 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:25:59.877 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:25:59.877 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 803 k 2026-02-22T22:25:59.877 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 0 2026-02-22T22:25:59.877 INFO:teuthology.orchestra.run.trial144.stderr:Operation aborted. 2026-02-22T22:25:59.896 INFO:teuthology.orchestra.run.trial144.stdout:Is this ok [y/N]: 2026-02-22T22:25:59.896 DEBUG:teuthology.orchestra.run.trial144:> sudo yum reinstall -y kernel || true 2026-02-22T22:26:00.197 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 10:25:58 PM UTC. 2026-02-22T22:26:00.278 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:26:00.278 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout: Package Architecture Version Repository Size 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout:Reinstalling: 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:26:00.279 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 803 k 2026-02-22T22:26:00.280 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 0 2026-02-22T22:26:00.280 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:26:00.667 INFO:teuthology.orchestra.run.trial125.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-22T22:26:00.806 INFO:teuthology.orchestra.run.trial144.stdout:kernel-5.14.0-681.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2026-02-22T22:26:00.806 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:26:00.806 INFO:teuthology.orchestra.run.trial144.stdout:Total 1.5 MB/s | 803 kB 00:00 2026-02-22T22:26:00.816 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:26:00.849 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:26:00.849 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:26:00.853 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:26:00.854 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:26:00.878 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:26:00.882 INFO:teuthology.orchestra.run.trial144.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T22:26:00.882 INFO:teuthology.orchestra.run.trial144.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T22:26:00.989 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T22:26:00.989 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T22:26:01.041 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T22:26:01.042 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:26:01.042 INFO:teuthology.orchestra.run.trial144.stdout:Reinstalled: 2026-02-22T22:26:01.042 INFO:teuthology.orchestra.run.trial144.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T22:26:01.042 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:26:01.042 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:26:01.069 DEBUG:teuthology.orchestra.run.trial144:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T22:26:01.133 INFO:teuthology.orchestra.run.trial144.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T22:26:01.135 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T22:26:01.135 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T22:26:01.135 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-22T22:26:01.135 DEBUG:teuthology.orchestra.run.trial144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T22:26:01.199 INFO:teuthology.orchestra.run.trial144.stdout:ttyS1 2026-02-22T22:26:01.229 DEBUG:teuthology.parallel:result is None 2026-02-22T22:26:01.679 INFO:teuthology.orchestra.run.trial125.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T22:26:01.679 INFO:teuthology.orchestra.run.trial125.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T22:26:01.698 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:26:01.698 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:26:01.698 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:26:01.722 DEBUG:teuthology.orchestra.run.trial125:> echo no | sudo yum reinstall kernel || true 2026-02-22T22:26:02.022 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 10:26:00 PM UTC. 2026-02-22T22:26:02.102 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:26:02.103 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout: Package Architecture Version Repository Size 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout:Reinstalling: 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:26:02.104 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:26:02.105 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 803 k 2026-02-22T22:26:02.105 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 0 2026-02-22T22:26:02.105 INFO:teuthology.orchestra.run.trial125.stderr:Operation aborted. 2026-02-22T22:26:02.123 INFO:teuthology.orchestra.run.trial125.stdout:Is this ok [y/N]: 2026-02-22T22:26:02.123 DEBUG:teuthology.orchestra.run.trial125:> sudo yum reinstall -y kernel || true 2026-02-22T22:26:02.422 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 10:26:00 PM UTC. 2026-02-22T22:26:02.503 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:26:02.503 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:26:02.503 INFO:teuthology.orchestra.run.trial125.stdout: Package Architecture Version Repository Size 2026-02-22T22:26:02.503 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:26:02.503 INFO:teuthology.orchestra.run.trial125.stdout:Reinstalling: 2026-02-22T22:26:02.503 INFO:teuthology.orchestra.run.trial125.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T22:26:02.504 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:26:02.504 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:26:02.504 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:26:02.504 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:26:02.504 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 803 k 2026-02-22T22:26:02.504 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 0 2026-02-22T22:26:02.504 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:26:02.937 INFO:teuthology.orchestra.run.trial125.stdout:kernel-5.14.0-681.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2026-02-22T22:26:02.937 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:26:02.937 INFO:teuthology.orchestra.run.trial125.stdout:Total 1.8 MB/s | 803 kB 00:00 2026-02-22T22:26:02.948 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:26:02.981 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:26:02.981 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:26:02.985 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:26:02.986 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:26:03.009 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:26:03.013 INFO:teuthology.orchestra.run.trial125.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T22:26:03.013 INFO:teuthology.orchestra.run.trial125.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T22:26:03.118 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T22:26:03.118 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T22:26:03.171 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T22:26:03.171 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:26:03.171 INFO:teuthology.orchestra.run.trial125.stdout:Reinstalled: 2026-02-22T22:26:03.171 INFO:teuthology.orchestra.run.trial125.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T22:26:03.171 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:26:03.171 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:26:03.198 DEBUG:teuthology.orchestra.run.trial125:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T22:26:03.223 INFO:teuthology.orchestra.run.trial125.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T22:26:03.223 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T22:26:03.223 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T22:26:03.223 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T22:26:03.224 DEBUG:teuthology.orchestra.run.trial125:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T22:26:03.286 INFO:teuthology.orchestra.run.trial125.stdout:ttyS1 2026-02-22T22:26:03.317 DEBUG:teuthology.parallel:result is None 2026-02-22T22:26:03.317 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T22:26:03.329 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T22:26:03.329 DEBUG:teuthology.orchestra.run.trial125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T22:26:03.358 DEBUG:teuthology.orchestra.run.trial144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T22:26:03.374 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T22:26:03.385 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T22:26:03.399 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T22:26:03.399 DEBUG:teuthology.orchestra.run.trial125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T22:26:03.415 DEBUG:teuthology.orchestra.run.trial144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T22:26:03.441 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T22:26:03.456 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T22:26:03.456 DEBUG:teuthology.orchestra.run.trial125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T22:26:03.472 DEBUG:teuthology.orchestra.run.trial144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T22:26:03.494 INFO:teuthology.orchestra.run.trial125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:26:03.497 INFO:teuthology.orchestra.run.trial144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:26:03.502 INFO:teuthology.orchestra.run.trial125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:26:03.506 INFO:teuthology.orchestra.run.trial144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:26:03.508 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T22:26:03.519 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T22:26:03.520 DEBUG:teuthology.orchestra.run.trial125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T22:26:03.546 DEBUG:teuthology.orchestra.run.trial144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T22:26:03.572 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T22:26:03.588 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T22:26:03.589 DEBUG:teuthology.orchestra.run.trial125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T22:26:03.610 DEBUG:teuthology.orchestra.run.trial144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T22:26:03.628 DEBUG:teuthology.orchestra.run.trial125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:26:03.738 DEBUG:teuthology.orchestra.run.trial125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:26:03.763 DEBUG:teuthology.orchestra.run.trial125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:26:03.889 DEBUG:teuthology.orchestra.run.trial125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:26:03.919 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:26:03.919 DEBUG:teuthology.orchestra.run.trial125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T22:26:03.995 DEBUG:teuthology.orchestra.run.trial144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:26:04.143 DEBUG:teuthology.orchestra.run.trial144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:26:04.168 DEBUG:teuthology.orchestra.run.trial144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:26:04.327 DEBUG:teuthology.orchestra.run.trial144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:26:04.350 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:26:04.351 DEBUG:teuthology.orchestra.run.trial144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T22:26:04.413 DEBUG:teuthology.orchestra.run.trial125:> sudo service rsyslog restart 2026-02-22T22:26:04.415 DEBUG:teuthology.orchestra.run.trial144:> sudo service rsyslog restart 2026-02-22T22:26:04.441 INFO:teuthology.orchestra.run.trial125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T22:26:04.481 INFO:teuthology.orchestra.run.trial144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T22:26:04.983 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T22:26:04.996 INFO:teuthology.task.internal:Starting timer... 2026-02-22T22:26:04.996 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T22:26:05.013 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T22:26:05.030 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-22T22:26:05.031 DEBUG:teuthology.orchestra.run.trial125:> sudo service auditd rotate 2026-02-22T22:26:05.060 INFO:teuthology.orchestra.run.trial125.stdout:Rotating logs: 2026-02-22T22:26:05.062 DEBUG:teuthology.orchestra.run.trial144:> sudo service auditd rotate 2026-02-22T22:26:05.091 INFO:teuthology.orchestra.run.trial144.stdout:Rotating logs: 2026-02-22T22:26:05.093 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T22:26:05.093 DEBUG:teuthology.orchestra.run.trial125:> /usr/sbin/getenforce 2026-02-22T22:26:05.117 INFO:teuthology.orchestra.run.trial125.stdout:Permissive 2026-02-22T22:26:05.118 DEBUG:teuthology.orchestra.run.trial144:> /usr/sbin/getenforce 2026-02-22T22:26:05.149 INFO:teuthology.orchestra.run.trial144.stdout:Permissive 2026-02-22T22:26:05.150 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial125.front.sepia.ceph.com': 'permissive', 'ubuntu@trial144.front.sepia.ceph.com': 'permissive'} 2026-02-22T22:26:05.150 DEBUG:teuthology.orchestra.run.trial125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T22:26:05.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:26:05.183 DEBUG:teuthology.orchestra.run.trial144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T22:26:05.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:26:05.214 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T22:26:05.214 DEBUG:teuthology.orchestra.run.trial125:> sudo /usr/sbin/setenforce permissive 2026-02-22T22:26:05.247 DEBUG:teuthology.orchestra.run.trial144:> sudo /usr/sbin/setenforce permissive 2026-02-22T22:26:05.278 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T22:26:05.293 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-22T22:26:05.296 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-22T22:26:05.404 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T22:26:05.410 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T22:26:05.411 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial125.front.sepia.ceph.com,trial144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T22:28:46.447 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial125.front.sepia.ceph.com'), Remote(name='ubuntu@trial144.front.sepia.ceph.com')] 2026-02-22T22:28:46.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial125.front.sepia.ceph.com' 2026-02-22T22:28:46.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:28:46.560 DEBUG:teuthology.orchestra.run.trial125:> true 2026-02-22T22:28:46.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial125.front.sepia.ceph.com' 2026-02-22T22:28:46.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial144.front.sepia.ceph.com' 2026-02-22T22:28:46.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:28:46.746 DEBUG:teuthology.orchestra.run.trial144:> true 2026-02-22T22:28:46.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial144.front.sepia.ceph.com' 2026-02-22T22:28:46.820 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T22:28:46.835 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T22:28:46.835 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T22:28:46.836 DEBUG:teuthology.orchestra.run.trial125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:28:46.838 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T22:28:46.839 DEBUG:teuthology.orchestra.run.trial144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:28:46.865 INFO:teuthology.orchestra.run.trial125.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T22:28:46.875 INFO:teuthology.orchestra.run.trial125.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T22:28:46.886 INFO:teuthology.orchestra.run.trial144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T22:28:46.895 INFO:teuthology.orchestra.run.trial125.stderr:sudo: ntpd: command not found 2026-02-22T22:28:46.898 INFO:teuthology.orchestra.run.trial144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T22:28:46.905 INFO:teuthology.orchestra.run.trial125.stdout:506 Cannot talk to daemon 2026-02-22T22:28:46.916 INFO:teuthology.orchestra.run.trial125.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T22:28:46.919 INFO:teuthology.orchestra.run.trial144.stderr:sudo: ntpd: command not found 2026-02-22T22:28:46.928 INFO:teuthology.orchestra.run.trial125.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T22:28:46.929 INFO:teuthology.orchestra.run.trial144.stdout:506 Cannot talk to daemon 2026-02-22T22:28:46.941 INFO:teuthology.orchestra.run.trial144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T22:28:46.953 INFO:teuthology.orchestra.run.trial144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T22:28:46.975 INFO:teuthology.orchestra.run.trial125.stderr:bash: line 1: ntpq: command not found 2026-02-22T22:28:46.996 INFO:teuthology.orchestra.run.trial125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T22:28:46.996 INFO:teuthology.orchestra.run.trial125.stdout:=============================================================================== 2026-02-22T22:28:46.996 INFO:teuthology.orchestra.run.trial125.stdout:^? rn-03.koehn.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:46.996 INFO:teuthology.orchestra.run.trial125.stdout:^? vps5.drown.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:46.996 INFO:teuthology.orchestra.run.trial125.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:46.996 INFO:teuthology.orchestra.run.trial125.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:47.002 INFO:teuthology.orchestra.run.trial144.stderr:bash: line 1: ntpq: command not found 2026-02-22T22:28:47.016 INFO:teuthology.orchestra.run.trial144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T22:28:47.016 INFO:teuthology.orchestra.run.trial144.stdout:=============================================================================== 2026-02-22T22:28:47.016 INFO:teuthology.orchestra.run.trial144.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:47.016 INFO:teuthology.orchestra.run.trial144.stdout:^? baron.cgee.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:47.016 INFO:teuthology.orchestra.run.trial144.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:47.016 INFO:teuthology.orchestra.run.trial144.stdout:^? 23-95-35-34-host.colocro> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T22:28:47.017 INFO:teuthology.run_tasks:Running task install... 2026-02-22T22:28:47.031 DEBUG:teuthology.task.install:project ceph 2026-02-22T22:28:47.031 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T22:28:47.031 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T22:28:47.032 INFO:teuthology.task.install:Using flavor: default 2026-02-22T22:28:47.040 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T22:28:47.040 INFO:teuthology.task.install:extra packages: [] 2026-02-22T22:28:47.040 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T22:28:47.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:28:47.044 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T22:28:47.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:28:47.233 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T22:28:47.233 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T22:28:47.246 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T22:28:47.247 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T22:28:47.405 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T22:28:47.405 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:28:47.405 DEBUG:teuthology.orchestra.run.trial125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T22:28:47.419 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T22:28:47.419 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:28:47.419 DEBUG:teuthology.orchestra.run.trial144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T22:28:47.430 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-22T22:28:47.430 DEBUG:teuthology.orchestra.run.trial125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T22:28:47.445 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-22T22:28:47.445 DEBUG:teuthology.orchestra.run.trial144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T22:28:47.495 DEBUG:teuthology.orchestra.run.trial125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T22:28:47.511 DEBUG:teuthology.orchestra.run.trial144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T22:28:47.567 DEBUG:teuthology.orchestra.run.trial125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T22:28:47.584 DEBUG:teuthology.orchestra.run.trial144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T22:28:47.631 INFO:teuthology.orchestra.run.trial125.stdout:check_obsoletes = 1 2026-02-22T22:28:47.632 DEBUG:teuthology.orchestra.run.trial125:> sudo yum clean all 2026-02-22T22:28:47.648 INFO:teuthology.orchestra.run.trial144.stdout:check_obsoletes = 1 2026-02-22T22:28:47.650 DEBUG:teuthology.orchestra.run.trial144:> sudo yum clean all 2026-02-22T22:28:47.788 INFO:teuthology.orchestra.run.trial125.stdout:41 files removed 2026-02-22T22:28:47.803 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-radosgw 2026-02-22T22:28:47.807 INFO:teuthology.orchestra.run.trial144.stdout:41 files removed 2026-02-22T22:28:47.822 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-radosgw 2026-02-22T22:28:48.086 INFO:teuthology.orchestra.run.trial125.stdout:ceph packages for x86_64 603 kB/s | 86 kB 00:00 2026-02-22T22:28:48.093 INFO:teuthology.orchestra.run.trial144.stdout:ceph packages for x86_64 668 kB/s | 86 kB 00:00 2026-02-22T22:28:48.218 INFO:teuthology.orchestra.run.trial125.stdout:ceph noarch packages 111 kB/s | 12 kB 00:00 2026-02-22T22:28:48.227 INFO:teuthology.orchestra.run.trial144.stdout:ceph noarch packages 112 kB/s | 12 kB 00:00 2026-02-22T22:28:48.344 INFO:teuthology.orchestra.run.trial125.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-22T22:28:48.353 INFO:teuthology.orchestra.run.trial144.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-22T22:28:49.046 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-22T22:28:49.710 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-22T22:28:52.807 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-22T22:28:53.132 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-22T22:28:55.785 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - CRB 12 MB/s | 7.8 MB 00:00 2026-02-22T22:28:56.539 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 7.8 MB 00:00 2026-02-22T22:28:57.683 INFO:teuthology.orchestra.run.trial125.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 20 kB 00:01 2026-02-22T22:28:57.698 INFO:teuthology.orchestra.run.trial144.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 20 kB 00:00 2026-02-22T22:28:57.963 INFO:teuthology.orchestra.run.trial125.stdout:Extra Packages for Enterprise Linux 93 MB/s | 20 MB 00:00 2026-02-22T22:28:58.865 INFO:teuthology.orchestra.run.trial144.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-22T22:29:01.211 INFO:teuthology.orchestra.run.trial125.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-22T22:29:02.005 INFO:teuthology.orchestra.run.trial144.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-22T22:29:02.406 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: Package Arch Version Repository Size 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout:Upgrading: 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout:Installing dependencies: 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T22:29:02.407 INFO:teuthology.orchestra.run.trial125.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout:Installing weak dependencies: 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout:Install 33 Packages 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout:Upgrade 2 Packages 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 63 M 2026-02-22T22:29:02.408 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:03.196 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repository Size 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout:Upgrading: 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T22:29:03.197 INFO:teuthology.orchestra.run.trial144.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout:Installing dependencies: 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T22:29:03.198 INFO:teuthology.orchestra.run.trial144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T22:29:03.199 INFO:teuthology.orchestra.run.trial144.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout:Installing weak dependencies: 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:03.200 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:03.201 INFO:teuthology.orchestra.run.trial144.stdout:Install 33 Packages 2026-02-22T22:29:03.201 INFO:teuthology.orchestra.run.trial144.stdout:Upgrade 2 Packages 2026-02-22T22:29:03.201 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:03.201 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 63 M 2026-02-22T22:29:03.201 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:03.255 INFO:teuthology.orchestra.run.trial125.stdout:(1/35): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 12 MB/s | 5.5 MB 00:00 2026-02-22T22:29:03.303 INFO:teuthology.orchestra.run.trial125.stdout:(2/35): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 525 kB/s | 25 kB 00:00 2026-02-22T22:29:03.376 INFO:teuthology.orchestra.run.trial125.stdout:(3/35): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 13 MB/s | 999 kB 00:00 2026-02-22T22:29:03.418 INFO:teuthology.orchestra.run.trial125.stdout:(4/35): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 18 MB/s | 11 MB 00:00 2026-02-22T22:29:03.425 INFO:teuthology.orchestra.run.trial125.stdout:(5/35): libradosstriper1-19.2.3-689.gf90f4eae.e 10 MB/s | 503 kB 00:00 2026-02-22T22:29:03.481 INFO:teuthology.orchestra.run.trial125.stdout:(6/35): python3-ceph-argparse-19.2.3-689.gf90f4 805 kB/s | 45 kB 00:00 2026-02-22T22:29:03.541 INFO:teuthology.orchestra.run.trial125.stdout:(7/35): python3-ceph-common-19.2.3-689.gf90f4ea 2.3 MB/s | 142 kB 00:00 2026-02-22T22:29:03.604 INFO:teuthology.orchestra.run.trial125.stdout:(8/35): python3-cephfs-19.2.3-689.gf90f4eae.el9 2.6 MB/s | 165 kB 00:00 2026-02-22T22:29:03.650 INFO:teuthology.orchestra.run.trial125.stdout:(9/35): librgw2-19.2.3-689.gf90f4eae.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-22T22:29:03.654 INFO:teuthology.orchestra.run.trial125.stdout:(10/35): python3-rados-19.2.3-689.gf90f4eae.el9 6.3 MB/s | 322 kB 00:00 2026-02-22T22:29:03.692 INFO:teuthology.orchestra.run.trial125.stdout:(11/35): python3-rbd-19.2.3-689.gf90f4eae.el9.x 7.2 MB/s | 303 kB 00:00 2026-02-22T22:29:03.694 INFO:teuthology.orchestra.run.trial125.stdout:(12/35): python3-rgw-19.2.3-689.gf90f4eae.el9.x 2.5 MB/s | 100 kB 00:00 2026-02-22T22:29:03.766 INFO:teuthology.orchestra.run.trial125.stdout:(13/35): ceph-common-19.2.3-689.gf90f4eae.el9.x 23 MB/s | 22 MB 00:00 2026-02-22T22:29:03.778 INFO:teuthology.orchestra.run.trial125.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 382 kB/s | 33 kB 00:00 2026-02-22T22:29:03.889 INFO:teuthology.orchestra.run.trial125.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 761 kB/s | 93 kB 00:00 2026-02-22T22:29:03.907 INFO:teuthology.orchestra.run.trial125.stdout:(16/35): nvme-cli-2.16-1.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2026-02-22T22:29:04.428 INFO:teuthology.orchestra.run.trial125.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 160 kB/s | 104 kB 00:00 2026-02-22T22:29:04.529 INFO:teuthology.orchestra.run.trial125.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2026-02-22T22:29:04.692 INFO:teuthology.orchestra.run.trial125.stdout:(19/35): libnbd-1.20.3-4.el9.x86_64.rpm 204 kB/s | 164 kB 00:00 2026-02-22T22:29:04.816 INFO:teuthology.orchestra.run.trial125.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 176 kB/s | 160 kB 00:00 2026-02-22T22:29:05.335 INFO:teuthology.orchestra.run.trial125.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 822 kB/s | 662 kB 00:00 2026-02-22T22:29:05.434 INFO:teuthology.orchestra.run.trial125.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 374 kB/s | 37 kB 00:00 2026-02-22T22:29:05.489 INFO:teuthology.orchestra.run.trial125.stdout:(23/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 367 kB/s | 292 kB 00:00 2026-02-22T22:29:05.535 INFO:teuthology.orchestra.run.trial125.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 657 kB/s | 66 kB 00:00 2026-02-22T22:29:05.546 INFO:teuthology.orchestra.run.trial125.stdout:(25/35): qatlib-25.08.0-2.el9.x86_64.rpm 328 kB/s | 240 kB 00:00 2026-02-22T22:29:05.947 INFO:teuthology.orchestra.run.trial125.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 62 kB/s | 25 kB 00:00 2026-02-22T22:29:06.104 INFO:teuthology.orchestra.run.trial125.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 310 kB/s | 49 kB 00:00 2026-02-22T22:29:06.262 INFO:teuthology.orchestra.run.trial125.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 427 kB/s | 67 kB 00:00 2026-02-22T22:29:06.469 INFO:teuthology.orchestra.run.trial144.stdout:(1/35): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 2.4 MB/s | 5.5 MB 00:02 2026-02-22T22:29:06.521 INFO:teuthology.orchestra.run.trial144.stdout:(2/35): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 477 kB/s | 25 kB 00:00 2026-02-22T22:29:06.808 INFO:teuthology.orchestra.run.trial144.stdout:(3/35): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 3.4 MB/s | 999 kB 00:00 2026-02-22T22:29:06.894 INFO:teuthology.orchestra.run.trial125.stdout:(29/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 219 kB/s | 308 kB 00:01 2026-02-22T22:29:06.985 INFO:teuthology.orchestra.run.trial144.stdout:(4/35): libradosstriper1-19.2.3-689.gf90f4eae.e 2.8 MB/s | 503 kB 00:00 2026-02-22T22:29:07.282 INFO:teuthology.orchestra.run.trial125.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 822 kB/s | 838 kB 00:01 2026-02-22T22:29:07.340 INFO:teuthology.orchestra.run.trial144.stdout:(5/35): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 3.4 MB/s | 11 MB 00:03 2026-02-22T22:29:07.396 INFO:teuthology.orchestra.run.trial144.stdout:(6/35): python3-ceph-argparse-19.2.3-689.gf90f4 805 kB/s | 45 kB 00:00 2026-02-22T22:29:07.438 INFO:teuthology.orchestra.run.trial125.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 352 kB/s | 191 kB 00:00 2026-02-22T22:29:07.453 INFO:teuthology.orchestra.run.trial144.stdout:(7/35): python3-ceph-common-19.2.3-689.gf90f4ea 2.4 MB/s | 142 kB 00:00 2026-02-22T22:29:07.513 INFO:teuthology.orchestra.run.trial144.stdout:(8/35): python3-cephfs-19.2.3-689.gf90f4eae.el9 2.7 MB/s | 165 kB 00:00 2026-02-22T22:29:07.575 INFO:teuthology.orchestra.run.trial144.stdout:(9/35): python3-rados-19.2.3-689.gf90f4eae.el9. 5.0 MB/s | 322 kB 00:00 2026-02-22T22:29:07.638 INFO:teuthology.orchestra.run.trial144.stdout:(10/35): python3-rbd-19.2.3-689.gf90f4eae.el9.x 4.7 MB/s | 303 kB 00:00 2026-02-22T22:29:07.698 INFO:teuthology.orchestra.run.trial144.stdout:(11/35): python3-rgw-19.2.3-689.gf90f4eae.el9.x 1.6 MB/s | 100 kB 00:00 2026-02-22T22:29:07.735 INFO:teuthology.orchestra.run.trial144.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 902 kB/s | 33 kB 00:00 2026-02-22T22:29:07.794 INFO:teuthology.orchestra.run.trial144.stdout:(13/35): nvme-cli-2.16-1.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2026-02-22T22:29:07.805 INFO:teuthology.orchestra.run.trial144.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 8.4 MB/s | 93 kB 00:00 2026-02-22T22:29:07.924 INFO:teuthology.orchestra.run.trial125.stdout:(32/35): librados2-19.2.3-689.gf90f4eae.el9.x86 7.1 MB/s | 3.4 MB 00:00 2026-02-22T22:29:07.929 INFO:teuthology.orchestra.run.trial144.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 838 kB/s | 104 kB 00:00 2026-02-22T22:29:07.985 INFO:teuthology.orchestra.run.trial144.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 2.9 MB/s | 164 kB 00:00 2026-02-22T22:29:08.020 INFO:teuthology.orchestra.run.trial144.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.5 MB/s | 160 kB 00:00 2026-02-22T22:29:08.047 INFO:teuthology.orchestra.run.trial144.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-22T22:29:08.062 INFO:teuthology.orchestra.run.trial125.stdout:(33/35): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 23 MB/s | 3.2 MB 00:00 2026-02-22T22:29:08.116 INFO:teuthology.orchestra.run.trial144.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 9.4 MB/s | 662 kB 00:00 2026-02-22T22:29:08.147 INFO:teuthology.orchestra.run.trial144.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.2 MB/s | 292 kB 00:00 2026-02-22T22:29:08.176 INFO:teuthology.orchestra.run.trial144.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 8.1 MB/s | 240 kB 00:00 2026-02-22T22:29:08.184 INFO:teuthology.orchestra.run.trial144.stdout:(22/35): librgw2-19.2.3-689.gf90f4eae.el9.x86_6 4.5 MB/s | 5.4 MB 00:01 2026-02-22T22:29:08.201 INFO:teuthology.orchestra.run.trial144.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-22T22:29:08.292 INFO:teuthology.orchestra.run.trial144.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 612 kB/s | 66 kB 00:00 2026-02-22T22:29:08.671 INFO:teuthology.orchestra.run.trial144.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 655 kB/s | 308 kB 00:00 2026-02-22T22:29:08.743 INFO:teuthology.orchestra.run.trial144.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 344 kB/s | 25 kB 00:00 2026-02-22T22:29:08.819 INFO:teuthology.orchestra.run.trial144.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2026-02-22T22:29:08.897 INFO:teuthology.orchestra.run.trial144.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 859 kB/s | 67 kB 00:00 2026-02-22T22:29:09.005 INFO:teuthology.orchestra.run.trial144.stdout:(29/35): libarrow-9.0.0-15.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2026-02-22T22:29:09.075 INFO:teuthology.orchestra.run.trial144.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-22T22:29:09.095 INFO:teuthology.orchestra.run.trial144.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2026-02-22T22:29:09.159 INFO:teuthology.orchestra.run.trial144.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2026-02-22T22:29:09.165 INFO:teuthology.orchestra.run.trial125.stdout:(34/35): thrift-0.15.0-4.el9.x86_64.rpm 860 kB/s | 1.6 MB 00:01 2026-02-22T22:29:09.518 INFO:teuthology.orchestra.run.trial144.stdout:(33/35): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 8.8 MB/s | 3.2 MB 00:00 2026-02-22T22:29:09.640 INFO:teuthology.orchestra.run.trial144.stdout:(34/35): librados2-19.2.3-689.gf90f4eae.el9.x86 6.3 MB/s | 3.4 MB 00:00 2026-02-22T22:29:10.098 INFO:teuthology.orchestra.run.trial144.stdout:(35/35): ceph-common-19.2.3-689.gf90f4eae.el9.x 3.7 MB/s | 22 MB 00:05 2026-02-22T22:29:10.099 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:10.100 INFO:teuthology.orchestra.run.trial144.stdout:Total 9.1 MB/s | 63 MB 00:06 2026-02-22T22:29:10.188 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:10.208 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:10.208 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:10.463 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:10.463 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:10.755 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:10.760 INFO:teuthology.orchestra.run.trial125.stdout:(35/35): libarrow-9.0.0-15.el9.x86_64.rpm 865 kB/s | 4.4 MB 00:05 2026-02-22T22:29:10.764 INFO:teuthology.orchestra.run.trial144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-22T22:29:10.765 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:10.765 INFO:teuthology.orchestra.run.trial125.stdout:Total 7.5 MB/s | 63 MB 00:08 2026-02-22T22:29:10.767 INFO:teuthology.orchestra.run.trial144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-22T22:29:10.779 INFO:teuthology.orchestra.run.trial144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-22T22:29:10.866 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:10.885 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:10.885 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:10.929 INFO:teuthology.orchestra.run.trial144.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-22T22:29:10.933 INFO:teuthology.orchestra.run.trial144.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T22:29:10.961 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T22:29:11.003 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T22:29:11.004 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T22:29:11.016 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T22:29:11.020 INFO:teuthology.orchestra.run.trial144.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-22T22:29:11.029 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/37 2026-02-22T22:29:11.051 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T22:29:11.052 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T22:29:11.064 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T22:29:11.094 INFO:teuthology.orchestra.run.trial144.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-22T22:29:11.100 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-22T22:29:11.107 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-22T22:29:11.109 INFO:teuthology.orchestra.run.trial144.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-22T22:29:11.112 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-22T22:29:11.118 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-22T22:29:11.140 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:11.140 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:11.258 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T22:29:11.259 INFO:teuthology.orchestra.run.trial144.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T22:29:11.286 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T22:29:11.289 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/37 2026-02-22T22:29:11.296 INFO:teuthology.orchestra.run.trial144.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-22T22:29:11.432 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:11.441 INFO:teuthology.orchestra.run.trial125.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-22T22:29:11.444 INFO:teuthology.orchestra.run.trial125.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-22T22:29:11.455 INFO:teuthology.orchestra.run.trial125.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-22T22:29:11.522 INFO:teuthology.orchestra.run.trial144.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-22T22:29:11.523 INFO:teuthology.orchestra.run.trial144.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T22:29:11.539 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T22:29:11.545 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/37 2026-02-22T22:29:11.552 INFO:teuthology.orchestra.run.trial144.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-22T22:29:11.554 INFO:teuthology.orchestra.run.trial144.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-22T22:29:11.555 INFO:teuthology.orchestra.run.trial144.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T22:29:11.574 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T22:29:11.615 INFO:teuthology.orchestra.run.trial125.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-22T22:29:11.620 INFO:teuthology.orchestra.run.trial125.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T22:29:11.651 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T22:29:11.691 INFO:teuthology.orchestra.run.trial144.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-22T22:29:11.693 INFO:teuthology.orchestra.run.trial144.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T22:29:11.694 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T22:29:11.695 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T22:29:11.707 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T22:29:11.711 INFO:teuthology.orchestra.run.trial125.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-22T22:29:11.721 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/37 2026-02-22T22:29:11.743 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T22:29:11.744 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T22:29:11.757 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T22:29:11.790 INFO:teuthology.orchestra.run.trial125.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-22T22:29:11.794 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-22T22:29:11.802 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-22T22:29:11.804 INFO:teuthology.orchestra.run.trial125.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-22T22:29:11.807 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-22T22:29:11.813 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-22T22:29:11.963 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T22:29:11.964 INFO:teuthology.orchestra.run.trial125.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T22:29:11.991 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T22:29:11.991 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T22:29:11.991 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:11.992 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T22:29:11.996 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/37 2026-02-22T22:29:12.003 INFO:teuthology.orchestra.run.trial125.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-22T22:29:12.026 INFO:teuthology.orchestra.run.trial144.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-22T22:29:12.028 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 31/37 2026-02-22T22:29:12.241 INFO:teuthology.orchestra.run.trial125.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-22T22:29:12.242 INFO:teuthology.orchestra.run.trial125.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T22:29:12.259 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T22:29:12.265 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/37 2026-02-22T22:29:12.269 INFO:teuthology.orchestra.run.trial125.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-22T22:29:12.272 INFO:teuthology.orchestra.run.trial125.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-22T22:29:12.273 INFO:teuthology.orchestra.run.trial125.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T22:29:12.290 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T22:29:12.405 INFO:teuthology.orchestra.run.trial125.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-22T22:29:12.407 INFO:teuthology.orchestra.run.trial125.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T22:29:12.685 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T22:29:12.685 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T22:29:12.685 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:12.719 INFO:teuthology.orchestra.run.trial125.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-22T22:29:12.721 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 31/37 2026-02-22T22:29:13.002 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T22:29:13.004 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T22:29:13.284 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T22:29:13.287 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T22:29:13.326 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T22:29:13.327 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T22:29:13.327 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T22:29:13.327 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:13.329 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T22:29:13.753 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T22:29:13.756 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T22:29:14.048 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T22:29:14.051 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T22:29:14.090 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T22:29:14.090 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T22:29:14.090 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T22:29:14.091 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:14.094 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T22:29:17.831 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T22:29:17.831 INFO:teuthology.orchestra.run.trial144.stdout:skipping the directory /sys 2026-02-22T22:29:17.831 INFO:teuthology.orchestra.run.trial144.stdout:skipping the directory /proc 2026-02-22T22:29:17.831 INFO:teuthology.orchestra.run.trial144.stdout:skipping the directory /mnt 2026-02-22T22:29:17.831 INFO:teuthology.orchestra.run.trial144.stdout:skipping the directory /var/tmp 2026-02-22T22:29:17.831 INFO:teuthology.orchestra.run.trial144.stdout:skipping the directory /home 2026-02-22T22:29:17.832 INFO:teuthology.orchestra.run.trial144.stdout:skipping the directory /root 2026-02-22T22:29:17.832 INFO:teuthology.orchestra.run.trial144.stdout:skipping the directory /tmp 2026-02-22T22:29:17.832 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:18.280 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T22:29:18.303 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T22:29:18.303 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:18.303 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T22:29:18.304 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:29:18.304 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:29:18.304 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:18.304 INFO:teuthology.orchestra.run.trial144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T22:29:18.317 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T22:29:18.317 INFO:teuthology.orchestra.run.trial144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T22:29:18.370 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T22:29:18.371 INFO:teuthology.orchestra.run.trial144.stdout:Creating group 'qat' with GID 992. 2026-02-22T22:29:18.371 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:18.616 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T22:29:18.616 INFO:teuthology.orchestra.run.trial125.stdout:skipping the directory /sys 2026-02-22T22:29:18.616 INFO:teuthology.orchestra.run.trial125.stdout:skipping the directory /proc 2026-02-22T22:29:18.616 INFO:teuthology.orchestra.run.trial125.stdout:skipping the directory /mnt 2026-02-22T22:29:18.616 INFO:teuthology.orchestra.run.trial125.stdout:skipping the directory /var/tmp 2026-02-22T22:29:18.616 INFO:teuthology.orchestra.run.trial125.stdout:skipping the directory /home 2026-02-22T22:29:18.617 INFO:teuthology.orchestra.run.trial125.stdout:skipping the directory /root 2026-02-22T22:29:18.617 INFO:teuthology.orchestra.run.trial125.stdout:skipping the directory /tmp 2026-02-22T22:29:18.617 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T22:29:18.645 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-22T22:29:18.646 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 36/37 2026-02-22T22:29:18.710 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T22:29:18.710 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:18.710 INFO:teuthology.orchestra.run.trial144.stdout:Upgraded: 2026-02-22T22:29:18.710 INFO:teuthology.orchestra.run.trial144.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.710 INFO:teuthology.orchestra.run.trial144.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.710 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.711 INFO:teuthology.orchestra.run.trial144.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T22:29:18.712 INFO:teuthology.orchestra.run.trial144.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T22:29:18.713 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:18.714 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:18.750 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-test 2026-02-22T22:29:19.056 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:17 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:19.081 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T22:29:19.105 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T22:29:19.105 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:19.106 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T22:29:19.106 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:29:19.106 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:29:19.106 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:19.107 INFO:teuthology.orchestra.run.trial125.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T22:29:19.120 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T22:29:19.120 INFO:teuthology.orchestra.run.trial125.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T22:29:19.139 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:19.140 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:19.140 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repository Size 2026-02-22T22:29:19.140 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout:Installing dependencies: 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:19.141 INFO:teuthology.orchestra.run.trial144.stdout:Install 5 Packages 2026-02-22T22:29:19.142 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:19.142 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 50 M 2026-02-22T22:29:19.142 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 212 M 2026-02-22T22:29:19.142 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:19.174 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T22:29:19.174 INFO:teuthology.orchestra.run.trial125.stdout:Creating group 'qat' with GID 992. 2026-02-22T22:29:19.174 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:19.299 INFO:teuthology.orchestra.run.trial144.stdout:(1/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 1.6 MB/s | 163 kB 00:00 2026-02-22T22:29:19.464 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/37 2026-02-22T22:29:19.464 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/37 2026-02-22T22:29:19.464 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/37 2026-02-22T22:29:19.464 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-22T22:29:19.465 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-22T22:29:19.466 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 36/37 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout:Upgraded: 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.532 INFO:teuthology.orchestra.run.trial125.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.533 INFO:teuthology.orchestra.run.trial125.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:19.534 INFO:teuthology.orchestra.run.trial125.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T22:29:19.534 INFO:teuthology.orchestra.run.trial125.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T22:29:19.534 INFO:teuthology.orchestra.run.trial125.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T22:29:19.534 INFO:teuthology.orchestra.run.trial125.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T22:29:19.534 INFO:teuthology.orchestra.run.trial125.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T22:29:19.534 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:19.534 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:19.574 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-test 2026-02-22T22:29:19.885 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:18 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:19.951 INFO:teuthology.orchestra.run.trial144.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 311 kB/s | 233 kB 00:00 2026-02-22T22:29:19.969 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: Package Arch Version Repository Size 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout:Installing dependencies: 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout:Install 5 Packages 2026-02-22T22:29:19.970 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:19.971 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 50 M 2026-02-22T22:29:19.971 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 212 M 2026-02-22T22:29:19.971 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:20.049 INFO:teuthology.orchestra.run.trial144.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 646 kB/s | 64 kB 00:00 2026-02-22T22:29:20.090 INFO:teuthology.orchestra.run.trial125.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.7 MB/s | 233 kB 00:00 2026-02-22T22:29:20.106 INFO:teuthology.orchestra.run.trial144.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 376 kB/s | 303 kB 00:00 2026-02-22T22:29:20.110 INFO:teuthology.orchestra.run.trial125.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 15 MB/s | 303 kB 00:00 2026-02-22T22:29:20.122 INFO:teuthology.orchestra.run.trial125.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 5.5 MB/s | 64 kB 00:00 2026-02-22T22:29:20.207 INFO:teuthology.orchestra.run.trial125.stdout:(4/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 912 kB/s | 163 kB 00:00 2026-02-22T22:29:20.222 INFO:teuthology.orchestra.run.trial144.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-22T22:29:20.224 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:20.224 INFO:teuthology.orchestra.run.trial144.stdout:Total 46 MB/s | 50 MB 00:01 2026-02-22T22:29:20.250 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:20.260 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:20.260 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:20.447 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:20.447 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:20.661 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:20.666 INFO:teuthology.orchestra.run.trial144.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-22T22:29:20.671 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-22T22:29:20.679 INFO:teuthology.orchestra.run.trial144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-22T22:29:20.679 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T22:29:21.146 INFO:teuthology.orchestra.run.trial125.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 44 MB/s | 50 MB 00:01 2026-02-22T22:29:21.147 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:21.147 INFO:teuthology.orchestra.run.trial125.stdout:Total 43 MB/s | 50 MB 00:01 2026-02-22T22:29:21.175 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:21.184 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:21.184 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:21.370 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:21.370 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:21.582 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:21.588 INFO:teuthology.orchestra.run.trial125.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-22T22:29:21.592 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-22T22:29:21.600 INFO:teuthology.orchestra.run.trial125.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-22T22:29:21.601 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T22:29:22.939 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T22:29:22.957 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T22:29:23.170 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T22:29:23.170 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-22T22:29:23.170 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-22T22:29:23.170 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-22T22:29:23.170 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-22T22:29:23.223 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-22T22:29:23.223 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:23.223 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:23.224 INFO:teuthology.orchestra.run.trial144.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:23.224 INFO:teuthology.orchestra.run.trial144.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:23.224 INFO:teuthology.orchestra.run.trial144.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T22:29:23.224 INFO:teuthology.orchestra.run.trial144.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T22:29:23.224 INFO:teuthology.orchestra.run.trial144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T22:29:23.224 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:23.224 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:23.256 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph 2026-02-22T22:29:23.565 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:21 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:23.650 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout:====================================================================================== 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repository Size 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout:====================================================================================== 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout:Installing dependencies: 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T22:29:23.653 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T22:29:23.654 INFO:teuthology.orchestra.run.trial144.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T22:29:23.655 INFO:teuthology.orchestra.run.trial144.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T22:29:23.656 INFO:teuthology.orchestra.run.trial144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T22:29:23.657 INFO:teuthology.orchestra.run.trial144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T22:29:23.658 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T22:29:23.659 INFO:teuthology.orchestra.run.trial144.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout:Installing weak dependencies: 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T22:29:23.660 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout:====================================================================================== 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout:Install 99 Packages 2026-02-22T22:29:23.661 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:23.662 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 95 M 2026-02-22T22:29:23.662 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 520 M 2026-02-22T22:29:23.662 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:23.846 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T22:29:23.864 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T22:29:24.090 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T22:29:24.090 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-22T22:29:24.090 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-22T22:29:24.090 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-22T22:29:24.090 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T22:29:24.146 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:24.147 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:24.178 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph 2026-02-22T22:29:24.203 INFO:teuthology.orchestra.run.trial144.stdout:(1/99): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 127 kB/s | 6.5 kB 00:00 2026-02-22T22:29:24.296 INFO:teuthology.orchestra.run.trial144.stdout:(2/99): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 7.5 MB/s | 1.1 MB 00:00 2026-02-22T22:29:24.324 INFO:teuthology.orchestra.run.trial144.stdout:(3/99): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-22T22:29:24.358 INFO:teuthology.orchestra.run.trial144.stdout:(4/99): ceph-grafana-dashboards-19.2.3-689.gf90 935 kB/s | 31 kB 00:00 2026-02-22T22:29:24.396 INFO:teuthology.orchestra.run.trial144.stdout:(5/99): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 3.8 MB/s | 150 kB 00:00 2026-02-22T22:29:24.430 INFO:teuthology.orchestra.run.trial144.stdout:(6/99): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 21 MB/s | 4.7 MB 00:00 2026-02-22T22:29:24.483 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:23 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:24.570 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:24.573 INFO:teuthology.orchestra.run.trial125.stdout:====================================================================================== 2026-02-22T22:29:24.573 INFO:teuthology.orchestra.run.trial125.stdout: Package Arch Version Repository Size 2026-02-22T22:29:24.573 INFO:teuthology.orchestra.run.trial125.stdout:====================================================================================== 2026-02-22T22:29:24.573 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:24.574 INFO:teuthology.orchestra.run.trial125.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T22:29:24.574 INFO:teuthology.orchestra.run.trial125.stdout:Installing dependencies: 2026-02-22T22:29:24.574 INFO:teuthology.orchestra.run.trial125.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T22:29:24.574 INFO:teuthology.orchestra.run.trial125.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T22:29:24.574 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T22:29:24.575 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T22:29:24.575 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T22:29:24.575 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T22:29:24.575 INFO:teuthology.orchestra.run.trial125.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T22:29:24.575 INFO:teuthology.orchestra.run.trial125.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T22:29:24.576 INFO:teuthology.orchestra.run.trial125.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T22:29:24.576 INFO:teuthology.orchestra.run.trial125.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T22:29:24.576 INFO:teuthology.orchestra.run.trial125.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T22:29:24.576 INFO:teuthology.orchestra.run.trial125.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T22:29:24.576 INFO:teuthology.orchestra.run.trial125.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T22:29:24.577 INFO:teuthology.orchestra.run.trial125.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T22:29:24.577 INFO:teuthology.orchestra.run.trial125.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T22:29:24.577 INFO:teuthology.orchestra.run.trial125.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T22:29:24.577 INFO:teuthology.orchestra.run.trial125.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T22:29:24.577 INFO:teuthology.orchestra.run.trial125.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T22:29:24.577 INFO:teuthology.orchestra.run.trial125.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T22:29:24.578 INFO:teuthology.orchestra.run.trial125.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T22:29:24.578 INFO:teuthology.orchestra.run.trial125.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T22:29:24.578 INFO:teuthology.orchestra.run.trial125.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T22:29:24.578 INFO:teuthology.orchestra.run.trial125.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T22:29:24.578 INFO:teuthology.orchestra.run.trial125.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T22:29:24.578 INFO:teuthology.orchestra.run.trial125.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T22:29:24.579 INFO:teuthology.orchestra.run.trial125.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T22:29:24.579 INFO:teuthology.orchestra.run.trial125.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T22:29:24.579 INFO:teuthology.orchestra.run.trial125.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T22:29:24.579 INFO:teuthology.orchestra.run.trial125.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T22:29:24.579 INFO:teuthology.orchestra.run.trial125.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T22:29:24.579 INFO:teuthology.orchestra.run.trial125.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T22:29:24.579 INFO:teuthology.orchestra.run.trial125.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T22:29:24.580 INFO:teuthology.orchestra.run.trial125.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T22:29:24.580 INFO:teuthology.orchestra.run.trial125.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T22:29:24.580 INFO:teuthology.orchestra.run.trial125.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T22:29:24.580 INFO:teuthology.orchestra.run.trial125.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T22:29:24.580 INFO:teuthology.orchestra.run.trial125.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T22:29:24.580 INFO:teuthology.orchestra.run.trial125.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T22:29:24.581 INFO:teuthology.orchestra.run.trial125.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T22:29:24.581 INFO:teuthology.orchestra.run.trial125.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T22:29:24.581 INFO:teuthology.orchestra.run.trial125.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T22:29:24.581 INFO:teuthology.orchestra.run.trial125.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T22:29:24.581 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T22:29:24.581 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T22:29:24.581 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T22:29:24.582 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T22:29:24.582 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T22:29:24.582 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T22:29:24.582 INFO:teuthology.orchestra.run.trial125.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T22:29:24.582 INFO:teuthology.orchestra.run.trial125.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T22:29:24.582 INFO:teuthology.orchestra.run.trial125.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T22:29:24.583 INFO:teuthology.orchestra.run.trial125.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T22:29:24.583 INFO:teuthology.orchestra.run.trial125.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T22:29:24.583 INFO:teuthology.orchestra.run.trial125.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T22:29:24.583 INFO:teuthology.orchestra.run.trial125.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T22:29:24.583 INFO:teuthology.orchestra.run.trial125.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T22:29:24.583 INFO:teuthology.orchestra.run.trial125.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T22:29:24.583 INFO:teuthology.orchestra.run.trial125.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T22:29:24.584 INFO:teuthology.orchestra.run.trial125.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T22:29:24.584 INFO:teuthology.orchestra.run.trial125.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T22:29:24.584 INFO:teuthology.orchestra.run.trial125.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T22:29:24.584 INFO:teuthology.orchestra.run.trial125.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T22:29:24.584 INFO:teuthology.orchestra.run.trial125.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T22:29:24.584 INFO:teuthology.orchestra.run.trial125.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T22:29:24.584 INFO:teuthology.orchestra.run.trial125.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T22:29:24.585 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T22:29:24.585 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T22:29:24.585 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T22:29:24.585 INFO:teuthology.orchestra.run.trial125.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T22:29:24.585 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T22:29:24.585 INFO:teuthology.orchestra.run.trial125.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T22:29:24.585 INFO:teuthology.orchestra.run.trial125.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T22:29:24.586 INFO:teuthology.orchestra.run.trial125.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T22:29:24.587 INFO:teuthology.orchestra.run.trial125.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T22:29:24.587 INFO:teuthology.orchestra.run.trial125.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T22:29:24.587 INFO:teuthology.orchestra.run.trial125.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T22:29:24.587 INFO:teuthology.orchestra.run.trial125.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T22:29:24.587 INFO:teuthology.orchestra.run.trial125.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T22:29:24.587 INFO:teuthology.orchestra.run.trial125.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T22:29:24.587 INFO:teuthology.orchestra.run.trial125.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout:Installing weak dependencies: 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T22:29:24.588 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T22:29:24.589 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T22:29:24.589 INFO:teuthology.orchestra.run.trial125.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T22:29:24.589 INFO:teuthology.orchestra.run.trial125.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T22:29:24.589 INFO:teuthology.orchestra.run.trial125.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T22:29:24.589 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:24.589 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:24.589 INFO:teuthology.orchestra.run.trial125.stdout:====================================================================================== 2026-02-22T22:29:24.590 INFO:teuthology.orchestra.run.trial125.stdout:Install 99 Packages 2026-02-22T22:29:24.590 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:24.590 INFO:teuthology.orchestra.run.trial144.stdout:(7/99): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 21 MB/s | 3.8 MB 00:00 2026-02-22T22:29:24.591 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 95 M 2026-02-22T22:29:24.591 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 520 M 2026-02-22T22:29:24.591 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:24.619 INFO:teuthology.orchestra.run.trial144.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 516 kB/s | 22 kB 00:00 2026-02-22T22:29:24.669 INFO:teuthology.orchestra.run.trial144.stdout:(9/99): ceph-mgr-modules-core-19.2.3-689.gf90f4 5.0 MB/s | 253 kB 00:00 2026-02-22T22:29:24.716 INFO:teuthology.orchestra.run.trial144.stdout:(10/99): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 1.0 MB/s | 49 kB 00:00 2026-02-22T22:29:24.758 INFO:teuthology.orchestra.run.trial144.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 23 MB/s | 7.4 MB 00:00 2026-02-22T22:29:24.761 INFO:teuthology.orchestra.run.trial144.stdout:(12/99): ceph-prometheus-alerts-19.2.3-689.gf90 374 kB/s | 17 kB 00:00 2026-02-22T22:29:24.789 INFO:teuthology.orchestra.run.trial144.stdout:(13/99): ceph-volume-19.2.3-689.gf90f4eae.el9.n 9.4 MB/s | 299 kB 00:00 2026-02-22T22:29:24.806 INFO:teuthology.orchestra.run.trial144.stdout:(14/99): cephadm-19.2.3-689.gf90f4eae.el9.noarc 17 MB/s | 769 kB 00:00 2026-02-22T22:29:24.907 INFO:teuthology.orchestra.run.trial144.stdout:(15/99): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-22T22:29:25.150 INFO:teuthology.orchestra.run.trial125.stdout:(1/99): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 128 kB/s | 6.5 kB 00:00 2026-02-22T22:29:25.241 INFO:teuthology.orchestra.run.trial125.stdout:(2/99): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 7.6 MB/s | 1.1 MB 00:00 2026-02-22T22:29:25.267 INFO:teuthology.orchestra.run.trial125.stdout:(3/99): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-22T22:29:25.301 INFO:teuthology.orchestra.run.trial125.stdout:(4/99): ceph-grafana-dashboards-19.2.3-689.gf90 929 kB/s | 31 kB 00:00 2026-02-22T22:29:25.340 INFO:teuthology.orchestra.run.trial125.stdout:(5/99): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 3.8 MB/s | 150 kB 00:00 2026-02-22T22:29:25.376 INFO:teuthology.orchestra.run.trial125.stdout:(6/99): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 21 MB/s | 4.7 MB 00:00 2026-02-22T22:29:25.378 INFO:teuthology.orchestra.run.trial144.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 71 kB/s | 40 kB 00:00 2026-02-22T22:29:25.522 INFO:teuthology.orchestra.run.trial125.stdout:(7/99): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 21 MB/s | 3.8 MB 00:00 2026-02-22T22:29:25.535 INFO:teuthology.orchestra.run.trial144.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 115 kB/s | 72 kB 00:00 2026-02-22T22:29:25.565 INFO:teuthology.orchestra.run.trial125.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 508 kB/s | 22 kB 00:00 2026-02-22T22:29:25.605 INFO:teuthology.orchestra.run.trial144.stdout:(18/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 430 kB/s | 351 kB 00:00 2026-02-22T22:29:25.616 INFO:teuthology.orchestra.run.trial125.stdout:(9/99): ceph-mgr-modules-core-19.2.3-689.gf90f4 4.9 MB/s | 253 kB 00:00 2026-02-22T22:29:25.664 INFO:teuthology.orchestra.run.trial125.stdout:(10/99): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 1.0 MB/s | 49 kB 00:00 2026-02-22T22:29:25.701 INFO:teuthology.orchestra.run.trial125.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 23 MB/s | 7.4 MB 00:00 2026-02-22T22:29:25.702 INFO:teuthology.orchestra.run.trial125.stdout:(12/99): ceph-prometheus-alerts-19.2.3-689.gf90 441 kB/s | 17 kB 00:00 2026-02-22T22:29:25.732 INFO:teuthology.orchestra.run.trial125.stdout:(13/99): ceph-volume-19.2.3-689.gf90f4eae.el9.n 9.5 MB/s | 299 kB 00:00 2026-02-22T22:29:25.748 INFO:teuthology.orchestra.run.trial125.stdout:(14/99): cephadm-19.2.3-689.gf90f4eae.el9.noarc 16 MB/s | 769 kB 00:00 2026-02-22T22:29:25.811 INFO:teuthology.orchestra.run.trial125.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 639 kB/s | 40 kB 00:00 2026-02-22T22:29:25.854 INFO:teuthology.orchestra.run.trial125.stdout:(16/99): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-22T22:29:25.855 INFO:teuthology.orchestra.run.trial125.stdout:(17/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.8 MB/s | 351 kB 00:00 2026-02-22T22:29:25.855 INFO:teuthology.orchestra.run.trial125.stdout:(18/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.6 MB/s | 72 kB 00:00 2026-02-22T22:29:25.878 INFO:teuthology.orchestra.run.trial125.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 7.6 MB/s | 184 kB 00:00 2026-02-22T22:29:25.921 INFO:teuthology.orchestra.run.trial125.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.8 MB/s | 253 kB 00:00 2026-02-22T22:29:25.943 INFO:teuthology.orchestra.run.trial125.stdout:(21/99): python3-cryptography-36.0.1-5.el9.x86_ 19 MB/s | 1.2 MB 00:00 2026-02-22T22:29:25.945 INFO:teuthology.orchestra.run.trial125.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-22T22:29:25.967 INFO:teuthology.orchestra.run.trial125.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 5.5 MB/s | 135 kB 00:00 2026-02-22T22:29:25.970 INFO:teuthology.orchestra.run.trial125.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 5.9 MB/s | 150 kB 00:00 2026-02-22T22:29:25.981 INFO:teuthology.orchestra.run.trial125.stdout:(25/99): libgfortran-11.5.0-14.el9.x86_64.rpm 6.1 MB/s | 794 kB 00:00 2026-02-22T22:29:25.991 INFO:teuthology.orchestra.run.trial125.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 5.2 MB/s | 126 kB 00:00 2026-02-22T22:29:25.994 INFO:teuthology.orchestra.run.trial125.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 8.6 MB/s | 218 kB 00:00 2026-02-22T22:29:26.004 INFO:teuthology.orchestra.run.trial125.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-22T22:29:26.014 INFO:teuthology.orchestra.run.trial125.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-22T22:29:26.266 INFO:teuthology.orchestra.run.trial144.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 253 kB/s | 184 kB 00:00 2026-02-22T22:29:26.271 INFO:teuthology.orchestra.run.trial144.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 890 kB/s | 794 kB 00:00 2026-02-22T22:29:26.374 INFO:teuthology.orchestra.run.trial144.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 329 kB/s | 253 kB 00:00 2026-02-22T22:29:26.553 INFO:teuthology.orchestra.run.trial125.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2026-02-22T22:29:26.568 INFO:teuthology.orchestra.run.trial125.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 27 kB/s | 15 kB 00:00 2026-02-22T22:29:26.946 INFO:teuthology.orchestra.run.trial144.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2026-02-22T22:29:26.961 INFO:teuthology.orchestra.run.trial125.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 480 kB/s | 188 kB 00:00 2026-02-22T22:29:27.026 INFO:teuthology.orchestra.run.trial125.stdout:(33/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 521 kB/s | 246 kB 00:00 2026-02-22T22:29:27.079 INFO:teuthology.orchestra.run.trial144.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 192 kB/s | 135 kB 00:00 2026-02-22T22:29:27.121 INFO:teuthology.orchestra.run.trial125.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 264 kB/s | 42 kB 00:00 2026-02-22T22:29:27.212 INFO:teuthology.orchestra.run.trial144.stdout:(24/99): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-22T22:29:27.657 INFO:teuthology.orchestra.run.trial144.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 212 kB/s | 150 kB 00:00 2026-02-22T22:29:27.772 INFO:teuthology.orchestra.run.trial144.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 182 kB/s | 126 kB 00:00 2026-02-22T22:29:27.895 INFO:teuthology.orchestra.run.trial125.stdout:(35/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 6.1 MB/s | 5.3 MB 00:00 2026-02-22T22:29:27.969 INFO:teuthology.orchestra.run.trial144.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 288 kB/s | 218 kB 00:00 2026-02-22T22:29:28.061 INFO:teuthology.orchestra.run.trial144.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 320 kB/s | 30 kB 00:00 2026-02-22T22:29:28.144 INFO:teuthology.orchestra.run.trial125.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2026-02-22T22:29:28.250 INFO:teuthology.orchestra.run.trial144.stdout:(29/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-22T22:29:28.275 INFO:teuthology.orchestra.run.trial144.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 586 kB/s | 15 kB 00:00 2026-02-22T22:29:28.302 INFO:teuthology.orchestra.run.trial144.stdout:(31/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 8.9 MB/s | 246 kB 00:00 2026-02-22T22:29:28.305 INFO:teuthology.orchestra.run.trial125.stdout:(37/99): python3-devel-3.9.25-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-22T22:29:28.347 INFO:teuthology.orchestra.run.trial144.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 4.1 MB/s | 188 kB 00:00 2026-02-22T22:29:28.373 INFO:teuthology.orchestra.run.trial144.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-22T22:29:28.384 INFO:teuthology.orchestra.run.trial144.stdout:(34/99): unzip-6.0-59.el9.x86_64.rpm 250 kB/s | 182 kB 00:00 2026-02-22T22:29:28.438 INFO:teuthology.orchestra.run.trial144.stdout:(35/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 81 MB/s | 5.3 MB 00:00 2026-02-22T22:29:28.457 INFO:teuthology.orchestra.run.trial125.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2026-02-22T22:29:28.465 INFO:teuthology.orchestra.run.trial125.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-22T22:29:28.507 INFO:teuthology.orchestra.run.trial144.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 86 MB/s | 6.0 MB 00:00 2026-02-22T22:29:28.525 INFO:teuthology.orchestra.run.trial125.stdout:(40/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 1.2 MB/s | 3.0 MB 00:02 2026-02-22T22:29:28.536 INFO:teuthology.orchestra.run.trial144.stdout:(37/99): python3-devel-3.9.25-3.el9.x86_64.rpm 8.4 MB/s | 244 kB 00:00 2026-02-22T22:29:28.549 INFO:teuthology.orchestra.run.trial144.stdout:(38/99): zip-3.0-35.el9.x86_64.rpm 342 kB/s | 266 kB 00:00 2026-02-22T22:29:28.564 INFO:teuthology.orchestra.run.trial144.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.7 MB/s | 249 kB 00:00 2026-02-22T22:29:28.588 INFO:teuthology.orchestra.run.trial144.stdout:(40/99): protobuf-3.14.0-17.el9.x86_64.rpm 4.9 MB/s | 1.0 MB 00:00 2026-02-22T22:29:28.594 INFO:teuthology.orchestra.run.trial144.stdout:(41/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 40 MB/s | 1.2 MB 00:00 2026-02-22T22:29:28.617 INFO:teuthology.orchestra.run.trial144.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.0 MB/s | 172 kB 00:00 2026-02-22T22:29:28.618 INFO:teuthology.orchestra.run.trial125.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 1.1 MB/s | 177 kB 00:00 2026-02-22T22:29:28.620 INFO:teuthology.orchestra.run.trial144.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-22T22:29:28.649 INFO:teuthology.orchestra.run.trial144.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-22T22:29:28.675 INFO:teuthology.orchestra.run.trial144.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-22T22:29:28.684 INFO:teuthology.orchestra.run.trial125.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2026-02-22T22:29:28.694 INFO:teuthology.orchestra.run.trial144.stdout:(46/99): python3-libstoragemgmt-1.10.1-1.el9.x8 1.2 MB/s | 177 kB 00:00 2026-02-22T22:29:28.702 INFO:teuthology.orchestra.run.trial144.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 9.7 MB/s | 267 kB 00:00 2026-02-22T22:29:28.705 INFO:teuthology.orchestra.run.trial125.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 5.1 MB/s | 1.2 MB 00:00 2026-02-22T22:29:28.721 INFO:teuthology.orchestra.run.trial144.stdout:(48/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 59 MB/s | 6.1 MB 00:00 2026-02-22T22:29:28.732 INFO:teuthology.orchestra.run.trial144.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 9.2 MB/s | 279 kB 00:00 2026-02-22T22:29:28.734 INFO:teuthology.orchestra.run.trial144.stdout:(50/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 159 kB 00:00 2026-02-22T22:29:28.747 INFO:teuthology.orchestra.run.trial144.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 2.0 MB/s | 54 kB 00:00 2026-02-22T22:29:28.761 INFO:teuthology.orchestra.run.trial144.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-22T22:29:28.774 INFO:teuthology.orchestra.run.trial144.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.0 MB/s | 189 kB 00:00 2026-02-22T22:29:28.778 INFO:teuthology.orchestra.run.trial125.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 217 kB/s | 35 kB 00:00 2026-02-22T22:29:28.793 INFO:teuthology.orchestra.run.trial144.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 2.8 MB/s | 90 kB 00:00 2026-02-22T22:29:28.867 INFO:teuthology.orchestra.run.trial125.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.7 MB/s | 442 kB 00:00 2026-02-22T22:29:28.913 INFO:teuthology.orchestra.run.trial144.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 106 MB/s | 19 MB 00:00 2026-02-22T22:29:28.936 INFO:teuthology.orchestra.run.trial125.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 488 kB/s | 77 kB 00:00 2026-02-22T22:29:29.028 INFO:teuthology.orchestra.run.trial125.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 1.6 MB/s | 267 kB 00:00 2026-02-22T22:29:29.095 INFO:teuthology.orchestra.run.trial125.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 997 kB/s | 159 kB 00:00 2026-02-22T22:29:29.173 INFO:teuthology.orchestra.run.trial125.stdout:(49/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 13 MB/s | 6.1 MB 00:00 2026-02-22T22:29:29.188 INFO:teuthology.orchestra.run.trial125.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 1.7 MB/s | 279 kB 00:00 2026-02-22T22:29:29.254 INFO:teuthology.orchestra.run.trial125.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 337 kB/s | 54 kB 00:00 2026-02-22T22:29:29.331 INFO:teuthology.orchestra.run.trial144.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-22T22:29:29.347 INFO:teuthology.orchestra.run.trial125.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 263 kB/s | 42 kB 00:00 2026-02-22T22:29:29.387 INFO:teuthology.orchestra.run.trial144.stdout:(57/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-22T22:29:29.416 INFO:teuthology.orchestra.run.trial125.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.1 MB/s | 189 kB 00:00 2026-02-22T22:29:29.461 INFO:teuthology.orchestra.run.trial144.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2026-02-22T22:29:29.489 INFO:teuthology.orchestra.run.trial125.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 302 kB/s | 22 kB 00:00 2026-02-22T22:29:29.507 INFO:teuthology.orchestra.run.trial125.stdout:(55/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 565 kB/s | 90 kB 00:00 2026-02-22T22:29:29.515 INFO:teuthology.orchestra.run.trial144.stdout:(59/99): grpc-data-1.46.7-10.el9.noarch.rpm 105 kB/s | 19 kB 00:00 2026-02-22T22:29:29.566 INFO:teuthology.orchestra.run.trial144.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 5.1 MB/s | 548 kB 00:00 2026-02-22T22:29:29.599 INFO:teuthology.orchestra.run.trial125.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 7.7 MB/s | 862 kB 00:00 2026-02-22T22:29:29.614 INFO:teuthology.orchestra.run.trial144.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 299 kB/s | 29 kB 00:00 2026-02-22T22:29:29.631 INFO:teuthology.orchestra.run.trial144.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 919 kB/s | 60 kB 00:00 2026-02-22T22:29:29.679 INFO:teuthology.orchestra.run.trial125.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 242 kB/s | 19 kB 00:00 2026-02-22T22:29:29.694 INFO:teuthology.orchestra.run.trial144.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 508 kB/s | 32 kB 00:00 2026-02-22T22:29:29.713 INFO:teuthology.orchestra.run.trial125.stdout:(58/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.6 MB/s | 551 kB 00:00 2026-02-22T22:29:29.720 INFO:teuthology.orchestra.run.trial144.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 412 kB/s | 43 kB 00:00 2026-02-22T22:29:29.757 INFO:teuthology.orchestra.run.trial144.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 226 kB/s | 14 kB 00:00 2026-02-22T22:29:29.842 INFO:teuthology.orchestra.run.trial144.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.1 MB/s | 358 kB 00:00 2026-02-22T22:29:29.908 INFO:teuthology.orchestra.run.trial144.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 920 kB/s | 173 kB 00:00 2026-02-22T22:29:29.920 INFO:teuthology.orchestra.run.trial144.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 3.2 MB/s | 254 kB 00:00 2026-02-22T22:29:29.992 INFO:teuthology.orchestra.run.trial144.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.0 MB/s | 144 kB 00:00 2026-02-22T22:29:30.062 INFO:teuthology.orchestra.run.trial144.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.9 MB/s | 139 kB 00:00 2026-02-22T22:29:30.129 INFO:teuthology.orchestra.run.trial144.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 845 kB/s | 56 kB 00:00 2026-02-22T22:29:30.191 INFO:teuthology.orchestra.run.trial144.stdout:(72/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 172 kB/s | 11 kB 00:00 2026-02-22T22:29:30.202 INFO:teuthology.orchestra.run.trial144.stdout:(73/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.9 MB/s | 2.0 MB 00:00 2026-02-22T22:29:30.253 INFO:teuthology.orchestra.run.trial144.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 284 kB/s | 18 kB 00:00 2026-02-22T22:29:30.264 INFO:teuthology.orchestra.run.trial144.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 372 kB/s | 23 kB 00:00 2026-02-22T22:29:30.316 INFO:teuthology.orchestra.run.trial144.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 315 kB/s | 20 kB 00:00 2026-02-22T22:29:30.326 INFO:teuthology.orchestra.run.trial144.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 312 kB/s | 19 kB 00:00 2026-02-22T22:29:30.368 INFO:teuthology.orchestra.run.trial144.stdout:(78/99): protobuf-compiler-3.14.0-17.el9.x86_64 547 kB/s | 862 kB 00:01 2026-02-22T22:29:30.380 INFO:teuthology.orchestra.run.trial144.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 412 kB/s | 26 kB 00:00 2026-02-22T22:29:30.409 INFO:teuthology.orchestra.run.trial144.stdout:(80/99): python3-kubernetes-26.1.0-3.el9.noarch 12 MB/s | 1.0 MB 00:00 2026-02-22T22:29:30.447 INFO:teuthology.orchestra.run.trial144.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2026-02-22T22:29:30.473 INFO:teuthology.orchestra.run.trial144.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2026-02-22T22:29:30.474 INFO:teuthology.orchestra.run.trial125.stdout:(59/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 15 MB/s | 19 MB 00:01 2026-02-22T22:29:30.512 INFO:teuthology.orchestra.run.trial144.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 885 kB/s | 58 kB 00:00 2026-02-22T22:29:30.539 INFO:teuthology.orchestra.run.trial144.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2026-02-22T22:29:30.574 INFO:teuthology.orchestra.run.trial144.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 263 kB/s | 16 kB 00:00 2026-02-22T22:29:30.590 INFO:teuthology.orchestra.run.trial125.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 253 kB/s | 29 kB 00:00 2026-02-22T22:29:30.603 INFO:teuthology.orchestra.run.trial144.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.4 MB/s | 90 kB 00:00 2026-02-22T22:29:30.613 INFO:teuthology.orchestra.run.trial144.stdout:(87/99): python3-logutils-0.3.5-21.el9.noarch.r 189 kB/s | 46 kB 00:00 2026-02-22T22:29:30.638 INFO:teuthology.orchestra.run.trial144.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 487 kB/s | 31 kB 00:00 2026-02-22T22:29:30.668 INFO:teuthology.orchestra.run.trial144.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2026-02-22T22:29:30.708 INFO:teuthology.orchestra.run.trial144.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.7 MB/s | 125 kB 00:00 2026-02-22T22:29:30.715 INFO:teuthology.orchestra.run.trial144.stdout:(91/99): python3-rsa-4.9-2.el9.noarch.rpm 580 kB/s | 59 kB 00:00 2026-02-22T22:29:30.731 INFO:teuthology.orchestra.run.trial144.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 571 kB/s | 36 kB 00:00 2026-02-22T22:29:30.775 INFO:teuthology.orchestra.run.trial144.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 1.3 MB/s | 86 kB 00:00 2026-02-22T22:29:30.795 INFO:teuthology.orchestra.run.trial144.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-22T22:29:30.859 INFO:teuthology.orchestra.run.trial144.stdout:(95/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 761 kB/s | 48 kB 00:00 2026-02-22T22:29:30.864 INFO:teuthology.orchestra.run.trial144.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.7 MB/s | 427 kB 00:00 2026-02-22T22:29:30.899 INFO:teuthology.orchestra.run.trial144.stdout:(97/99): python3-webob-1.8.8-2.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2026-02-22T22:29:30.924 INFO:teuthology.orchestra.run.trial144.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 341 kB/s | 22 kB 00:00 2026-02-22T22:29:30.928 INFO:teuthology.orchestra.run.trial144.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 314 kB/s | 20 kB 00:00 2026-02-22T22:29:30.931 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:30.931 INFO:teuthology.orchestra.run.trial144.stdout:Total 13 MB/s | 95 MB 00:07 2026-02-22T22:29:31.359 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:31.398 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:31.398 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:31.813 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:31.813 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:32.277 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:32.279 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-22T22:29:32.310 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-22T22:29:32.315 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-22T22:29:32.337 INFO:teuthology.orchestra.run.trial144.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-22T22:29:32.343 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-22T22:29:32.377 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-22T22:29:32.386 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-22T22:29:32.391 INFO:teuthology.orchestra.run.trial144.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-22T22:29:32.394 INFO:teuthology.orchestra.run.trial144.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-22T22:29:32.398 INFO:teuthology.orchestra.run.trial144.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-22T22:29:32.421 INFO:teuthology.orchestra.run.trial144.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-22T22:29:32.434 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-22T22:29:32.437 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-22T22:29:32.445 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-22T22:29:32.447 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-22T22:29:32.458 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-22T22:29:32.464 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-22T22:29:32.488 INFO:teuthology.orchestra.run.trial144.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-22T22:29:32.491 INFO:teuthology.orchestra.run.trial144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-22T22:29:32.498 INFO:teuthology.orchestra.run.trial144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-22T22:29:32.523 INFO:teuthology.orchestra.run.trial144.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-22T22:29:32.573 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-22T22:29:32.586 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-22T22:29:32.588 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-22T22:29:32.593 INFO:teuthology.orchestra.run.trial144.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-22T22:29:32.598 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-22T22:29:32.603 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-22T22:29:32.606 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-22T22:29:32.620 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-22T22:29:32.641 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-22T22:29:32.646 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-22T22:29:32.651 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-22T22:29:32.662 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-22T22:29:32.671 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-22T22:29:32.677 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-22T22:29:32.697 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-22T22:29:32.706 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-22T22:29:32.760 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-22T22:29:32.772 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-22T22:29:32.788 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-22T22:29:32.792 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-22T22:29:32.800 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-22T22:29:32.840 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-22T22:29:33.164 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-22T22:29:33.174 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-22T22:29:33.177 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-22T22:29:33.183 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-22T22:29:33.185 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-22T22:29:33.213 INFO:teuthology.orchestra.run.trial144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-22T22:29:33.257 INFO:teuthology.orchestra.run.trial144.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-22T22:29:33.264 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-22T22:29:33.267 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-22T22:29:33.273 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-22T22:29:33.277 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-22T22:29:33.284 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-22T22:29:33.287 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-22T22:29:33.315 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-22T22:29:33.325 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-22T22:29:33.359 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-22T22:29:33.582 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-22T22:29:33.606 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-22T22:29:33.610 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-22T22:29:33.668 INFO:teuthology.orchestra.run.trial144.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-22T22:29:33.670 INFO:teuthology.orchestra.run.trial144.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-22T22:29:33.691 INFO:teuthology.orchestra.run.trial144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-22T22:29:34.015 INFO:teuthology.orchestra.run.trial144.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-22T22:29:34.088 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-22T22:29:34.757 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-22T22:29:34.774 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-22T22:29:34.784 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-22T22:29:34.791 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-22T22:29:34.804 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-22T22:29:34.819 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-22T22:29:34.895 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-22T22:29:34.904 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-22T22:29:34.927 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-22T22:29:34.957 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-22T22:29:35.007 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-22T22:29:35.013 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-22T22:29:35.017 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-22T22:29:35.018 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-22T22:29:35.036 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T22:29:35.036 INFO:teuthology.orchestra.run.trial144.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T22:29:35.037 INFO:teuthology.orchestra.run.trial144.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T22:29:35.037 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:35.044 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T22:29:35.069 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T22:29:35.069 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T22:29:35.069 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:35.103 INFO:teuthology.orchestra.run.trial144.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-22T22:29:35.166 INFO:teuthology.orchestra.run.trial144.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-22T22:29:35.169 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T22:29:35.182 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T22:29:35.182 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:35.182 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T22:29:35.182 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:35.904 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T22:29:35.927 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T22:29:35.928 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:35.928 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T22:29:35.928 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T22:29:35.928 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T22:29:35.928 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:35.986 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T22:29:35.988 INFO:teuthology.orchestra.run.trial144.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T22:29:35.992 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 88/99 2026-02-22T22:29:36.012 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 89/99 2026-02-22T22:29:36.013 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T22:29:36.508 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T22:29:36.511 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T22:29:36.980 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T22:29:36.981 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T22:29:36.994 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T22:29:36.995 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T22:29:37.051 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T22:29:37.100 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 94/99 2026-02-22T22:29:37.101 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T22:29:37.123 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T22:29:37.123 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:37.123 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T22:29:37.123 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T22:29:37.124 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T22:29:37.124 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:37.135 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T22:29:37.359 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T22:29:37.360 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T22:29:37.382 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T22:29:37.383 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:37.383 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T22:29:37.383 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T22:29:37.383 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T22:29:37.383 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:37.486 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T22:29:37.506 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T22:29:37.506 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:37.507 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T22:29:37.507 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T22:29:37.507 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T22:29:37.507 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:37.525 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T22:29:38.206 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/99 2026-02-22T22:29:38.207 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-22T22:29:38.208 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-22T22:29:38.209 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-22T22:29:38.210 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-22T22:29:38.211 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-22T22:29:38.212 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-22T22:29:38.213 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-22T22:29:38.214 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-22T22:29:38.270 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-22T22:29:38.270 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:38.270 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:38.270 INFO:teuthology.orchestra.run.trial144.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T22:29:38.270 INFO:teuthology.orchestra.run.trial144.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:38.270 INFO:teuthology.orchestra.run.trial144.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.271 INFO:teuthology.orchestra.run.trial144.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T22:29:38.272 INFO:teuthology.orchestra.run.trial144.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T22:29:38.273 INFO:teuthology.orchestra.run.trial144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T22:29:38.274 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T22:29:38.275 INFO:teuthology.orchestra.run.trial144.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T22:29:38.276 INFO:teuthology.orchestra.run.trial144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T22:29:38.277 INFO:teuthology.orchestra.run.trial144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: zip-3.0-35.el9.x86_64 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:38.278 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:38.326 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-base 2026-02-22T22:29:38.638 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:36 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:38.702 INFO:teuthology.orchestra.run.trial144.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:38.720 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:38.721 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:38.721 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:38.742 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install cephadm 2026-02-22T22:29:39.045 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:39.110 INFO:teuthology.orchestra.run.trial144.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:39.128 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:39.129 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:39.129 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:39.149 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-immutable-object-cache 2026-02-22T22:29:39.456 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:39.540 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:39.540 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:39.540 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repo Size 2026-02-22T22:29:39.540 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:39.540 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout:Install 1 Package 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 145 k 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 431 k 2026-02-22T22:29:39.541 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:39.671 INFO:teuthology.orchestra.run.trial144.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.1 MB/s | 145 kB 00:00 2026-02-22T22:29:39.671 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:39.671 INFO:teuthology.orchestra.run.trial144.stdout:Total 1.1 MB/s | 145 kB 00:00 2026-02-22T22:29:39.671 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:39.675 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:39.675 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:39.707 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:39.707 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:39.762 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:39.763 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T22:29:39.786 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T22:29:39.786 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:39.786 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T22:29:39.787 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:39.897 INFO:teuthology.orchestra.run.trial125.stdout:(61/99): python3-asyncssh-2.13.2-5.el9.noarch.r 54 kB/s | 548 kB 00:10 2026-02-22T22:29:39.912 INFO:teuthology.orchestra.run.trial125.stdout:(62/99): luarocks-3.9.2-5.el9.noarch.rpm 15 kB/s | 151 kB 00:10 2026-02-22T22:29:39.945 INFO:teuthology.orchestra.run.trial125.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 981 kB/s | 32 kB 00:00 2026-02-22T22:29:39.952 INFO:teuthology.orchestra.run.trial125.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 811 kB/s | 43 kB 00:00 2026-02-22T22:29:39.988 INFO:teuthology.orchestra.run.trial125.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 330 kB/s | 14 kB 00:00 2026-02-22T22:29:40.019 INFO:teuthology.orchestra.run.trial125.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.6 MB/s | 173 kB 00:00 2026-02-22T22:29:40.101 INFO:teuthology.orchestra.run.trial125.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 3.0 MB/s | 254 kB 00:00 2026-02-22T22:29:40.105 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T22:29:40.105 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:40.105 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:40.105 INFO:teuthology.orchestra.run.trial144.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:40.105 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:40.105 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:40.116 INFO:teuthology.orchestra.run.trial125.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 2.7 MB/s | 358 kB 00:00 2026-02-22T22:29:40.131 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-mgr 2026-02-22T22:29:40.178 INFO:teuthology.orchestra.run.trial125.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.3 MB/s | 144 kB 00:00 2026-02-22T22:29:40.240 INFO:teuthology.orchestra.run.trial125.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 2.2 MB/s | 139 kB 00:00 2026-02-22T22:29:40.300 INFO:teuthology.orchestra.run.trial125.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 947 kB/s | 56 kB 00:00 2026-02-22T22:29:40.315 INFO:teuthology.orchestra.run.trial125.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.5 MB/s | 2.0 MB 00:00 2026-02-22T22:29:40.333 INFO:teuthology.orchestra.run.trial125.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 320 kB/s | 11 kB 00:00 2026-02-22T22:29:40.359 INFO:teuthology.orchestra.run.trial125.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 401 kB/s | 18 kB 00:00 2026-02-22T22:29:40.378 INFO:teuthology.orchestra.run.trial125.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 510 kB/s | 23 kB 00:00 2026-02-22T22:29:40.413 INFO:teuthology.orchestra.run.trial125.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 365 kB/s | 20 kB 00:00 2026-02-22T22:29:40.438 INFO:teuthology.orchestra.run.trial125.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 327 kB/s | 19 kB 00:00 2026-02-22T22:29:40.442 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:40.460 INFO:teuthology.orchestra.run.trial125.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 557 kB/s | 26 kB 00:00 2026-02-22T22:29:40.497 INFO:teuthology.orchestra.run.trial125.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 1.2 MB/s | 46 kB 00:00 2026-02-22T22:29:40.507 INFO:teuthology.orchestra.run.trial144.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:40.525 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:40.526 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:40.526 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:40.540 INFO:teuthology.orchestra.run.trial125.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2026-02-22T22:29:40.547 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-mgr-dashboard 2026-02-22T22:29:40.582 INFO:teuthology.orchestra.run.trial125.stdout:(81/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2026-02-22T22:29:40.620 INFO:teuthology.orchestra.run.trial125.stdout:(82/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.5 MB/s | 58 kB 00:00 2026-02-22T22:29:40.644 INFO:teuthology.orchestra.run.trial125.stdout:(83/99): python3-kubernetes-26.1.0-3.el9.noarch 5.0 MB/s | 1.0 MB 00:00 2026-02-22T22:29:40.682 INFO:teuthology.orchestra.run.trial125.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 4.3 MB/s | 272 kB 00:00 2026-02-22T22:29:40.698 INFO:teuthology.orchestra.run.trial125.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 306 kB/s | 16 kB 00:00 2026-02-22T22:29:40.724 INFO:teuthology.orchestra.run.trial125.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2026-02-22T22:29:40.740 INFO:teuthology.orchestra.run.trial125.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 739 kB/s | 31 kB 00:00 2026-02-22T22:29:40.763 INFO:teuthology.orchestra.run.trial125.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 4.7 MB/s | 188 kB 00:00 2026-02-22T22:29:40.769 INFO:teuthology.orchestra.run.trial125.stdout:(89/99): python3-backports-tarfile-1.2.0-1.el9. 5.9 kB/s | 60 kB 00:10 2026-02-22T22:29:40.791 INFO:teuthology.orchestra.run.trial125.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2026-02-22T22:29:40.807 INFO:teuthology.orchestra.run.trial125.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 935 kB/s | 36 kB 00:00 2026-02-22T22:29:40.837 INFO:teuthology.orchestra.run.trial125.stdout:(92/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.7 MB/s | 125 kB 00:00 2026-02-22T22:29:40.840 INFO:teuthology.orchestra.run.trial125.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 1.7 MB/s | 86 kB 00:00 2026-02-22T22:29:40.857 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:40.902 INFO:teuthology.orchestra.run.trial125.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2026-02-22T22:29:40.911 INFO:teuthology.orchestra.run.trial125.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2026-02-22T22:29:40.922 INFO:teuthology.orchestra.run.trial144.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:40.941 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:40.941 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:40.941 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:40.953 INFO:teuthology.orchestra.run.trial125.stdout:(96/99): python3-xmltodict-0.12.0-15.el9.noarch 528 kB/s | 22 kB 00:00 2026-02-22T22:29:40.961 INFO:teuthology.orchestra.run.trial125.stdout:(97/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.5 MB/s | 427 kB 00:00 2026-02-22T22:29:40.964 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-22T22:29:40.968 INFO:teuthology.orchestra.run.trial125.stdout:(98/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 735 kB/s | 48 kB 00:00 2026-02-22T22:29:41.004 INFO:teuthology.orchestra.run.trial125.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2026-02-22T22:29:41.004 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:41.005 INFO:teuthology.orchestra.run.trial125.stdout:Total 5.8 MB/s | 95 MB 00:16 2026-02-22T22:29:41.274 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:41.339 INFO:teuthology.orchestra.run.trial144.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:41.357 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:41.358 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:41.358 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:41.379 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-mgr-rook 2026-02-22T22:29:41.429 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:41.468 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:41.468 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:41.693 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:41.758 INFO:teuthology.orchestra.run.trial144.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:41.776 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:41.777 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:41.777 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:41.798 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-mgr-cephadm 2026-02-22T22:29:41.889 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:41.889 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:42.107 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:40 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:42.172 INFO:teuthology.orchestra.run.trial144.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:42.190 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:42.191 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:42.191 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:42.213 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-fuse 2026-02-22T22:29:42.355 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:42.357 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-22T22:29:42.389 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-22T22:29:42.394 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-22T22:29:42.415 INFO:teuthology.orchestra.run.trial125.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-22T22:29:42.421 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-22T22:29:42.457 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-22T22:29:42.466 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-22T22:29:42.471 INFO:teuthology.orchestra.run.trial125.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-22T22:29:42.473 INFO:teuthology.orchestra.run.trial125.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-22T22:29:42.478 INFO:teuthology.orchestra.run.trial125.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-22T22:29:42.501 INFO:teuthology.orchestra.run.trial125.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-22T22:29:42.514 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-22T22:29:42.517 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-22T22:29:42.520 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:40 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:42.523 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-22T22:29:42.527 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-22T22:29:42.538 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-22T22:29:42.544 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-22T22:29:42.569 INFO:teuthology.orchestra.run.trial125.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-22T22:29:42.572 INFO:teuthology.orchestra.run.trial125.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-22T22:29:42.579 INFO:teuthology.orchestra.run.trial125.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-22T22:29:42.603 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout: Package Architecture Version Repository Size 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:42.604 INFO:teuthology.orchestra.run.trial144.stdout:Install 1 Package 2026-02-22T22:29:42.605 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:42.605 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 1.2 M 2026-02-22T22:29:42.605 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 3.6 M 2026-02-22T22:29:42.605 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:42.605 INFO:teuthology.orchestra.run.trial125.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-22T22:29:42.656 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-22T22:29:42.669 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-22T22:29:42.673 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-22T22:29:42.678 INFO:teuthology.orchestra.run.trial125.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-22T22:29:42.683 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-22T22:29:42.688 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-22T22:29:42.691 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-22T22:29:42.706 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-22T22:29:42.727 INFO:teuthology.orchestra.run.trial144.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 9.4 MB/s | 1.2 MB 00:00 2026-02-22T22:29:42.727 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-22T22:29:42.728 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:42.728 INFO:teuthology.orchestra.run.trial144.stdout:Total 9.3 MB/s | 1.2 MB 00:00 2026-02-22T22:29:42.728 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:42.731 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:42.731 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:42.732 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-22T22:29:42.737 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-22T22:29:42.748 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-22T22:29:42.757 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-22T22:29:42.763 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-22T22:29:42.767 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:42.768 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:42.783 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-22T22:29:42.792 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-22T22:29:42.848 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-22T22:29:42.860 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-22T22:29:42.870 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:42.876 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-22T22:29:42.880 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-22T22:29:42.887 INFO:teuthology.orchestra.run.trial144.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:42.888 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-22T22:29:42.929 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-22T22:29:43.133 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:43.191 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:43.192 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:43.192 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:43.192 INFO:teuthology.orchestra.run.trial144.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:43.192 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:43.192 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:43.220 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install ceph-volume 2026-02-22T22:29:43.257 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-22T22:29:43.268 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-22T22:29:43.272 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-22T22:29:43.278 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-22T22:29:43.279 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-22T22:29:43.307 INFO:teuthology.orchestra.run.trial125.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-22T22:29:43.352 INFO:teuthology.orchestra.run.trial125.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-22T22:29:43.359 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-22T22:29:43.362 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-22T22:29:43.368 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-22T22:29:43.371 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-22T22:29:43.378 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-22T22:29:43.382 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-22T22:29:43.410 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-22T22:29:43.420 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-22T22:29:43.455 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-22T22:29:43.537 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:41 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:43.602 INFO:teuthology.orchestra.run.trial144.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:43.620 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:43.621 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:43.621 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:43.643 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install librados-devel 2026-02-22T22:29:43.680 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-22T22:29:43.704 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-22T22:29:43.708 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-22T22:29:43.767 INFO:teuthology.orchestra.run.trial125.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-22T22:29:43.769 INFO:teuthology.orchestra.run.trial125.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-22T22:29:43.790 INFO:teuthology.orchestra.run.trial125.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-22T22:29:43.948 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:41 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:44.031 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:44.032 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:44.032 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repo Size 2026-02-22T22:29:44.032 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:44.032 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:44.032 INFO:teuthology.orchestra.run.trial144.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T22:29:44.032 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:44.033 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:44.033 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:44.033 INFO:teuthology.orchestra.run.trial144.stdout:Install 1 Package 2026-02-22T22:29:44.033 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:44.033 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 126 k 2026-02-22T22:29:44.033 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 456 k 2026-02-22T22:29:44.033 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:44.117 INFO:teuthology.orchestra.run.trial125.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-22T22:29:44.120 INFO:teuthology.orchestra.run.trial144.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-22T22:29:44.121 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:44.121 INFO:teuthology.orchestra.run.trial144.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-22T22:29:44.121 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:44.124 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:44.124 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:44.157 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:44.157 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:44.191 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-22T22:29:44.212 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:44.229 INFO:teuthology.orchestra.run.trial144.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:44.310 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:44.368 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:44.368 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:44.368 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:44.368 INFO:teuthology.orchestra.run.trial144.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:44.368 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:44.368 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:44.397 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install libcephfs2 2026-02-22T22:29:44.710 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:42 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:44.775 INFO:teuthology.orchestra.run.trial144.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:44.793 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:44.794 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:44.794 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:44.816 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install libcephfs-devel 2026-02-22T22:29:44.870 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-22T22:29:44.887 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-22T22:29:44.898 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-22T22:29:44.904 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-22T22:29:44.918 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-22T22:29:44.934 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-22T22:29:45.010 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-22T22:29:45.019 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-22T22:29:45.043 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-22T22:29:45.073 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-22T22:29:45.124 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-22T22:29:45.128 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:43 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:45.130 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-22T22:29:45.136 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-22T22:29:45.137 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-22T22:29:45.156 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T22:29:45.156 INFO:teuthology.orchestra.run.trial125.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T22:29:45.156 INFO:teuthology.orchestra.run.trial125.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T22:29:45.156 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:45.165 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T22:29:45.191 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T22:29:45.191 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T22:29:45.191 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:45.210 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:45.211 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:45.211 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repo Size 2026-02-22T22:29:45.211 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout:Install 1 Package 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 34 k 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 153 k 2026-02-22T22:29:45.212 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:45.226 INFO:teuthology.orchestra.run.trial125.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-22T22:29:45.276 INFO:teuthology.orchestra.run.trial144.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 516 kB/s | 34 kB 00:00 2026-02-22T22:29:45.277 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:45.277 INFO:teuthology.orchestra.run.trial144.stdout:Total 510 kB/s | 34 kB 00:00 2026-02-22T22:29:45.277 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:45.279 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:45.279 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:45.282 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:45.282 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:45.291 INFO:teuthology.orchestra.run.trial125.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-22T22:29:45.294 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T22:29:45.302 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:45.308 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T22:29:45.308 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:45.308 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T22:29:45.308 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:45.318 INFO:teuthology.orchestra.run.trial144.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:45.374 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:45.431 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:45.432 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:45.432 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:45.432 INFO:teuthology.orchestra.run.trial144.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:45.432 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:45.432 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:45.457 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install librados2 2026-02-22T22:29:45.766 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:43 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:45.831 INFO:teuthology.orchestra.run.trial144.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:45.850 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:45.850 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:45.850 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:45.871 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install librbd1 2026-02-22T22:29:46.004 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T22:29:46.029 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T22:29:46.029 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:46.029 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T22:29:46.029 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T22:29:46.029 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T22:29:46.029 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:46.086 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T22:29:46.088 INFO:teuthology.orchestra.run.trial125.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T22:29:46.093 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 88/99 2026-02-22T22:29:46.113 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 89/99 2026-02-22T22:29:46.114 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T22:29:46.179 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:44 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:46.243 INFO:teuthology.orchestra.run.trial144.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:46.262 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:46.262 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:46.262 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:46.284 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install python3-rados 2026-02-22T22:29:46.593 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:44 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:46.603 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T22:29:46.607 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T22:29:46.660 INFO:teuthology.orchestra.run.trial144.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:46.678 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:46.679 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:46.679 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:46.701 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install python3-rgw 2026-02-22T22:29:47.006 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:45 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:47.057 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T22:29:47.058 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T22:29:47.069 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T22:29:47.070 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T22:29:47.071 INFO:teuthology.orchestra.run.trial144.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:47.090 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:47.090 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:47.091 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:47.113 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install python3-cephfs 2026-02-22T22:29:47.127 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T22:29:47.176 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 94/99 2026-02-22T22:29:47.177 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T22:29:47.199 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T22:29:47.199 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:47.199 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T22:29:47.199 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T22:29:47.199 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T22:29:47.199 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:47.211 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T22:29:47.424 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T22:29:47.425 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:45 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:47.426 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T22:29:47.448 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T22:29:47.449 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:47.449 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T22:29:47.449 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T22:29:47.449 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T22:29:47.449 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:47.489 INFO:teuthology.orchestra.run.trial144.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:47.507 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:47.508 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:47.508 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:47.530 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install python3-rbd 2026-02-22T22:29:47.550 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T22:29:47.571 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T22:29:47.571 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:47.571 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T22:29:47.571 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T22:29:47.571 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T22:29:47.571 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:47.589 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T22:29:47.841 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:45 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:47.906 INFO:teuthology.orchestra.run.trial144.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:47.925 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:47.926 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:29:47.926 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:47.948 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install rbd-fuse 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-22T22:29:48.244 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-22T22:29:48.245 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-22T22:29:48.246 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-22T22:29:48.260 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:46 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:48.312 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.313 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T22:29:48.314 INFO:teuthology.orchestra.run.trial125.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T22:29:48.315 INFO:teuthology.orchestra.run.trial125.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T22:29:48.316 INFO:teuthology.orchestra.run.trial125.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T22:29:48.317 INFO:teuthology.orchestra.run.trial125.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T22:29:48.318 INFO:teuthology.orchestra.run.trial125.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T22:29:48.319 INFO:teuthology.orchestra.run.trial125.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T22:29:48.320 INFO:teuthology.orchestra.run.trial125.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T22:29:48.321 INFO:teuthology.orchestra.run.trial125.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T22:29:48.321 INFO:teuthology.orchestra.run.trial125.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T22:29:48.321 INFO:teuthology.orchestra.run.trial125.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T22:29:48.321 INFO:teuthology.orchestra.run.trial125.stdout: zip-3.0-35.el9.x86_64 2026-02-22T22:29:48.321 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:48.321 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:48.342 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:48.342 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:48.342 INFO:teuthology.orchestra.run.trial144.stdout: Package Architecture Version Repository Size 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:Install 1 Package 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 85 k 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 227 k 2026-02-22T22:29:48.343 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:48.368 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-base 2026-02-22T22:29:48.420 INFO:teuthology.orchestra.run.trial144.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-22T22:29:48.420 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:48.420 INFO:teuthology.orchestra.run.trial144.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-22T22:29:48.420 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:48.423 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:48.423 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:48.453 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:48.453 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:48.505 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:48.522 INFO:teuthology.orchestra.run.trial144.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:48.607 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:48.666 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:48.666 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:48.667 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:48.667 INFO:teuthology.orchestra.run.trial144.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:48.667 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:48.667 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:48.678 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:47 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:48.694 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install rbd-mirror 2026-02-22T22:29:48.743 INFO:teuthology.orchestra.run.trial125.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:48.761 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:48.762 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:48.762 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:48.783 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install cephadm 2026-02-22T22:29:49.006 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:47 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:49.090 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:49.090 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:48 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repo Size 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:Install 1 Package 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 3.1 M 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 13 M 2026-02-22T22:29:49.091 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:49.155 INFO:teuthology.orchestra.run.trial125.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:49.173 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:49.174 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:49.174 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:49.197 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-immutable-object-cache 2026-02-22T22:29:49.244 INFO:teuthology.orchestra.run.trial144.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 20 MB/s | 3.1 MB 00:00 2026-02-22T22:29:49.244 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:49.244 INFO:teuthology.orchestra.run.trial144.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-22T22:29:49.244 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:49.248 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:49.248 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:49.288 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:49.288 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:49.480 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:49.481 INFO:teuthology.orchestra.run.trial144.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:49.505 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:49.505 INFO:teuthology.orchestra.run.trial144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:49.505 INFO:teuthology.orchestra.run.trial144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T22:29:49.505 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T22:29:49.505 INFO:teuthology.orchestra.run.trial144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T22:29:49.505 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:49.506 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:48 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:49.591 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:49.591 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:49.591 INFO:teuthology.orchestra.run.trial125.stdout: Package Arch Version Repo Size 2026-02-22T22:29:49.591 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:49.591 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout:Install 1 Package 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 145 k 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 431 k 2026-02-22T22:29:49.592 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:49.678 INFO:teuthology.orchestra.run.trial125.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.6 MB/s | 145 kB 00:00 2026-02-22T22:29:49.679 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:49.679 INFO:teuthology.orchestra.run.trial125.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-22T22:29:49.679 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:49.683 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:49.683 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:49.715 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:49.715 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:49.770 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:49.772 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T22:29:49.795 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T22:29:49.795 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:49.795 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T22:29:49.795 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:49.825 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:49.825 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:49.825 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:49.825 INFO:teuthology.orchestra.run.trial144.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:49.826 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:49.826 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:49.853 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install rbd-nbd 2026-02-22T22:29:50.114 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T22:29:50.115 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:50.115 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:50.115 INFO:teuthology.orchestra.run.trial125.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:50.115 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:50.115 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:50.142 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-mgr 2026-02-22T22:29:50.173 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:00:48 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:29:50.257 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout: Package Architecture Version Repository Size 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:Installing: 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:Install 1 Package 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:Total download size: 170 k 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:Installed size: 490 k 2026-02-22T22:29:50.258 INFO:teuthology.orchestra.run.trial144.stdout:Downloading Packages: 2026-02-22T22:29:50.353 INFO:teuthology.orchestra.run.trial144.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 1.7 MB/s | 170 kB 00:00 2026-02-22T22:29:50.354 INFO:teuthology.orchestra.run.trial144.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:50.354 INFO:teuthology.orchestra.run.trial144.stdout:Total 1.7 MB/s | 170 kB 00:00 2026-02-22T22:29:50.354 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:29:50.358 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:29:50.358 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:29:50.388 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:29:50.389 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:29:50.445 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:29:50.456 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:49 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:50.462 INFO:teuthology.orchestra.run.trial144.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:50.520 INFO:teuthology.orchestra.run.trial125.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:50.538 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:50.539 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:50.539 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:50.544 INFO:teuthology.orchestra.run.trial144.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:50.561 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-mgr-dashboard 2026-02-22T22:29:50.603 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:50.604 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:50.604 INFO:teuthology.orchestra.run.trial144.stdout:Installed: 2026-02-22T22:29:50.604 INFO:teuthology.orchestra.run.trial144.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:50.604 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:29:50.604 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:29:50.634 DEBUG:teuthology.parallel:result is None 2026-02-22T22:29:50.875 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:49 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:50.940 INFO:teuthology.orchestra.run.trial125.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:50.959 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:50.959 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:50.959 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:50.980 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-22T22:29:51.285 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:50 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:51.351 INFO:teuthology.orchestra.run.trial125.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:51.370 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:51.370 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:51.371 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:51.391 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-mgr-rook 2026-02-22T22:29:51.699 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:50 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:51.765 INFO:teuthology.orchestra.run.trial125.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:51.783 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:51.784 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:51.784 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:51.805 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-mgr-cephadm 2026-02-22T22:29:52.116 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:51 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:52.182 INFO:teuthology.orchestra.run.trial125.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:52.200 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:52.201 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:52.201 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:52.222 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-fuse 2026-02-22T22:29:52.532 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:51 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:52.616 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:52.616 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:52.616 INFO:teuthology.orchestra.run.trial125.stdout: Package Architecture Version Repository Size 2026-02-22T22:29:52.616 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout:Install 1 Package 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 1.2 M 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 3.6 M 2026-02-22T22:29:52.617 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:52.738 INFO:teuthology.orchestra.run.trial125.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 9.5 MB/s | 1.2 MB 00:00 2026-02-22T22:29:52.738 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:52.738 INFO:teuthology.orchestra.run.trial125.stdout:Total 9.4 MB/s | 1.2 MB 00:00 2026-02-22T22:29:52.738 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:52.742 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:52.742 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:52.779 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:52.779 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:52.883 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:52.900 INFO:teuthology.orchestra.run.trial125.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:53.143 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:53.203 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:53.203 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:53.203 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:53.203 INFO:teuthology.orchestra.run.trial125.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:53.204 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:53.204 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:53.232 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install ceph-volume 2026-02-22T22:29:53.549 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:52 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:53.615 INFO:teuthology.orchestra.run.trial125.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T22:29:53.634 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:53.634 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:53.635 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:53.656 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install librados-devel 2026-02-22T22:29:53.965 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:52 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:54.050 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:54.050 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:54.050 INFO:teuthology.orchestra.run.trial125.stdout: Package Arch Version Repo Size 2026-02-22T22:29:54.050 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:54.050 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:54.050 INFO:teuthology.orchestra.run.trial125.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T22:29:54.050 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:54.051 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:54.051 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:54.051 INFO:teuthology.orchestra.run.trial125.stdout:Install 1 Package 2026-02-22T22:29:54.051 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:54.051 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 126 k 2026-02-22T22:29:54.051 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 456 k 2026-02-22T22:29:54.051 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:54.139 INFO:teuthology.orchestra.run.trial125.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-22T22:29:54.139 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:54.139 INFO:teuthology.orchestra.run.trial125.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-22T22:29:54.139 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:54.141 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:54.142 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:54.174 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:54.174 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:54.229 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:54.245 INFO:teuthology.orchestra.run.trial125.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:54.335 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:54.394 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:54.394 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:54.394 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:54.395 INFO:teuthology.orchestra.run.trial125.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:54.395 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:54.395 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:54.422 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install libcephfs2 2026-02-22T22:29:54.733 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:53 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:54.798 INFO:teuthology.orchestra.run.trial125.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:54.816 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:54.817 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:54.817 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:54.839 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install libcephfs-devel 2026-02-22T22:29:55.146 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:54 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout: Package Arch Version Repo Size 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:55.232 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:55.233 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:55.233 INFO:teuthology.orchestra.run.trial125.stdout:Install 1 Package 2026-02-22T22:29:55.233 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:55.233 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 34 k 2026-02-22T22:29:55.233 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 153 k 2026-02-22T22:29:55.233 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:55.297 INFO:teuthology.orchestra.run.trial125.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 515 kB/s | 34 kB 00:00 2026-02-22T22:29:55.298 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:55.298 INFO:teuthology.orchestra.run.trial125.stdout:Total 506 kB/s | 34 kB 00:00 2026-02-22T22:29:55.298 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:55.300 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:55.300 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:55.303 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:55.303 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:55.325 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:55.341 INFO:teuthology.orchestra.run.trial125.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:55.397 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:55.454 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:55.455 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:55.455 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:55.455 INFO:teuthology.orchestra.run.trial125.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:55.455 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:55.455 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:55.483 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install librados2 2026-02-22T22:29:55.792 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:54 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:55.859 INFO:teuthology.orchestra.run.trial125.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:55.878 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:55.879 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:55.879 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:55.900 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install librbd1 2026-02-22T22:29:56.210 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:55 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:56.276 INFO:teuthology.orchestra.run.trial125.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:56.294 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:56.295 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:56.295 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:56.316 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install python3-rados 2026-02-22T22:29:56.624 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:55 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:56.688 INFO:teuthology.orchestra.run.trial125.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:56.707 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:56.707 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:56.707 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:56.729 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install python3-rgw 2026-02-22T22:29:57.039 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:56 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:57.106 INFO:teuthology.orchestra.run.trial125.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:57.124 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:57.125 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:57.125 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:57.146 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install python3-cephfs 2026-02-22T22:29:57.459 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:56 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:57.525 INFO:teuthology.orchestra.run.trial125.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:57.543 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:57.544 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:57.544 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:57.565 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install python3-rbd 2026-02-22T22:29:57.878 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:56 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:57.944 INFO:teuthology.orchestra.run.trial125.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T22:29:57.962 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:57.963 INFO:teuthology.orchestra.run.trial125.stdout:Nothing to do. 2026-02-22T22:29:57.963 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:57.984 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install rbd-fuse 2026-02-22T22:29:58.297 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:57 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:58.381 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:58.381 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:58.381 INFO:teuthology.orchestra.run.trial125.stdout: Package Architecture Version Repository Size 2026-02-22T22:29:58.381 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:58.381 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout:Install 1 Package 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 85 k 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 227 k 2026-02-22T22:29:58.382 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:58.457 INFO:teuthology.orchestra.run.trial125.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-22T22:29:58.457 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:58.458 INFO:teuthology.orchestra.run.trial125.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-22T22:29:58.458 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:58.461 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:58.461 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:58.491 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:58.491 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:58.543 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:58.559 INFO:teuthology.orchestra.run.trial125.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:58.639 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:58.697 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:58.698 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:58.698 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:58.698 INFO:teuthology.orchestra.run.trial125.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:58.698 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:58.698 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:58.728 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install rbd-mirror 2026-02-22T22:29:59.044 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:58 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:29:59.130 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:29:59.130 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:59.130 INFO:teuthology.orchestra.run.trial125.stdout: Package Arch Version Repo Size 2026-02-22T22:29:59.130 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:59.130 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:29:59.130 INFO:teuthology.orchestra.run.trial125.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout:Install 1 Package 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 3.1 M 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 13 M 2026-02-22T22:29:59.131 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:29:59.281 INFO:teuthology.orchestra.run.trial125.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-22T22:29:59.281 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:29:59.282 INFO:teuthology.orchestra.run.trial125.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-22T22:29:59.282 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:29:59.286 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:29:59.286 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:29:59.326 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:29:59.326 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:29:59.519 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:29:59.520 INFO:teuthology.orchestra.run.trial125.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:59.542 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:59.543 INFO:teuthology.orchestra.run.trial125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T22:29:59.543 INFO:teuthology.orchestra.run.trial125.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T22:29:59.543 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T22:29:59.543 INFO:teuthology.orchestra.run.trial125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T22:29:59.543 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:59.864 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:29:59.864 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:59.864 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:29:59.864 INFO:teuthology.orchestra.run.trial125.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:29:59.864 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:29:59.865 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:29:59.892 DEBUG:teuthology.orchestra.run.trial125:> sudo yum -y install rbd-nbd 2026-02-22T22:30:00.205 INFO:teuthology.orchestra.run.trial125.stdout:Last metadata expiration check: 0:00:59 ago on Sun 22 Feb 2026 10:29:01 PM UTC. 2026-02-22T22:30:00.289 INFO:teuthology.orchestra.run.trial125.stdout:Dependencies resolved. 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout: Package Architecture Version Repository Size 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout:Installing: 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout:Transaction Summary 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout:================================================================================ 2026-02-22T22:30:00.290 INFO:teuthology.orchestra.run.trial125.stdout:Install 1 Package 2026-02-22T22:30:00.291 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:00.291 INFO:teuthology.orchestra.run.trial125.stdout:Total download size: 170 k 2026-02-22T22:30:00.291 INFO:teuthology.orchestra.run.trial125.stdout:Installed size: 490 k 2026-02-22T22:30:00.291 INFO:teuthology.orchestra.run.trial125.stdout:Downloading Packages: 2026-02-22T22:30:00.650 INFO:teuthology.orchestra.run.trial125.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 474 kB/s | 170 kB 00:00 2026-02-22T22:30:00.650 INFO:teuthology.orchestra.run.trial125.stdout:-------------------------------------------------------------------------------- 2026-02-22T22:30:00.651 INFO:teuthology.orchestra.run.trial125.stdout:Total 473 kB/s | 170 kB 00:00 2026-02-22T22:30:00.651 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction check 2026-02-22T22:30:00.654 INFO:teuthology.orchestra.run.trial125.stdout:Transaction check succeeded. 2026-02-22T22:30:00.654 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction test 2026-02-22T22:30:00.686 INFO:teuthology.orchestra.run.trial125.stdout:Transaction test succeeded. 2026-02-22T22:30:00.686 INFO:teuthology.orchestra.run.trial125.stdout:Running transaction 2026-02-22T22:30:00.742 INFO:teuthology.orchestra.run.trial125.stdout: Preparing : 1/1 2026-02-22T22:30:00.758 INFO:teuthology.orchestra.run.trial125.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:30:00.843 INFO:teuthology.orchestra.run.trial125.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:30:00.901 INFO:teuthology.orchestra.run.trial125.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T22:30:00.901 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:00.901 INFO:teuthology.orchestra.run.trial125.stdout:Installed: 2026-02-22T22:30:00.901 INFO:teuthology.orchestra.run.trial125.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T22:30:00.902 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:00.902 INFO:teuthology.orchestra.run.trial125.stdout:Complete! 2026-02-22T22:30:00.930 DEBUG:teuthology.parallel:result is None 2026-02-22T22:30:00.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:30:01.060 DEBUG:teuthology.orchestra.run.trial125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T22:30:01.082 INFO:teuthology.orchestra.run.trial125.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T22:30:01.082 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T22:30:01.082 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T22:30:01.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:30:01.225 DEBUG:teuthology.orchestra.run.trial144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T22:30:01.246 INFO:teuthology.orchestra.run.trial144.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T22:30:01.246 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T22:30:01.247 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T22:30:01.248 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T22:30:01.248 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:01.249 DEBUG:teuthology.orchestra.run.trial125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T22:30:01.275 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:01.275 DEBUG:teuthology.orchestra.run.trial144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T22:30:01.324 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T22:30:01.324 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:01.324 DEBUG:teuthology.orchestra.run.trial125:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T22:30:01.349 DEBUG:teuthology.orchestra.run.trial125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T22:30:01.413 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:01.413 DEBUG:teuthology.orchestra.run.trial144:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T22:30:01.440 DEBUG:teuthology.orchestra.run.trial144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T22:30:01.503 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T22:30:01.503 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:01.504 DEBUG:teuthology.orchestra.run.trial125:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T22:30:01.529 DEBUG:teuthology.orchestra.run.trial125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T22:30:01.592 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:01.592 DEBUG:teuthology.orchestra.run.trial144:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T22:30:01.616 DEBUG:teuthology.orchestra.run.trial144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T22:30:01.679 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T22:30:01.680 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:01.680 DEBUG:teuthology.orchestra.run.trial125:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T22:30:01.705 DEBUG:teuthology.orchestra.run.trial125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T22:30:01.769 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:01.770 DEBUG:teuthology.orchestra.run.trial144:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T22:30:01.794 DEBUG:teuthology.orchestra.run.trial144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T22:30:01.857 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T22:30:01.962 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T22:30:01.962 DEBUG:teuthology.orchestra.run.trial125:> sudo chmod 777 /var/log/ceph 2026-02-22T22:30:01.964 DEBUG:teuthology.orchestra.run.trial144:> sudo chmod 777 /var/log/ceph 2026-02-22T22:30:01.988 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T22:30:01.988 DEBUG:teuthology.orchestra.run.trial125:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T22:30:02.029 DEBUG:teuthology.orchestra.run.trial144:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T22:30:02.053 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T22:30:02.053 DEBUG:teuthology.orchestra.run.trial125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T22:30:02.094 DEBUG:teuthology.orchestra.run.trial144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T22:30:02.138 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T22:30:02.139 INFO:tasks.ceph:config {'conf': {'client': {'rbd_persistent_cache_mode': 'ssd', 'rbd_persistent_cache_path': '/home/ubuntu/cephtest/rbd-pwl-cache', 'rbd_persistent_cache_size': 5368709120, 'rbd_plugins': 'pwl_cache'}, 'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-22T22:30:02.139 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests conf/{disable-pool-app}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64238', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'client': {'rbd_persistent_cache_mode': 'ssd', 'rbd_persistent_cache_path': '/home/ubuntu/cephtest/rbd-pwl-cache', 'rbd_persistent_cache_size': 5368709120, 'rbd_plugins': 'pwl_cache'}, 'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1'], ['mon.b', 'mgr.y', 'osd.2', 'osd.3', 'client.0']], 'seed': 9196, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial125.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHxvfhS7LJFd8ddb+aGJNkc2CKs2nwKGhtxHDd52IbYWWiltp4EIrhWUJkdd5Uc88O+Fm/k4NYIjvlrd1gC1KTE=', 'trial144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODLpM596NowJ+BkiyEsDK62abunHM2Y+M1mVyUW7/efC1wypLJt5km936vkRfXkMPlz7IZme/R9MYOj9AlX1TU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['mkdir /home/ubuntu/cephtest/tmpfs', 'mkdir /home/ubuntu/cephtest/rbd-pwl-cache', 'sudo mount -t tmpfs -o size=20G tmpfs /home/ubuntu/cephtest/tmpfs', 'truncate -s 20G /home/ubuntu/cephtest/tmpfs/loopfile', 'mkfs.ext4 /home/ubuntu/cephtest/tmpfs/loopfile', 'sudo mount -o loop /home/ubuntu/cephtest/tmpfs/loopfile /home/ubuntu/cephtest/rbd-pwl-cache', 'sudo chmod 777 /home/ubuntu/cephtest/rbd-pwl-cache']}}, {'exec_on_cleanup': {'client.0': ['sudo umount /home/ubuntu/cephtest/rbd-pwl-cache', 'sudo umount /home/ubuntu/cephtest/tmpfs', 'rm -rf /home/ubuntu/cephtest/rbd-pwl-cache', 'rm -rf /home/ubuntu/cephtest/tmpfs']}}, {'qemu': {'client.0': {'cpus': 4, 'disks': 3, 'memory': 4096, 'test': 'qa/run_xfstests_qemu.sh', 'type': 'block'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:38', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T22:30:02.140 DEBUG:teuthology.orchestra.run.trial125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T22:30:02.157 DEBUG:teuthology.orchestra.run.trial144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T22:30:02.174 DEBUG:teuthology.orchestra.run.trial125:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T22:30:02.214 DEBUG:teuthology.orchestra.run.trial144:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T22:30:02.240 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:02.240 DEBUG:teuthology.orchestra.run.trial125:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T22:30:02.295 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T22:30:02.296 DEBUG:teuthology.orchestra.run.trial125:> stat /dev/vg_nvme/lv_1 2026-02-22T22:30:02.351 INFO:teuthology.orchestra.run.trial125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T22:30:02.351 INFO:teuthology.orchestra.run.trial125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:02.352 INFO:teuthology.orchestra.run.trial125.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-22T22:30:02.352 INFO:teuthology.orchestra.run.trial125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:02.352 INFO:teuthology.orchestra.run.trial125.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:02.352 INFO:teuthology.orchestra.run.trial125.stdout:Access: 2026-02-22 22:29:59.684757173 +0000 2026-02-22T22:30:02.352 INFO:teuthology.orchestra.run.trial125.stdout:Modify: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.352 INFO:teuthology.orchestra.run.trial125.stdout:Change: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.352 INFO:teuthology.orchestra.run.trial125.stdout: Birth: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.353 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T22:30:02.415 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records in 2026-02-22T22:30:02.416 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records out 2026-02-22T22:30:02.416 INFO:teuthology.orchestra.run.trial125.stderr:512 bytes copied, 0.000158153 s, 3.2 MB/s 2026-02-22T22:30:02.417 DEBUG:teuthology.orchestra.run.trial125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T22:30:02.474 DEBUG:teuthology.orchestra.run.trial125:> stat /dev/vg_nvme/lv_2 2026-02-22T22:30:02.530 INFO:teuthology.orchestra.run.trial125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T22:30:02.530 INFO:teuthology.orchestra.run.trial125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:02.530 INFO:teuthology.orchestra.run.trial125.stdout:Device: 6h/6d Inode: 1320 Links: 1 2026-02-22T22:30:02.530 INFO:teuthology.orchestra.run.trial125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:02.531 INFO:teuthology.orchestra.run.trial125.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:02.531 INFO:teuthology.orchestra.run.trial125.stdout:Access: 2026-02-22 22:29:59.684757173 +0000 2026-02-22T22:30:02.531 INFO:teuthology.orchestra.run.trial125.stdout:Modify: 2026-02-22 22:29:12.712650857 +0000 2026-02-22T22:30:02.531 INFO:teuthology.orchestra.run.trial125.stdout:Change: 2026-02-22 22:29:12.712650857 +0000 2026-02-22T22:30:02.531 INFO:teuthology.orchestra.run.trial125.stdout: Birth: 2026-02-22 22:29:12.712650857 +0000 2026-02-22T22:30:02.531 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T22:30:02.591 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records in 2026-02-22T22:30:02.592 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records out 2026-02-22T22:30:02.592 INFO:teuthology.orchestra.run.trial125.stderr:512 bytes copied, 0.000140411 s, 3.6 MB/s 2026-02-22T22:30:02.593 DEBUG:teuthology.orchestra.run.trial125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T22:30:02.650 DEBUG:teuthology.orchestra.run.trial125:> stat /dev/vg_nvme/lv_3 2026-02-22T22:30:02.707 INFO:teuthology.orchestra.run.trial125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout:Access: 2026-02-22 22:29:59.685757155 +0000 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout:Modify: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout:Change: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.708 INFO:teuthology.orchestra.run.trial125.stdout: Birth: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.708 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T22:30:02.770 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records in 2026-02-22T22:30:02.770 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records out 2026-02-22T22:30:02.770 INFO:teuthology.orchestra.run.trial125.stderr:512 bytes copied, 0.000156431 s, 3.3 MB/s 2026-02-22T22:30:02.771 DEBUG:teuthology.orchestra.run.trial125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T22:30:02.826 DEBUG:teuthology.orchestra.run.trial125:> stat /dev/vg_nvme/lv_4 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout:Access: 2026-02-22 22:29:59.685757155 +0000 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout:Modify: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout:Change: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.882 INFO:teuthology.orchestra.run.trial125.stdout: Birth: 2026-02-22 22:29:12.711650876 +0000 2026-02-22T22:30:02.882 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T22:30:02.945 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records in 2026-02-22T22:30:02.945 INFO:teuthology.orchestra.run.trial125.stderr:1+0 records out 2026-02-22T22:30:02.945 INFO:teuthology.orchestra.run.trial125.stderr:512 bytes copied, 0.000145791 s, 3.5 MB/s 2026-02-22T22:30:02.947 DEBUG:teuthology.orchestra.run.trial125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T22:30:03.003 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-22T22:30:03.003 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:03.003 DEBUG:teuthology.orchestra.run.trial144:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T22:30:03.021 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T22:30:03.021 DEBUG:teuthology.orchestra.run.trial144:> stat /dev/vg_nvme/lv_1 2026-02-22T22:30:03.077 INFO:teuthology.orchestra.run.trial144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T22:30:03.077 INFO:teuthology.orchestra.run.trial144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:03.078 INFO:teuthology.orchestra.run.trial144.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-22T22:30:03.078 INFO:teuthology.orchestra.run.trial144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:03.078 INFO:teuthology.orchestra.run.trial144.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:03.078 INFO:teuthology.orchestra.run.trial144.stdout:Access: 2026-02-22 22:29:49.649239829 +0000 2026-02-22T22:30:03.078 INFO:teuthology.orchestra.run.trial144.stdout:Modify: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.078 INFO:teuthology.orchestra.run.trial144.stdout:Change: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.078 INFO:teuthology.orchestra.run.trial144.stdout: Birth: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.078 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T22:30:03.142 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records in 2026-02-22T22:30:03.142 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records out 2026-02-22T22:30:03.142 INFO:teuthology.orchestra.run.trial144.stderr:512 bytes copied, 0.000164656 s, 3.1 MB/s 2026-02-22T22:30:03.143 DEBUG:teuthology.orchestra.run.trial144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T22:30:03.201 DEBUG:teuthology.orchestra.run.trial144:> stat /dev/vg_nvme/lv_2 2026-02-22T22:30:03.259 INFO:teuthology.orchestra.run.trial144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T22:30:03.259 INFO:teuthology.orchestra.run.trial144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:03.259 INFO:teuthology.orchestra.run.trial144.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-22T22:30:03.259 INFO:teuthology.orchestra.run.trial144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:03.259 INFO:teuthology.orchestra.run.trial144.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:03.260 INFO:teuthology.orchestra.run.trial144.stdout:Access: 2026-02-22 22:29:49.650239806 +0000 2026-02-22T22:30:03.260 INFO:teuthology.orchestra.run.trial144.stdout:Modify: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.260 INFO:teuthology.orchestra.run.trial144.stdout:Change: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.260 INFO:teuthology.orchestra.run.trial144.stdout: Birth: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.260 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T22:30:03.321 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records in 2026-02-22T22:30:03.322 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records out 2026-02-22T22:30:03.322 INFO:teuthology.orchestra.run.trial144.stderr:512 bytes copied, 0.000142125 s, 3.6 MB/s 2026-02-22T22:30:03.323 DEBUG:teuthology.orchestra.run.trial144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T22:30:03.380 DEBUG:teuthology.orchestra.run.trial144:> stat /dev/vg_nvme/lv_3 2026-02-22T22:30:03.437 INFO:teuthology.orchestra.run.trial144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout:Access: 2026-02-22 22:29:49.650239806 +0000 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout:Modify: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout:Change: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.438 INFO:teuthology.orchestra.run.trial144.stdout: Birth: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.439 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T22:30:03.501 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records in 2026-02-22T22:30:03.501 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records out 2026-02-22T22:30:03.501 INFO:teuthology.orchestra.run.trial144.stderr:512 bytes copied, 0.000167472 s, 3.1 MB/s 2026-02-22T22:30:03.502 DEBUG:teuthology.orchestra.run.trial144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T22:30:03.560 DEBUG:teuthology.orchestra.run.trial144:> stat /dev/vg_nvme/lv_4 2026-02-22T22:30:03.617 INFO:teuthology.orchestra.run.trial144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T22:30:03.617 INFO:teuthology.orchestra.run.trial144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:30:03.617 INFO:teuthology.orchestra.run.trial144.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-22T22:30:03.617 INFO:teuthology.orchestra.run.trial144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:30:03.617 INFO:teuthology.orchestra.run.trial144.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T22:30:03.617 INFO:teuthology.orchestra.run.trial144.stdout:Access: 2026-02-22 22:29:49.650239806 +0000 2026-02-22T22:30:03.618 INFO:teuthology.orchestra.run.trial144.stdout:Modify: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.618 INFO:teuthology.orchestra.run.trial144.stdout:Change: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.618 INFO:teuthology.orchestra.run.trial144.stdout: Birth: 2026-02-22 22:29:12.019135265 +0000 2026-02-22T22:30:03.618 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T22:30:03.680 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records in 2026-02-22T22:30:03.680 INFO:teuthology.orchestra.run.trial144.stderr:1+0 records out 2026-02-22T22:30:03.680 INFO:teuthology.orchestra.run.trial144.stderr:512 bytes copied, 0.000152343 s, 3.4 MB/s 2026-02-22T22:30:03.682 DEBUG:teuthology.orchestra.run.trial144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T22:30:03.740 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-22T22:30:03.740 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial144.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-22T22:30:03.740 INFO:tasks.ceph:Generating config... 2026-02-22T22:30:03.743 INFO:tasks.ceph:[client] rbd_persistent_cache_mode = ssd 2026-02-22T22:30:03.743 INFO:tasks.ceph:[client] rbd_persistent_cache_path = /home/ubuntu/cephtest/rbd-pwl-cache 2026-02-22T22:30:03.743 INFO:tasks.ceph:[client] rbd_persistent_cache_size = 5368709120 2026-02-22T22:30:03.743 INFO:tasks.ceph:[client] rbd_plugins = pwl_cache 2026-02-22T22:30:03.743 INFO:tasks.ceph:[global] mon warn on pool no app = False 2026-02-22T22:30:03.743 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T22:30:03.744 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T22:30:03.744 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T22:30:03.744 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T22:30:03.744 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T22:30:03.744 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T22:30:03.744 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T22:30:03.744 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T22:30:03.744 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T22:30:03.780 INFO:teuthology.orchestra.run.trial125.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T22:30:03.783 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T22:30:03.860 DEBUG:teuthology.orchestra.run.trial125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:30:03.924 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.125'), ('mon.b', '10.20.193.144')] 2026-02-22T22:30:03.924 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.125,10.20.193.144', 'mon warn on pool no app': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd_persistent_cache_mode': 'ssd', 'rbd_persistent_cache_path': '/home/ubuntu/cephtest/rbd-pwl-cache', 'rbd_persistent_cache_size': 5368709120, 'rbd_plugins': 'pwl_cache'}, 'mon.a': {}, 'mon.b': {}} 2026-02-22T22:30:03.925 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:03.926 DEBUG:teuthology.orchestra.run.trial125:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T22:30:03.981 DEBUG:teuthology.orchestra.run.trial125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.125 --add b 10.20.193.144 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:monmaptool: generated fsid d59c90c8-7ec2-4873-b6be-8a8b1253060c 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:setting min_mon_release = quincy 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:epoch 0 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:fsid d59c90c8-7ec2-4873-b6be-8a8b1253060c 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:last_changed 2026-02-22T22:30:04.051581+0000 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:created 2026-02-22T22:30:04.051581+0000 2026-02-22T22:30:04.053 INFO:teuthology.orchestra.run.trial125.stdout:min_mon_release 17 (quincy) 2026-02-22T22:30:04.054 INFO:teuthology.orchestra.run.trial125.stdout:election_strategy: 1 2026-02-22T22:30:04.054 INFO:teuthology.orchestra.run.trial125.stdout:0: [v2:10.20.193.125:3300/0,v1:10.20.193.125:6789/0] mon.a 2026-02-22T22:30:04.054 INFO:teuthology.orchestra.run.trial125.stdout:1: [v2:10.20.193.144:3300/0,v1:10.20.193.144:6789/0] mon.b 2026-02-22T22:30:04.054 INFO:teuthology.orchestra.run.trial125.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (2 monitors) 2026-02-22T22:30:04.055 DEBUG:teuthology.orchestra.run.trial125:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T22:30:04.110 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d59c90c8-7ec2-4873-b6be-8a8b1253060c... 2026-02-22T22:30:04.110 DEBUG:teuthology.orchestra.run.trial125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T22:30:04.152 DEBUG:teuthology.orchestra.run.trial144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T22:30:04.189 INFO:teuthology.orchestra.run.trial125.stdout:[global] 2026-02-22T22:30:04.189 INFO:teuthology.orchestra.run.trial125.stdout: chdir = "" 2026-02-22T22:30:04.189 INFO:teuthology.orchestra.run.trial125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: auth supported = cephx 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: filestore xattr use omap = true 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: mon clock drift allowed = 1.000 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: osd crush chooseleaf type = 0 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: auth debug = true 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.190 INFO:teuthology.orchestra.run.trial125.stdout: ms die on old message = true 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: ms die on bug = true 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: mon pg warn max object skew = 0 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: osd pool default size = 2 2026-02-22T22:30:04.191 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon osd allow primary affinity = true 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon osd allow pg remap = true 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon warn on legacy crush tunables = false 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon warn on crush straw calc version zero = false 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon warn on no sortbitwise = false 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon warn on osd down out interval zero = false 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon warn on too few osds = false 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T22:30:04.192 INFO:teuthology.orchestra.run.trial125.stdout: mon_allow_pool_size_one = true 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: osd default data pool replay window = 5 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: mon allow pool delete = true 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: mon cluster log file level = debug 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: debug asserts on shutdown = true 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: mon health detail to clog = false 2026-02-22T22:30:04.193 INFO:teuthology.orchestra.run.trial125.stdout: mon host = "10.20.193.125,10.20.193.144" 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: mon warn on pool no app = False 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: fsid = d59c90c8-7ec2-4873-b6be-8a8b1253060c 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout:[osd] 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: osd journal size = 100 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: osd scrub load threshold = 5.0 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: osd scrub max interval = 600 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: osd mclock profile = high_recovery_ops 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: osd mclock skip benchmark = true 2026-02-22T22:30:04.194 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd recover clone overlap = true 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd recovery max chunk = 1048576 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd debug shutdown = true 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd debug op order = true 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd debug verify stray on activate = true 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd debug trim objects = true 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd open classes on start = true 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: osd debug pg log writeout = true 2026-02-22T22:30:04.195 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: osd deep scrub update digest min age = 30 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: osd map max advance = 10 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: journal zero on create = true 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: filestore ondisk finisher threads = 3 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: filestore apply finisher threads = 3 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: bdev debug aio = true 2026-02-22T22:30:04.196 INFO:teuthology.orchestra.run.trial125.stdout: osd debug misdirected ops = true 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: debug ms = 1 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: debug osd = 20 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout:[mgr] 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: debug ms = 1 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: debug mgr = 20 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: debug mon = 20 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: debug auth = 20 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:30:04.197 INFO:teuthology.orchestra.run.trial125.stdout: mgr/telemetry/nag = false 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout:[mon] 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: debug ms = 1 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: debug mon = 20 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: debug paxos = 20 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: debug auth = 20 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: mon data avail warn = 5 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: mon mgr mkfs grace = 240 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: mon osd reporter subtree level = osd 2026-02-22T22:30:04.198 INFO:teuthology.orchestra.run.trial125.stdout: mon osd prime pg temp = true 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.199 INFO:teuthology.orchestra.run.trial125.stdout: # 1m isn't quite enough 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: mon_down_mkfs_grace = 2m 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: mon_warn_on_filestore_osds = false 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout:[client] 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: rgw cache enabled = true 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: rgw enable ops log = true 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: rgw enable usage log = true 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T22:30:04.200 INFO:teuthology.orchestra.run.trial125.stdout: rbd_persistent_cache_mode = ssd 2026-02-22T22:30:04.201 INFO:teuthology.orchestra.run.trial125.stdout: rbd_persistent_cache_path = /home/ubuntu/cephtest/rbd-pwl-cache 2026-02-22T22:30:04.201 INFO:teuthology.orchestra.run.trial125.stdout: rbd_persistent_cache_size = 5368709120 2026-02-22T22:30:04.201 INFO:teuthology.orchestra.run.trial125.stdout: rbd_plugins = pwl_cache 2026-02-22T22:30:04.201 INFO:teuthology.orchestra.run.trial125.stdout:[mon.a] 2026-02-22T22:30:04.201 INFO:teuthology.orchestra.run.trial125.stdout:[mon.b] 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout:[global] 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout: chdir = "" 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout: auth supported = cephx 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout: filestore xattr use omap = true 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.202 INFO:teuthology.orchestra.run.trial144.stdout: mon clock drift allowed = 1.000 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: osd crush chooseleaf type = 0 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: auth debug = true 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: ms die on old message = true 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: ms die on bug = true 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: mon pg warn max object skew = 0 2026-02-22T22:30:04.203 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: osd pool default size = 2 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: mon osd allow primary affinity = true 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: mon osd allow pg remap = true 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: mon warn on legacy crush tunables = false 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: mon warn on crush straw calc version zero = false 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: mon warn on no sortbitwise = false 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: mon warn on osd down out interval zero = false 2026-02-22T22:30:04.204 INFO:teuthology.orchestra.run.trial144.stdout: mon warn on too few osds = false 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: mon_allow_pool_size_one = true 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: osd default data pool replay window = 5 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: mon allow pool delete = true 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: mon cluster log file level = debug 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: debug asserts on shutdown = true 2026-02-22T22:30:04.205 INFO:teuthology.orchestra.run.trial144.stdout: mon health detail to clog = false 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: mon host = "10.20.193.125,10.20.193.144" 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: mon warn on pool no app = False 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: fsid = d59c90c8-7ec2-4873-b6be-8a8b1253060c 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout:[osd] 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: osd journal size = 100 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: osd scrub load threshold = 5.0 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: osd scrub max interval = 600 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: osd mclock profile = high_recovery_ops 2026-02-22T22:30:04.206 INFO:teuthology.orchestra.run.trial144.stdout: osd mclock skip benchmark = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd recover clone overlap = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd recovery max chunk = 1048576 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd debug shutdown = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd debug op order = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd debug verify stray on activate = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd debug trim objects = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd open classes on start = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd debug pg log writeout = true 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.207 INFO:teuthology.orchestra.run.trial144.stdout: osd deep scrub update digest min age = 30 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: osd map max advance = 10 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: journal zero on create = true 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: filestore ondisk finisher threads = 3 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: filestore apply finisher threads = 3 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: bdev debug aio = true 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: osd debug misdirected ops = true 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: debug ms = 1 2026-02-22T22:30:04.208 INFO:teuthology.orchestra.run.trial144.stdout: debug osd = 20 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout:[mgr] 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: debug ms = 1 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: debug mgr = 20 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: debug mon = 20 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: debug auth = 20 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: mgr/telemetry/nag = false 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout:[mon] 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: debug ms = 1 2026-02-22T22:30:04.209 INFO:teuthology.orchestra.run.trial144.stdout: debug mon = 20 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: debug paxos = 20 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: debug auth = 20 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: mon data avail warn = 5 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: mon mgr mkfs grace = 240 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: mon osd reporter subtree level = osd 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: mon osd prime pg temp = true 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T22:30:04.210 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: # 1m isn't quite enough 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: mon_down_mkfs_grace = 2m 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: mon_warn_on_filestore_osds = false 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout:[client] 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: rgw cache enabled = true 2026-02-22T22:30:04.211 INFO:teuthology.orchestra.run.trial144.stdout: rgw enable ops log = true 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout: rgw enable usage log = true 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout: rbd_persistent_cache_mode = ssd 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout: rbd_persistent_cache_path = /home/ubuntu/cephtest/rbd-pwl-cache 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout: rbd_persistent_cache_size = 5368709120 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout: rbd_plugins = pwl_cache 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout:[mon.a] 2026-02-22T22:30:04.212 INFO:teuthology.orchestra.run.trial144.stdout:[mon.b] 2026-02-22T22:30:04.214 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T22:30:04.215 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T22:30:04.295 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T22:30:04.295 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:04.295 DEBUG:teuthology.orchestra.run.trial125:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T22:30:04.351 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:04.351 DEBUG:teuthology.orchestra.run.trial125:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T22:30:04.409 INFO:tasks.ceph:Sending monmap to node ubuntu@trial125.front.sepia.ceph.com 2026-02-22T22:30:04.410 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:04.410 DEBUG:teuthology.orchestra.run.trial125:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T22:30:04.410 DEBUG:teuthology.orchestra.run.trial125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:30:04.480 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:04.481 DEBUG:teuthology.orchestra.run.trial125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:04.537 INFO:tasks.ceph:Sending monmap to node ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:30:04.538 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:04.538 DEBUG:teuthology.orchestra.run.trial144:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T22:30:04.538 DEBUG:teuthology.orchestra.run.trial144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:30:04.572 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:04.572 DEBUG:teuthology.orchestra.run.trial144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:04.628 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T22:30:04.628 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T22:30:04.629 DEBUG:teuthology.orchestra.run.trial125:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T22:30:04.674 INFO:teuthology.orchestra.run.trial125.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T22:30:04.676 DEBUG:teuthology.orchestra.run.trial144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-22T22:30:04.721 INFO:teuthology.orchestra.run.trial144.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-22T22:30:04.723 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T22:30:04.724 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T22:30:04.724 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T22:30:04.758 INFO:teuthology.orchestra.run.trial144.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T22:30:04.769 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T22:30:04.769 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial144.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-22T22:30:04.769 DEBUG:teuthology.orchestra.run.trial125:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T22:30:04.795 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-22T22:30:04.795 INFO:tasks.ceph:role: osd.0 2026-02-22T22:30:04.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial125.front.sepia.ceph.com 2026-02-22T22:30:04.795 DEBUG:teuthology.orchestra.run.trial125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T22:30:04.860 INFO:teuthology.orchestra.run.trial125.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:30:04.860 INFO:teuthology.orchestra.run.trial125.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:30:04.860 INFO:teuthology.orchestra.run.trial125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:30:04.860 INFO:teuthology.orchestra.run.trial125.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T22:30:04.860 INFO:teuthology.orchestra.run.trial125.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:30:04.860 INFO:teuthology.orchestra.run.trial125.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:30:04.860 INFO:teuthology.orchestra.run.trial125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:30:04.861 INFO:teuthology.orchestra.run.trial125.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:30:04.861 INFO:teuthology.orchestra.run.trial125.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:30:04.861 INFO:teuthology.orchestra.run.trial125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:30:05.428 INFO:teuthology.orchestra.run.trial125.stdout:Discarding blocks...Done. 2026-02-22T22:30:05.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial125.front.sepia.ceph.com -o noatime 2026-02-22T22:30:05.431 DEBUG:teuthology.orchestra.run.trial125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T22:30:05.499 DEBUG:teuthology.orchestra.run.trial125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T22:30:05.566 DEBUG:teuthology.orchestra.run.trial125:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T22:30:05.630 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-22T22:30:05.630 INFO:tasks.ceph:role: osd.1 2026-02-22T22:30:05.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial125.front.sepia.ceph.com 2026-02-22T22:30:05.630 DEBUG:teuthology.orchestra.run.trial125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T22:30:05.695 INFO:teuthology.orchestra.run.trial125.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:30:05.695 INFO:teuthology.orchestra.run.trial125.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:30:05.695 INFO:teuthology.orchestra.run.trial125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:30:05.695 INFO:teuthology.orchestra.run.trial125.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T22:30:05.695 INFO:teuthology.orchestra.run.trial125.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:30:05.695 INFO:teuthology.orchestra.run.trial125.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:30:05.695 INFO:teuthology.orchestra.run.trial125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:30:05.696 INFO:teuthology.orchestra.run.trial125.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:30:05.696 INFO:teuthology.orchestra.run.trial125.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:30:05.696 INFO:teuthology.orchestra.run.trial125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:30:06.264 INFO:teuthology.orchestra.run.trial125.stdout:Discarding blocks...Done. 2026-02-22T22:30:06.266 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial125.front.sepia.ceph.com -o noatime 2026-02-22T22:30:06.267 DEBUG:teuthology.orchestra.run.trial125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T22:30:06.333 DEBUG:teuthology.orchestra.run.trial125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T22:30:06.400 DEBUG:teuthology.orchestra.run.trial125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:06.480 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:06.478+0000 7f084960b780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T22:30:06.480 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:06.478+0000 7f084960b780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T22:30:06.480 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:06.478+0000 7f084960b780 -1 bdev(0x5567199f7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T22:30:06.481 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:06.478+0000 7f084960b780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T22:30:08.836 DEBUG:teuthology.orchestra.run.trial125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T22:30:08.900 DEBUG:teuthology.orchestra.run.trial125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:08.978 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:08.976+0000 7f4a5d61f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T22:30:08.979 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:08.976+0000 7f4a5d61f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T22:30:08.979 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:08.976+0000 7f4a5d61f780 -1 bdev(0x55ae17f4d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T22:30:08.979 INFO:teuthology.orchestra.run.trial125.stderr:2026-02-22T22:30:08.976+0000 7f4a5d61f780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T22:30:11.096 DEBUG:teuthology.orchestra.run.trial125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T22:30:11.160 DEBUG:teuthology.orchestra.run.trial144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T22:30:11.186 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-22T22:30:11.186 INFO:tasks.ceph:role: osd.2 2026-02-22T22:30:11.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:30:11.186 DEBUG:teuthology.orchestra.run.trial144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T22:30:11.251 INFO:teuthology.orchestra.run.trial144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:30:11.251 INFO:teuthology.orchestra.run.trial144.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:30:11.251 INFO:teuthology.orchestra.run.trial144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:30:11.251 INFO:teuthology.orchestra.run.trial144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T22:30:11.251 INFO:teuthology.orchestra.run.trial144.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:30:11.251 INFO:teuthology.orchestra.run.trial144.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:30:11.251 INFO:teuthology.orchestra.run.trial144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:30:11.252 INFO:teuthology.orchestra.run.trial144.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:30:11.252 INFO:teuthology.orchestra.run.trial144.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:30:11.252 INFO:teuthology.orchestra.run.trial144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:30:11.824 INFO:teuthology.orchestra.run.trial144.stdout:Discarding blocks...Done. 2026-02-22T22:30:11.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial144.front.sepia.ceph.com -o noatime 2026-02-22T22:30:11.826 DEBUG:teuthology.orchestra.run.trial144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-22T22:30:11.895 DEBUG:teuthology.orchestra.run.trial144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T22:30:11.962 DEBUG:teuthology.orchestra.run.trial144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-22T22:30:12.028 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-22T22:30:12.028 INFO:tasks.ceph:role: osd.3 2026-02-22T22:30:12.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:30:12.029 DEBUG:teuthology.orchestra.run.trial144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T22:30:12.092 INFO:teuthology.orchestra.run.trial144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:30:12.093 INFO:teuthology.orchestra.run.trial144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:30:12.653 INFO:teuthology.orchestra.run.trial144.stdout:Discarding blocks...Done. 2026-02-22T22:30:12.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial144.front.sepia.ceph.com -o noatime 2026-02-22T22:30:12.655 DEBUG:teuthology.orchestra.run.trial144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-22T22:30:12.723 DEBUG:teuthology.orchestra.run.trial144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-22T22:30:12.790 DEBUG:teuthology.orchestra.run.trial144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:12.870 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:12.868+0000 7f97d61ad780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T22:30:12.871 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:12.868+0000 7f97d61ad780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T22:30:12.871 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:12.868+0000 7f97d61ad780 -1 bdev(0x55b54f7bf800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T22:30:12.871 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:12.868+0000 7f97d61ad780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T22:30:14.993 DEBUG:teuthology.orchestra.run.trial144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T22:30:15.058 DEBUG:teuthology.orchestra.run.trial144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:15.136 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:15.133+0000 7fcef0d93780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-22T22:30:15.136 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:15.134+0000 7fcef0d93780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-22T22:30:15.137 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:15.134+0000 7fcef0d93780 -1 bdev(0x55e29cec3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-22T22:30:15.137 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:30:15.134+0000 7fcef0d93780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-22T22:30:17.497 DEBUG:teuthology.orchestra.run.trial144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-22T22:30:17.561 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T22:30:17.561 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:17.561 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T22:30:17.587 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:17.587 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T22:30:17.649 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:17.649 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T22:30:17.713 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:17.713 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-22T22:30:17.739 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:17.740 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T22:30:17.802 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:17.802 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-22T22:30:17.867 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:17.867 DEBUG:teuthology.orchestra.run.trial144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T22:30:17.922 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T22:30:17.923 DEBUG:teuthology.orchestra.run.trial125:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T22:30:17.925 DEBUG:teuthology.orchestra.run.trial144:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T22:30:17.966 INFO:teuthology.orchestra.run.trial125.stdout:[mgr.x] 2026-02-22T22:30:17.966 INFO:teuthology.orchestra.run.trial125.stdout: key = AQBsg5tpfv4cKBAAkv9pMrOu9eMgHaAFR/+yZw== 2026-02-22T22:30:17.966 INFO:teuthology.orchestra.run.trial125.stdout:[osd.0] 2026-02-22T22:30:17.966 INFO:teuthology.orchestra.run.trial125.stdout: key = AQBug5tpKb2LHBAAjLH4+DibXO5TeikaYZhvHw== 2026-02-22T22:30:17.966 INFO:teuthology.orchestra.run.trial125.stdout:[osd.1] 2026-02-22T22:30:17.966 INFO:teuthology.orchestra.run.trial125.stdout: key = AQBwg5tp0Nc/OhAAtekIhfBtcld5CAeAS1cCyQ== 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout:[mgr.y] 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout: key = AQBsg5tpjdDuKhAA5XngBYHh+6TuVPNwgH2Dmg== 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout:[osd.2] 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout: key = AQB0g5tpytDWMxAAKGtUsslFJgAuwFw3db04Ig== 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout:[osd.3] 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout: key = AQB3g5tpbowRCBAAGke/phvOiJfvgjbpNcU48w== 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout:[client.0] 2026-02-22T22:30:17.967 INFO:teuthology.orchestra.run.trial125.stdout: key = AQBsg5tpOKkjLRAARyx+NWjNDfdEZ+9WvCbDWw== 2026-02-22T22:30:17.986 INFO:teuthology.orchestra.run.trial144.stdout:[mgr.x] 2026-02-22T22:30:17.986 INFO:teuthology.orchestra.run.trial144.stdout: key = AQBsg5tpfv4cKBAAkv9pMrOu9eMgHaAFR/+yZw== 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout:[osd.0] 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout: key = AQBug5tpKb2LHBAAjLH4+DibXO5TeikaYZhvHw== 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout:[osd.1] 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout: key = AQBwg5tp0Nc/OhAAtekIhfBtcld5CAeAS1cCyQ== 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout:[mgr.y] 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout: key = AQBsg5tpjdDuKhAA5XngBYHh+6TuVPNwgH2Dmg== 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout:[osd.2] 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout: key = AQB0g5tpytDWMxAAKGtUsslFJgAuwFw3db04Ig== 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout:[osd.3] 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout: key = AQB3g5tpbowRCBAAGke/phvOiJfvgjbpNcU48w== 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout:[client.0] 2026-02-22T22:30:17.987 INFO:teuthology.orchestra.run.trial144.stdout: key = AQBsg5tpOKkjLRAARyx+NWjNDfdEZ+9WvCbDWw== 2026-02-22T22:30:17.988 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:30:18.011 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:30:18.068 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.091 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.147 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.169 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.227 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:30:18.248 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:30:18.307 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.326 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.387 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.405 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:30:18.465 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T22:30:18.483 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T22:30:18.547 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T22:30:18.547 DEBUG:teuthology.orchestra.run.trial125:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T22:30:18.587 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T22:30:18.670 DEBUG:teuthology.orchestra.run.trial125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T22:30:18.734 DEBUG:teuthology.orchestra.run.trial144:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-22T22:30:18.760 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T22:30:18.842 DEBUG:teuthology.orchestra.run.trial144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-22T22:30:18.906 DEBUG:teuthology.orchestra.run.trial125:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:18.908 DEBUG:teuthology.orchestra.run.trial144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:30:18.962 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T22:30:18.963 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T22:30:18.963 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T22:30:18.965 INFO:tasks.ceph.mon.a:Started 2026-02-22T22:30:18.966 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T22:30:18.966 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T22:30:19.004 INFO:tasks.ceph.mon.b:Started 2026-02-22T22:30:19.004 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T22:30:19.004 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T22:30:19.004 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T22:30:19.006 INFO:tasks.ceph.mgr.x:Started 2026-02-22T22:30:19.006 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-22T22:30:19.006 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-22T22:30:19.007 INFO:tasks.ceph.mgr.y:Started 2026-02-22T22:30:19.008 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T22:30:19.008 DEBUG:teuthology.orchestra.run.trial125:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T22:30:19.296 INFO:teuthology.orchestra.run.trial125.stderr:adjusted tunables profile to default 2026-02-22T22:30:19.305 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T22:30:19.305 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T22:30:19.305 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:19.305 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T22:30:19.330 DEBUG:teuthology.orchestra.run.trial125:> set -ex 2026-02-22T22:30:19.330 DEBUG:teuthology.orchestra.run.trial125:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T22:30:19.394 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:19.394 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T22:30:19.419 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:30:19.419 DEBUG:teuthology.orchestra.run.trial144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-22T22:30:19.483 DEBUG:teuthology.orchestra.run.trial144:> sudo ceph --cluster ceph osd new 9be3c328-d53f-4b08-9d13-b41135afbf9a 0 2026-02-22T22:30:19.614 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.612+0000 7f00e77d3140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T22:30:19.618 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.616+0000 7f27ff991140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T22:30:19.626 INFO:teuthology.orchestra.run.trial144.stdout:0 2026-02-22T22:30:19.634 DEBUG:teuthology.orchestra.run.trial144:> sudo ceph --cluster ceph osd new 3f2ef6e5-b1eb-44a4-a94d-10e412019f03 1 2026-02-22T22:30:19.738 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.735+0000 7f00e77d3140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T22:30:19.739 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.737+0000 7f27ff991140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T22:30:19.739 INFO:teuthology.orchestra.run.trial144.stdout:1 2026-02-22T22:30:19.747 DEBUG:teuthology.orchestra.run.trial144:> sudo ceph --cluster ceph osd new 4a3c5816-481d-453e-b015-51cd5c58442d 2 2026-02-22T22:30:19.765 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.763+0000 7f00e77d3140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T22:30:19.766 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.764+0000 7f27ff991140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T22:30:19.799 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.797+0000 7f00e77d3140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T22:30:19.799 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.797+0000 7f27ff991140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T22:30:19.822 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.820+0000 7f27ff991140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T22:30:19.822 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.820+0000 7f00e77d3140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T22:30:19.848 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.846+0000 7f27ff991140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T22:30:19.849 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.847+0000 7f00e77d3140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T22:30:19.850 INFO:teuthology.orchestra.run.trial144.stdout:2 2026-02-22T22:30:19.858 DEBUG:teuthology.orchestra.run.trial144:> sudo ceph --cluster ceph osd new 210204fa-693c-4cd1-94ec-2bdd5376f34b 3 2026-02-22T22:30:19.904 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.902+0000 7f27ff991140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T22:30:19.905 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.903+0000 7f00e77d3140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T22:30:19.965 INFO:tasks.ceph.mgr.x.trial125.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T22:30:19.966 INFO:tasks.ceph.mgr.x.trial125.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T22:30:19.966 INFO:tasks.ceph.mgr.x.trial125.stderr: from numpy import show_config as show_numpy_config 2026-02-22T22:30:19.968 INFO:tasks.ceph.mgr.y.trial144.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T22:30:19.968 INFO:tasks.ceph.mgr.y.trial144.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T22:30:19.968 INFO:tasks.ceph.mgr.y.trial144.stderr: from numpy import show_config as show_numpy_config 2026-02-22T22:30:19.969 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.967+0000 7f27ff991140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T22:30:19.971 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.969+0000 7f00e77d3140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T22:30:19.994 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:19.992+0000 7f27ff991140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T22:30:19.997 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:19.994+0000 7f00e77d3140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T22:30:20.002 INFO:teuthology.orchestra.run.trial144.stdout:3 2026-02-22T22:30:20.011 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T22:30:20.011 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T22:30:20.014 INFO:tasks.ceph.osd.0:Started 2026-02-22T22:30:20.014 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T22:30:20.014 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T22:30:20.017 INFO:tasks.ceph.osd.1:Started 2026-02-22T22:30:20.017 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T22:30:20.017 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T22:30:20.050 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.048+0000 7f27ff991140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T22:30:20.053 INFO:tasks.ceph.osd.2:Started 2026-02-22T22:30:20.054 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-22T22:30:20.054 DEBUG:teuthology.orchestra.run.trial144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-22T22:30:20.055 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.050+0000 7f00e77d3140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T22:30:20.056 INFO:tasks.ceph.osd.3:Started 2026-02-22T22:30:20.057 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:30:20.094 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.092+0000 7f27ff991140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T22:30:20.096 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.094+0000 7f00e77d3140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T22:30:20.121 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.119+0000 7f27ff991140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T22:30:20.122 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.120+0000 7f00e77d3140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T22:30:20.145 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.143+0000 7f27ff991140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T22:30:20.147 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.145+0000 7f00e77d3140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T22:30:20.157 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:20.157 INFO:teuthology.orchestra.run.trial125.stdout:{"epoch":6,"fsid":"d59c90c8-7ec2-4873-b6be-8a8b1253060c","created":"2026-02-22T22:30:19.256654+0000","modified":"2026-02-22T22:30:20.000127+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:30:20.000127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9be3c328-d53f-4b08-9d13-b41135afbf9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f2ef6e5-b1eb-44a4-a94d-10e412019f03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a3c5816-481d-453e-b015-51cd5c58442d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"210204fa-693c-4cd1-94ec-2bdd5376f34b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:30:20.164 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T22:30:20.164 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T22:30:20.171 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.169+0000 7f27ff991140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T22:30:20.173 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.170+0000 7f00e77d3140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T22:30:20.194 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.192+0000 7f27ff991140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T22:30:20.195 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.193+0000 7f00e77d3140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T22:30:20.387 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.385+0000 7f27ff991140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T22:30:20.388 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.385+0000 7f00e77d3140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T22:30:20.441 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.439+0000 7f27ff991140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T22:30:20.442 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.440+0000 7f00e77d3140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T22:30:20.464 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.462+0000 7f27ff991140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T22:30:20.465 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.462+0000 7f00e77d3140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T22:30:20.487 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.485+0000 7f27ff991140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T22:30:20.487 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.485+0000 7f00e77d3140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T22:30:20.540 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.538+0000 7f27ff991140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:30:20.540 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.538+0000 7f00e77d3140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:30:20.561 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.558+0000 7f27ff991140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T22:30:20.561 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.559+0000 7f00e77d3140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T22:30:20.568 DEBUG:teuthology.orchestra.run.trial125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:30:20.612 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:20.610+0000 7f27ff991140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:30:20.613 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:20.610+0000 7f00e77d3140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:30:20.660 INFO:teuthology.misc.health.trial125.stdout: 2026-02-22T22:30:20.660 INFO:teuthology.misc.health.trial125.stdout:{"epoch":6,"fsid":"d59c90c8-7ec2-4873-b6be-8a8b1253060c","created":"2026-02-22T22:30:19.256654+0000","modified":"2026-02-22T22:30:20.000127+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:30:20.000127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9be3c328-d53f-4b08-9d13-b41135afbf9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f2ef6e5-b1eb-44a4-a94d-10e412019f03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a3c5816-481d-453e-b015-51cd5c58442d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"210204fa-693c-4cd1-94ec-2bdd5376f34b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:30:20.666 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-22T22:30:21.008 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:21.006+0000 7f00e77d3140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T22:30:21.009 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:21.007+0000 7f27ff991140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T22:30:21.031 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:21.029+0000 7f27ff991140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T22:30:21.031 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:21.029+0000 7f00e77d3140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T22:30:21.366 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:21.364+0000 7f27ff991140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T22:30:21.369 INFO:tasks.ceph.mgr.y.trial144.stderr:2026-02-22T22:30:21.367+0000 7f00e77d3140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T22:30:21.483 INFO:tasks.ceph.osd.3.trial144.stderr:2026-02-22T22:30:21.481+0000 7f5ad1c97780 -1 Falling back to public interface 2026-02-22T22:30:21.704 INFO:tasks.ceph.osd.1.trial125.stderr:2026-02-22T22:30:21.702+0000 7feb461f9780 -1 Falling back to public interface 2026-02-22T22:30:21.719 INFO:tasks.ceph.osd.2.trial144.stderr:2026-02-22T22:30:21.717+0000 7f979ee0e780 -1 Falling back to public interface 2026-02-22T22:30:21.930 INFO:tasks.ceph.osd.0.trial125.stderr:2026-02-22T22:30:21.928+0000 7f87b922f780 -1 Falling back to public interface 2026-02-22T22:30:22.377 INFO:tasks.ceph.mgr.x.trial125.stderr:2026-02-22T22:30:22.374+0000 7f271d118640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-22T22:30:24.185 INFO:tasks.ceph.osd.3.trial144.stderr:2026-02-22T22:30:24.183+0000 7f5ad1c97780 -1 osd.3 0 log_to_monitors true 2026-02-22T22:30:24.409 INFO:tasks.ceph.osd.1.trial125.stderr:2026-02-22T22:30:24.407+0000 7feb461f9780 -1 osd.1 0 log_to_monitors true 2026-02-22T22:30:24.410 INFO:tasks.ceph.osd.2.trial144.stderr:2026-02-22T22:30:24.408+0000 7f979ee0e780 -1 osd.2 0 log_to_monitors true 2026-02-22T22:30:24.612 INFO:tasks.ceph.osd.0.trial125.stderr:2026-02-22T22:30:24.611+0000 7f87b922f780 -1 osd.0 0 log_to_monitors true 2026-02-22T22:30:25.396 INFO:tasks.ceph.osd.3.trial144.stderr:2026-02-22T22:30:25.394+0000 7f5acdc26640 -1 osd.3 0 waiting for initial osdmap 2026-02-22T22:30:25.397 INFO:tasks.ceph.osd.3.trial144.stderr:2026-02-22T22:30:25.395+0000 7f5ac5a48640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:30:26.394 INFO:tasks.ceph.osd.0.trial125.stderr:2026-02-22T22:30:26.392+0000 7f87b47c3640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T22:30:26.394 INFO:tasks.ceph.osd.1.trial125.stderr:2026-02-22T22:30:26.392+0000 7feb42188640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T22:30:26.395 INFO:tasks.ceph.osd.1.trial125.stderr:2026-02-22T22:30:26.393+0000 7feb39faa640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:30:26.396 INFO:tasks.ceph.osd.0.trial125.stderr:2026-02-22T22:30:26.393+0000 7f87ac5e5640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:30:26.396 INFO:tasks.ceph.osd.2.trial144.stderr:2026-02-22T22:30:26.394+0000 7f979a6f9640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T22:30:26.397 INFO:tasks.ceph.osd.2.trial144.stderr:2026-02-22T22:30:26.395+0000 7f979251b640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:30:27.069 DEBUG:teuthology.orchestra.run.trial125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:30:27.221 INFO:teuthology.misc.health.trial125.stdout: 2026-02-22T22:30:27.222 INFO:teuthology.misc.health.trial125.stdout:{"epoch":9,"fsid":"d59c90c8-7ec2-4873-b6be-8a8b1253060c","created":"2026-02-22T22:30:19.256654+0000","modified":"2026-02-22T22:30:26.379404+0000","last_up_change":"2026-02-22T22:30:26.379404+0000","last_in_change":"2026-02-22T22:30:20.000127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9be3c328-d53f-4b08-9d13-b41135afbf9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f2ef6e5-b1eb-44a4-a94d-10e412019f03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4a3c5816-481d-453e-b015-51cd5c58442d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"210204fa-693c-4cd1-94ec-2bdd5376f34b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6800","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6801","nonce":3084229140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6802","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6803","nonce":3084229140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6806","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6807","nonce":3084229140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6804","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6805","nonce":3084229140}]},"public_addr":"10.20.193.144:6801/3084229140","cluster_addr":"10.20.193.144:6803/3084229140","heartbeat_back_addr":"10.20.193.144:6807/3084229140","heartbeat_front_addr":"10.20.193.144:6805/3084229140","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:30:27.228 DEBUG:teuthology.misc:1 of 4 OSDs are up 2026-02-22T22:30:33.632 DEBUG:teuthology.orchestra.run.trial125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:30:33.784 INFO:teuthology.misc.health.trial125.stdout: 2026-02-22T22:30:33.784 INFO:teuthology.misc.health.trial125.stdout:{"epoch":14,"fsid":"d59c90c8-7ec2-4873-b6be-8a8b1253060c","created":"2026-02-22T22:30:19.256654+0000","modified":"2026-02-22T22:30:31.395432+0000","last_up_change":"2026-02-22T22:30:27.386471+0000","last_in_change":"2026-02-22T22:30:20.000127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:30:29.380769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9be3c328-d53f-4b08-9d13-b41135afbf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6810","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6811","nonce":489417350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6812","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6813","nonce":489417350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6816","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6817","nonce":489417350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6814","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6815","nonce":489417350}]},"public_addr":"10.20.193.125:6811/489417350","cluster_addr":"10.20.193.125:6813/489417350","heartbeat_back_addr":"10.20.193.125:6817/489417350","heartbeat_front_addr":"10.20.193.125:6815/489417350","state":["exists","up"]},{"osd":1,"uuid":"3f2ef6e5-b1eb-44a4-a94d-10e412019f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6802","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6803","nonce":4038169865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6804","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6805","nonce":4038169865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6808","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6809","nonce":4038169865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6806","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6807","nonce":4038169865}]},"public_addr":"10.20.193.125:6803/4038169865","cluster_addr":"10.20.193.125:6805/4038169865","heartbeat_back_addr":"10.20.193.125:6809/4038169865","heartbeat_front_addr":"10.20.193.125:6807/4038169865","state":["exists","up"]},{"osd":2,"uuid":"4a3c5816-481d-453e-b015-51cd5c58442d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6808","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6809","nonce":304017367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6810","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6811","nonce":304017367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6814","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6815","nonce":304017367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6812","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6813","nonce":304017367}]},"public_addr":"10.20.193.144:6809/304017367","cluster_addr":"10.20.193.144:6811/304017367","heartbeat_back_addr":"10.20.193.144:6815/304017367","heartbeat_front_addr":"10.20.193.144:6813/304017367","state":["exists","up"]},{"osd":3,"uuid":"210204fa-693c-4cd1-94ec-2bdd5376f34b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6800","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6801","nonce":3084229140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6802","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6803","nonce":3084229140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6806","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6807","nonce":3084229140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6804","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6805","nonce":3084229140}]},"public_addr":"10.20.193.144:6801/3084229140","cluster_addr":"10.20.193.144:6803/3084229140","heartbeat_back_addr":"10.20.193.144:6807/3084229140","heartbeat_front_addr":"10.20.193.144:6805/3084229140","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.566284+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.365959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.375505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.156486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:30:33.792 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-22T22:30:33.792 INFO:tasks.ceph:Creating RBD pool 2026-02-22T22:30:33.793 DEBUG:teuthology.orchestra.run.trial125:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T22:30:34.405 INFO:teuthology.orchestra.run.trial125.stderr:pool 'rbd' created 2026-02-22T22:30:34.416 DEBUG:teuthology.orchestra.run.trial125:> rbd --cluster ceph pool init rbd 2026-02-22T22:30:38.420 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T22:30:38.421 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T22:30:38.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T22:30:38.421 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T22:30:38.422 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T22:30:38.604 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:38.611 INFO:teuthology.orchestra.run.trial125.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6800","nonce":2077763772},{"type":"v1","addr":"10.20.193.125:6801","nonce":2077763772}]},"active_addr":"10.20.193.125:6801/2077763772","active_change":"2026-02-22T22:30:21.366495+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.125:0","nonce":4262886436}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.125:0","nonce":3671149000}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.125:0","nonce":2732254182}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.125:0","nonce":2883319388}]}]} 2026-02-22T22:30:38.618 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T22:30:38.618 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T22:30:38.618 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:30:38.779 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:38.779 INFO:teuthology.orchestra.run.trial125.stdout:{"epoch":19,"fsid":"d59c90c8-7ec2-4873-b6be-8a8b1253060c","created":"2026-02-22T22:30:19.256654+0000","modified":"2026-02-22T22:30:38.410580+0000","last_up_change":"2026-02-22T22:30:27.386471+0000","last_in_change":"2026-02-22T22:30:20.000127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:30:29.380769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:30:33.953209+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9be3c328-d53f-4b08-9d13-b41135afbf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6810","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6811","nonce":489417350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6812","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6813","nonce":489417350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6816","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6817","nonce":489417350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6814","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6815","nonce":489417350}]},"public_addr":"10.20.193.125:6811/489417350","cluster_addr":"10.20.193.125:6813/489417350","heartbeat_back_addr":"10.20.193.125:6817/489417350","heartbeat_front_addr":"10.20.193.125:6815/489417350","state":["exists","up"]},{"osd":1,"uuid":"3f2ef6e5-b1eb-44a4-a94d-10e412019f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6802","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6803","nonce":4038169865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6804","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6805","nonce":4038169865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6808","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6809","nonce":4038169865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6806","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6807","nonce":4038169865}]},"public_addr":"10.20.193.125:6803/4038169865","cluster_addr":"10.20.193.125:6805/4038169865","heartbeat_back_addr":"10.20.193.125:6809/4038169865","heartbeat_front_addr":"10.20.193.125:6807/4038169865","state":["exists","up"]},{"osd":2,"uuid":"4a3c5816-481d-453e-b015-51cd5c58442d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6808","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6809","nonce":304017367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6810","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6811","nonce":304017367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6814","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6815","nonce":304017367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6812","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6813","nonce":304017367}]},"public_addr":"10.20.193.144:6809/304017367","cluster_addr":"10.20.193.144:6811/304017367","heartbeat_back_addr":"10.20.193.144:6815/304017367","heartbeat_front_addr":"10.20.193.144:6813/304017367","state":["exists","up"]},{"osd":3,"uuid":"210204fa-693c-4cd1-94ec-2bdd5376f34b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6800","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6801","nonce":3084229140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6802","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6803","nonce":3084229140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6806","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6807","nonce":3084229140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6804","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6805","nonce":3084229140}]},"public_addr":"10.20.193.144:6801/3084229140","cluster_addr":"10.20.193.144:6803/3084229140","heartbeat_back_addr":"10.20.193.144:6807/3084229140","heartbeat_front_addr":"10.20.193.144:6805/3084229140","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.566284+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.365959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.375505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.156486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:30:38.788 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T22:30:38.789 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:30:38.946 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:38.947 INFO:teuthology.orchestra.run.trial125.stdout:{"epoch":19,"fsid":"d59c90c8-7ec2-4873-b6be-8a8b1253060c","created":"2026-02-22T22:30:19.256654+0000","modified":"2026-02-22T22:30:38.410580+0000","last_up_change":"2026-02-22T22:30:27.386471+0000","last_in_change":"2026-02-22T22:30:20.000127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:30:29.380769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:30:33.953209+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9be3c328-d53f-4b08-9d13-b41135afbf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6810","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6811","nonce":489417350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6812","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6813","nonce":489417350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6816","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6817","nonce":489417350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6814","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6815","nonce":489417350}]},"public_addr":"10.20.193.125:6811/489417350","cluster_addr":"10.20.193.125:6813/489417350","heartbeat_back_addr":"10.20.193.125:6817/489417350","heartbeat_front_addr":"10.20.193.125:6815/489417350","state":["exists","up"]},{"osd":1,"uuid":"3f2ef6e5-b1eb-44a4-a94d-10e412019f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6802","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6803","nonce":4038169865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6804","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6805","nonce":4038169865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6808","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6809","nonce":4038169865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6806","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6807","nonce":4038169865}]},"public_addr":"10.20.193.125:6803/4038169865","cluster_addr":"10.20.193.125:6805/4038169865","heartbeat_back_addr":"10.20.193.125:6809/4038169865","heartbeat_front_addr":"10.20.193.125:6807/4038169865","state":["exists","up"]},{"osd":2,"uuid":"4a3c5816-481d-453e-b015-51cd5c58442d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6808","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6809","nonce":304017367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6810","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6811","nonce":304017367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6814","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6815","nonce":304017367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6812","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6813","nonce":304017367}]},"public_addr":"10.20.193.144:6809/304017367","cluster_addr":"10.20.193.144:6811/304017367","heartbeat_back_addr":"10.20.193.144:6815/304017367","heartbeat_front_addr":"10.20.193.144:6813/304017367","state":["exists","up"]},{"osd":3,"uuid":"210204fa-693c-4cd1-94ec-2bdd5376f34b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6800","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6801","nonce":3084229140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6802","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6803","nonce":3084229140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6806","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6807","nonce":3084229140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6804","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6805","nonce":3084229140}]},"public_addr":"10.20.193.144:6801/3084229140","cluster_addr":"10.20.193.144:6803/3084229140","heartbeat_back_addr":"10.20.193.144:6807/3084229140","heartbeat_front_addr":"10.20.193.144:6805/3084229140","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.566284+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.365959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.375505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.156486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:30:38.956 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T22:30:38.957 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T22:30:38.957 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T22:30:38.958 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-22T22:30:39.048 INFO:teuthology.orchestra.run.trial125.stdout:42949672964 2026-02-22T22:30:39.048 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T22:30:39.050 INFO:teuthology.orchestra.run.trial125.stdout:38654705669 2026-02-22T22:30:39.050 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T22:30:39.051 INFO:teuthology.orchestra.run.trial125.stdout:42949672965 2026-02-22T22:30:39.052 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T22:30:39.053 INFO:teuthology.orchestra.run.trial125.stdout:42949672966 2026-02-22T22:30:39.053 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T22:30:39.253 INFO:teuthology.orchestra.run.trial125.stdout:38654705668 2026-02-22T22:30:39.254 INFO:teuthology.orchestra.run.trial125.stdout:42949672962 2026-02-22T22:30:39.255 INFO:teuthology.orchestra.run.trial125.stdout:42949672964 2026-02-22T22:30:39.263 INFO:teuthology.orchestra.run.trial125.stdout:42949672963 2026-02-22T22:30:39.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672962 for osd.1 2026-02-22T22:30:39.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2026-02-22T22:30:39.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672964 for osd.0 2026-02-22T22:30:39.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672963 for osd.2 2026-02-22T22:30:40.265 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T22:30:40.266 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T22:30:40.267 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T22:30:40.275 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T22:30:40.429 INFO:teuthology.orchestra.run.trial125.stdout:42949672964 2026-02-22T22:30:40.431 INFO:teuthology.orchestra.run.trial125.stdout:38654705669 2026-02-22T22:30:40.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672964 for osd.1 2026-02-22T22:30:40.439 DEBUG:teuthology.parallel:result is None 2026-02-22T22:30:40.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2026-02-22T22:30:40.440 DEBUG:teuthology.parallel:result is None 2026-02-22T22:30:40.468 INFO:teuthology.orchestra.run.trial125.stdout:42949672966 2026-02-22T22:30:40.469 INFO:teuthology.orchestra.run.trial125.stdout:42949672965 2026-02-22T22:30:40.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.0 2026-02-22T22:30:40.479 DEBUG:teuthology.parallel:result is None 2026-02-22T22:30:40.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2026-02-22T22:30:40.479 DEBUG:teuthology.parallel:result is None 2026-02-22T22:30:40.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T22:30:40.479 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:30:40.677 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:40.678 INFO:teuthology.orchestra.run.trial125.stderr:dumped all 2026-02-22T22:30:40.686 INFO:teuthology.orchestra.run.trial125.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-22T22:30:39.371237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":419430400,"kb_used":109664,"kb_used_data":1792,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":419320736,"statfs":{"total":429496729600,"available":429384433664,"internally_reserved":0,"allocated":1835008,"data_stored":1389259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6372,"internal_metadata":110356252},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000534"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413450+0000","last_change":"2026-02-22T22:30:38.413555+0000","last_active":"2026-02-22T22:30:38.413450+0000","last_peered":"2026-02-22T22:30:38.413450+0000","last_clean":"2026-02-22T22:30:38.413450+0000","last_became_active":"2026-02-22T22:30:36.591519+0000","last_became_peered":"2026-02-22T22:30:36.591519+0000","last_unstale":"2026-02-22T22:30:38.413450+0000","last_undegraded":"2026-02-22T22:30:38.413450+0000","last_fullsized":"2026-02-22T22:30:38.413450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:19.496798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041129399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.415816+0000","last_change":"2026-02-22T22:30:38.415953+0000","last_active":"2026-02-22T22:30:38.415816+0000","last_peered":"2026-02-22T22:30:38.415816+0000","last_clean":"2026-02-22T22:30:38.415816+0000","last_became_active":"2026-02-22T22:30:35.408995+0000","last_became_peered":"2026-02-22T22:30:35.408995+0000","last_unstale":"2026-02-22T22:30:38.415816+0000","last_undegraded":"2026-02-22T22:30:38.415816+0000","last_fullsized":"2026-02-22T22:30:38.415816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:30:01.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037231999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413312+0000","last_change":"2026-02-22T22:30:38.413472+0000","last_active":"2026-02-22T22:30:38.413312+0000","last_peered":"2026-02-22T22:30:38.413312+0000","last_clean":"2026-02-22T22:30:38.413312+0000","last_became_active":"2026-02-22T22:30:36.410557+0000","last_became_peered":"2026-02-22T22:30:36.410557+0000","last_unstale":"2026-02-22T22:30:38.413312+0000","last_undegraded":"2026-02-22T22:30:38.413312+0000","last_fullsized":"2026-02-22T22:30:38.413312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:45.288096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032036500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.415707+0000","last_change":"2026-02-22T22:30:38.415783+0000","last_active":"2026-02-22T22:30:38.415707+0000","last_peered":"2026-02-22T22:30:38.415707+0000","last_clean":"2026-02-22T22:30:38.415707+0000","last_became_active":"2026-02-22T22:30:35.887940+0000","last_became_peered":"2026-02-22T22:30:35.887940+0000","last_unstale":"2026-02-22T22:30:38.415707+0000","last_undegraded":"2026-02-22T22:30:38.415707+0000","last_fullsized":"2026-02-22T22:30:38.415707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:01.676975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000214107,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.414683+0000","last_change":"2026-02-22T22:30:38.414683+0000","last_active":"2026-02-22T22:30:38.414683+0000","last_peered":"2026-02-22T22:30:38.414683+0000","last_clean":"2026-02-22T22:30:38.414683+0000","last_became_active":"2026-02-22T22:30:35.409017+0000","last_became_peered":"2026-02-22T22:30:35.409017+0000","last_unstale":"2026-02-22T22:30:38.414683+0000","last_undegraded":"2026-02-22T22:30:38.414683+0000","last_fullsized":"2026-02-22T22:30:38.414683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:13.064583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070440800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.415688+0000","last_change":"2026-02-22T22:30:38.415782+0000","last_active":"2026-02-22T22:30:38.415688+0000","last_peered":"2026-02-22T22:30:38.415688+0000","last_clean":"2026-02-22T22:30:38.415688+0000","last_became_active":"2026-02-22T22:30:35.887963+0000","last_became_peered":"2026-02-22T22:30:35.887963+0000","last_unstale":"2026-02-22T22:30:38.415688+0000","last_undegraded":"2026-02-22T22:30:38.415688+0000","last_fullsized":"2026-02-22T22:30:38.415688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:41.957432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024748899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.414158+0000","last_change":"2026-02-22T22:30:38.414286+0000","last_active":"2026-02-22T22:30:38.414158+0000","last_peered":"2026-02-22T22:30:38.414158+0000","last_clean":"2026-02-22T22:30:38.414158+0000","last_became_active":"2026-02-22T22:30:35.887628+0000","last_became_peered":"2026-02-22T22:30:35.887628+0000","last_unstale":"2026-02-22T22:30:38.414158+0000","last_undegraded":"2026-02-22T22:30:38.414158+0000","last_fullsized":"2026-02-22T22:30:38.414158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:35:51.047603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031158800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413269+0000","last_change":"2026-02-22T22:30:38.413409+0000","last_active":"2026-02-22T22:30:38.413269+0000","last_peered":"2026-02-22T22:30:38.413269+0000","last_clean":"2026-02-22T22:30:38.413269+0000","last_became_active":"2026-02-22T22:30:36.591493+0000","last_became_peered":"2026-02-22T22:30:36.591493+0000","last_unstale":"2026-02-22T22:30:38.413269+0000","last_undegraded":"2026-02-22T22:30:38.413269+0000","last_fullsized":"2026-02-22T22:30:38.413269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:58:56.103153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030094900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413065+0000","last_change":"2026-02-22T22:30:30.421179+0000","last_active":"2026-02-22T22:30:38.413065+0000","last_peered":"2026-02-22T22:30:38.413065+0000","last_clean":"2026-02-22T22:30:38.413065+0000","last_became_active":"2026-02-22T22:30:30.420650+0000","last_became_peered":"2026-02-22T22:30:30.420650+0000","last_unstale":"2026-02-22T22:30:38.413065+0000","last_undegraded":"2026-02-22T22:30:38.413065+0000","last_fullsized":"2026-02-22T22:30:38.413065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_clean_scrub_stamp":"2026-02-22T22:30:29.389678+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:39.255558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27708,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829892,"statfs":{"total":107374182400,"available":107345809408,"internally_reserved":0,"allocated":753664,"data_stored":640450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829896,"statfs":{"total":107374182400,"available":107345813504,"internally_reserved":0,"allocated":757760,"data_stored":644542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":54193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27120,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830480,"statfs":{"total":107374182400,"available":107346411520,"internally_reserved":0,"allocated":155648,"data_stored":50074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:30:40.687 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:30:40.845 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:40.846 INFO:teuthology.orchestra.run.trial125.stderr:dumped all 2026-02-22T22:30:40.854 INFO:teuthology.orchestra.run.trial125.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-22T22:30:39.371237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":419430400,"kb_used":109664,"kb_used_data":1792,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":419320736,"statfs":{"total":429496729600,"available":429384433664,"internally_reserved":0,"allocated":1835008,"data_stored":1389259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6372,"internal_metadata":110356252},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000534"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413450+0000","last_change":"2026-02-22T22:30:38.413555+0000","last_active":"2026-02-22T22:30:38.413450+0000","last_peered":"2026-02-22T22:30:38.413450+0000","last_clean":"2026-02-22T22:30:38.413450+0000","last_became_active":"2026-02-22T22:30:36.591519+0000","last_became_peered":"2026-02-22T22:30:36.591519+0000","last_unstale":"2026-02-22T22:30:38.413450+0000","last_undegraded":"2026-02-22T22:30:38.413450+0000","last_fullsized":"2026-02-22T22:30:38.413450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:19.496798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041129399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.415816+0000","last_change":"2026-02-22T22:30:38.415953+0000","last_active":"2026-02-22T22:30:38.415816+0000","last_peered":"2026-02-22T22:30:38.415816+0000","last_clean":"2026-02-22T22:30:38.415816+0000","last_became_active":"2026-02-22T22:30:35.408995+0000","last_became_peered":"2026-02-22T22:30:35.408995+0000","last_unstale":"2026-02-22T22:30:38.415816+0000","last_undegraded":"2026-02-22T22:30:38.415816+0000","last_fullsized":"2026-02-22T22:30:38.415816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:30:01.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037231999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413312+0000","last_change":"2026-02-22T22:30:38.413472+0000","last_active":"2026-02-22T22:30:38.413312+0000","last_peered":"2026-02-22T22:30:38.413312+0000","last_clean":"2026-02-22T22:30:38.413312+0000","last_became_active":"2026-02-22T22:30:36.410557+0000","last_became_peered":"2026-02-22T22:30:36.410557+0000","last_unstale":"2026-02-22T22:30:38.413312+0000","last_undegraded":"2026-02-22T22:30:38.413312+0000","last_fullsized":"2026-02-22T22:30:38.413312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:45.288096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032036500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.415707+0000","last_change":"2026-02-22T22:30:38.415783+0000","last_active":"2026-02-22T22:30:38.415707+0000","last_peered":"2026-02-22T22:30:38.415707+0000","last_clean":"2026-02-22T22:30:38.415707+0000","last_became_active":"2026-02-22T22:30:35.887940+0000","last_became_peered":"2026-02-22T22:30:35.887940+0000","last_unstale":"2026-02-22T22:30:38.415707+0000","last_undegraded":"2026-02-22T22:30:38.415707+0000","last_fullsized":"2026-02-22T22:30:38.415707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:01.676975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000214107,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.414683+0000","last_change":"2026-02-22T22:30:38.414683+0000","last_active":"2026-02-22T22:30:38.414683+0000","last_peered":"2026-02-22T22:30:38.414683+0000","last_clean":"2026-02-22T22:30:38.414683+0000","last_became_active":"2026-02-22T22:30:35.409017+0000","last_became_peered":"2026-02-22T22:30:35.409017+0000","last_unstale":"2026-02-22T22:30:38.414683+0000","last_undegraded":"2026-02-22T22:30:38.414683+0000","last_fullsized":"2026-02-22T22:30:38.414683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:13.064583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070440800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.415688+0000","last_change":"2026-02-22T22:30:38.415782+0000","last_active":"2026-02-22T22:30:38.415688+0000","last_peered":"2026-02-22T22:30:38.415688+0000","last_clean":"2026-02-22T22:30:38.415688+0000","last_became_active":"2026-02-22T22:30:35.887963+0000","last_became_peered":"2026-02-22T22:30:35.887963+0000","last_unstale":"2026-02-22T22:30:38.415688+0000","last_undegraded":"2026-02-22T22:30:38.415688+0000","last_fullsized":"2026-02-22T22:30:38.415688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:41.957432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024748899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.414158+0000","last_change":"2026-02-22T22:30:38.414286+0000","last_active":"2026-02-22T22:30:38.414158+0000","last_peered":"2026-02-22T22:30:38.414158+0000","last_clean":"2026-02-22T22:30:38.414158+0000","last_became_active":"2026-02-22T22:30:35.887628+0000","last_became_peered":"2026-02-22T22:30:35.887628+0000","last_unstale":"2026-02-22T22:30:38.414158+0000","last_undegraded":"2026-02-22T22:30:38.414158+0000","last_fullsized":"2026-02-22T22:30:38.414158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:35:51.047603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031158800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413269+0000","last_change":"2026-02-22T22:30:38.413409+0000","last_active":"2026-02-22T22:30:38.413269+0000","last_peered":"2026-02-22T22:30:38.413269+0000","last_clean":"2026-02-22T22:30:38.413269+0000","last_became_active":"2026-02-22T22:30:36.591493+0000","last_became_peered":"2026-02-22T22:30:36.591493+0000","last_unstale":"2026-02-22T22:30:38.413269+0000","last_undegraded":"2026-02-22T22:30:38.413269+0000","last_fullsized":"2026-02-22T22:30:38.413269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:58:56.103153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030094900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T22:30:38.413065+0000","last_change":"2026-02-22T22:30:30.421179+0000","last_active":"2026-02-22T22:30:38.413065+0000","last_peered":"2026-02-22T22:30:38.413065+0000","last_clean":"2026-02-22T22:30:38.413065+0000","last_became_active":"2026-02-22T22:30:30.420650+0000","last_became_peered":"2026-02-22T22:30:30.420650+0000","last_unstale":"2026-02-22T22:30:38.413065+0000","last_undegraded":"2026-02-22T22:30:38.413065+0000","last_fullsized":"2026-02-22T22:30:38.413065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_clean_scrub_stamp":"2026-02-22T22:30:29.389678+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:39.255558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27708,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829892,"statfs":{"total":107374182400,"available":107345809408,"internally_reserved":0,"allocated":753664,"data_stored":640450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829896,"statfs":{"total":107374182400,"available":107345813504,"internally_reserved":0,"allocated":757760,"data_stored":644542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":54193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27120,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830480,"statfs":{"total":107374182400,"available":107346411520,"internally_reserved":0,"allocated":155648,"data_stored":50074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:30:40.854 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T22:30:40.855 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T22:30:40.855 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T22:30:40.855 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T22:30:41.028 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:30:41.028 INFO:teuthology.orchestra.run.trial125.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T22:30:41.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T22:30:41.037 INFO:teuthology.run_tasks:Running task exec... 2026-02-22T22:30:41.047 INFO:teuthology.task.exec:Executing custom commands... 2026-02-22T22:30:41.047 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:30:41.047 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir /home/ubuntu/cephtest/tmpfs' 2026-02-22T22:30:41.075 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir /home/ubuntu/cephtest/rbd-pwl-cache' 2026-02-22T22:30:41.140 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mount -t tmpfs -o size=20G tmpfs /home/ubuntu/cephtest/tmpfs' 2026-02-22T22:30:41.213 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'truncate -s 20G /home/ubuntu/cephtest/tmpfs/loopfile' 2026-02-22T22:30:41.279 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkfs.ext4 /home/ubuntu/cephtest/tmpfs/loopfile' 2026-02-22T22:30:41.343 INFO:teuthology.orchestra.run.trial144.stderr:mke2fs 1.46.5 (30-Dec-2021) 2026-02-22T22:30:41.344 INFO:teuthology.orchestra.run.trial144.stdout:Discarding device blocks: 0/5242880 done 2026-02-22T22:30:41.344 INFO:teuthology.orchestra.run.trial144.stdout:Creating filesystem with 5242880 4k blocks and 1310720 inodes 2026-02-22T22:30:41.345 INFO:teuthology.orchestra.run.trial144.stdout:Filesystem UUID: 3f8ddc4b-2753-497d-8721-189f22d5ab37 2026-02-22T22:30:41.345 INFO:teuthology.orchestra.run.trial144.stdout:Superblock backups stored on blocks: 2026-02-22T22:30:41.345 INFO:teuthology.orchestra.run.trial144.stdout: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, 2026-02-22T22:30:41.345 INFO:teuthology.orchestra.run.trial144.stdout: 4096000 2026-02-22T22:30:41.345 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:41.345 INFO:teuthology.orchestra.run.trial144.stdout:Allocating group tables: 0/160 done 2026-02-22T22:30:41.345 INFO:teuthology.orchestra.run.trial144.stdout:Writing inode tables: 0/160 done 2026-02-22T22:30:41.346 INFO:teuthology.orchestra.run.trial144.stdout:Creating journal (32768 blocks): done 2026-02-22T22:30:41.346 INFO:teuthology.orchestra.run.trial144.stdout:Writing superblocks and filesystem accounting information: 0/160 done 2026-02-22T22:30:41.346 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:30:41.347 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mount -o loop /home/ubuntu/cephtest/tmpfs/loopfile /home/ubuntu/cephtest/rbd-pwl-cache' 2026-02-22T22:30:41.449 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo chmod 777 /home/ubuntu/cephtest/rbd-pwl-cache' 2026-02-22T22:30:41.482 INFO:teuthology.run_tasks:Running task exec_on_cleanup... 2026-02-22T22:30:41.499 INFO:teuthology.run_tasks:Running task qemu... 2026-02-22T22:30:41.537 INFO:tasks.rbd:Creating image client.0.1 with size 10240 2026-02-22T22:30:41.537 DEBUG:teuthology.orchestra.run.trial144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd --cluster ceph -p rbd create --size 10240 client.0.1 --image-format 2 2026-02-22T22:30:41.585 INFO:tasks.rbd:Creating image client.0.2 with size 10240 2026-02-22T22:30:41.585 DEBUG:teuthology.orchestra.run.trial144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd --cluster ceph -p rbd create --size 10240 client.0.2 --image-format 2 2026-02-22T22:30:41.632 DEBUG:teuthology.orchestra.run.trial144:> install -d -m0755 -- /home/ubuntu/cephtest/qemu /home/ubuntu/cephtest/archive/qemu 2026-02-22T22:30:41.649 INFO:teuthology.packaging:Installing package qemu-kvm-block-rbd on ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:30:41.649 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y install qemu-kvm-block-rbd 2026-02-22T22:30:42.001 INFO:teuthology.orchestra.run.trial144.stdout:Last metadata expiration check: 0:01:40 ago on Sun 22 Feb 2026 10:29:02 PM UTC. 2026-02-22T22:30:42.066 INFO:teuthology.orchestra.run.trial144.stdout:Package qemu-kvm-block-rbd-17:10.1.0-13.el9.x86_64 is already installed. 2026-02-22T22:30:42.084 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:30:42.085 INFO:teuthology.orchestra.run.trial144.stdout:Nothing to do. 2026-02-22T22:30:42.085 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:30:42.107 INFO:tasks.qemu:generating iso... 2026-02-22T22:30:42.107 INFO:tasks.qemu:Pulling tests from https://github.com/ceph/ceph-ci.git ref f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:30:42.108 DEBUG:teuthology.orchestra.run.trial144:> rm -rf /home/ubuntu/cephtest/qemu_clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/qemu_clone.client.0 && cd /home/ubuntu/cephtest/qemu_clone.client.0 && git checkout f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:30:42.132 INFO:teuthology.orchestra.run.trial144.stderr:Cloning into '/home/ubuntu/cephtest/qemu_clone.client.0'... 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr:Note: switching to 'f90f4eaebb28b619cf76e80cbbe997656da69579'. 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr:state without impacting any branches by switching back to a branch. 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-22T22:31:02.331 INFO:teuthology.orchestra.run.trial144.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr: git switch -c 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr:Or undo this operation with: 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr: git switch - 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:31:02.332 INFO:teuthology.orchestra.run.trial144.stderr:HEAD is now at f90f4eaebb2 Merge branch 'wip-74712-squid' of https://github.com/idryomov/ceph into wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:31:02.337 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:31:02.337 DEBUG:teuthology.orchestra.run.trial144:> dd of=/home/ubuntu/cephtest/qemu/userdata.client.0 2026-02-22T22:31:02.393 DEBUG:teuthology.orchestra.run.trial144:> set -ex 2026-02-22T22:31:02.393 DEBUG:teuthology.orchestra.run.trial144:> dd of=/home/ubuntu/cephtest/qemu/metadata.client.0 2026-02-22T22:31:02.449 INFO:tasks.qemu:fetching test qa/run_xfstests_qemu.sh for client.0 2026-02-22T22:31:02.450 DEBUG:teuthology.orchestra.run.trial144:> cp -- /home/ubuntu/cephtest/qemu_clone.client.0/qa/run_xfstests_qemu.sh /home/ubuntu/cephtest/qemu/client.0.test.sh && chmod 755 /home/ubuntu/cephtest/qemu/client.0.test.sh 2026-02-22T22:31:02.506 DEBUG:teuthology.orchestra.run.trial144:> genisoimage -quiet -input-charset utf-8 -volid cidata -joliet -rock -o /home/ubuntu/cephtest/qemu/client.0.iso -graft-points user-data=/home/ubuntu/cephtest/qemu/userdata.client.0 meta-data=/home/ubuntu/cephtest/qemu/metadata.client.0 ceph.conf=/etc/ceph/ceph.conf ceph.keyring=/etc/ceph/ceph.keyring test.sh=/home/ubuntu/cephtest/qemu/client.0.test.sh 2026-02-22T22:31:02.567 INFO:tasks.qemu:downloading base image 2026-02-22T22:31:02.567 DEBUG:teuthology.orchestra.run.trial144:> wget -nv -O /home/ubuntu/cephtest/qemu/base.client.0.0.qcow2 http://download.ceph.com/qa/ubuntu-12.04.qcow2 2026-02-22T22:31:42.291 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22 22:31:42 URL:http://download.ceph.com/qa/ubuntu-12.04.qcow2 [1206124544/1206124544] -> "/home/ubuntu/cephtest/qemu/base.client.0.0.qcow2" [1] 2026-02-22T22:31:42.292 DEBUG:teuthology.orchestra.run.trial144:> qemu-img convert -f qcow2 -O raw /home/ubuntu/cephtest/qemu/base.client.0.0.qcow2 rbd:rbd/client.0.0:conf=/etc/ceph/ceph.conf 2026-02-22T22:31:45.018 DEBUG:teuthology.orchestra.run.trial144:> rbd --cluster ceph resize --size=10240M client.0.0 || true 2026-02-22T22:31:45.062 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:31:45.060+0000 7fbffdd9b640 1 bdev(0x7fbfdc021f60 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.10772569b279.pool) open path /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.10772569b279.pool 2026-02-22T22:31:45.062 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:31:45.060+0000 7fbffdd9b640 0 bdev(0x7fbfdc021f60 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.10772569b279.pool) ioctl(F_SET_FILE_RW_HINT) on /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.10772569b279.pool failed: (22) Invalid argument 2026-02-22T22:31:45.062 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:31:45.061+0000 7fbffdd9b640 1 bdev(0x7fbfdc021f60 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.10772569b279.pool) open size 5368709120 (0x140000000, 5 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-22T22:31:45.066 INFO:teuthology.orchestra.run.trial144.stderr: Resizing image: 100% complete...done. 2026-02-22T22:31:45.066 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:31:45.064+0000 7fbfd5ffb640 1 bdev(0x7fbfdc021f60 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.10772569b279.pool) close 2026-02-22T22:31:45.333 DEBUG:teuthology.orchestra.run.trial144:> mkdir /home/ubuntu/cephtest/archive/qemu/client.0 && sudo modprobe kvm 2026-02-22T22:31:45.360 INFO:tasks.qemu:Creating the nfs export directory... 2026-02-22T22:31:45.360 DEBUG:teuthology.orchestra.run.trial144:> sudo mkdir -p /export/client.0 2026-02-22T22:31:45.425 INFO:tasks.qemu:Mounting the test directory... 2026-02-22T22:31:45.426 DEBUG:teuthology.orchestra.run.trial144:> sudo mount --bind /home/ubuntu/cephtest/archive/qemu/client.0 /export/client.0 2026-02-22T22:31:45.490 INFO:tasks.qemu:Adding mount to /etc/exports... 2026-02-22T22:31:45.490 INFO:tasks.qemu:Deleting export from /etc/exports... 2026-02-22T22:31:45.490 DEBUG:teuthology.orchestra.run.trial144:> sudo sed -i '\|/export/client.0|d' /etc/exports 2026-02-22T22:31:45.554 DEBUG:teuthology.orchestra.run.trial144:> echo '/export/client.0 *(rw,no_root_squash,no_subtree_check,insecure)' | sudo tee -a /etc/exports 2026-02-22T22:31:45.618 INFO:teuthology.orchestra.run.trial144.stdout:/export/client.0 *(rw,no_root_squash,no_subtree_check,insecure) 2026-02-22T22:31:45.619 INFO:tasks.qemu:Restarting NFS... 2026-02-22T22:31:45.620 DEBUG:teuthology.orchestra.run.trial144:> sudo systemctl restart nfs-server 2026-02-22T22:31:45.974 DEBUG:teuthology.orchestra.run.trial144:> sudo udevadm control --reload 2026-02-22T22:31:46.005 DEBUG:teuthology.orchestra.run.trial144:> sudo udevadm trigger /dev/kvm 2026-02-22T22:31:46.075 DEBUG:teuthology.orchestra.run.trial144:> ls -l /dev/kvm 2026-02-22T22:31:46.131 INFO:teuthology.orchestra.run.trial144.stdout:crw-rw-rw-. 1 root kvm 10, 232 Feb 22 22:31 /dev/kvm 2026-02-22T22:31:46.132 INFO:tasks.qemu:starting qemu... 2026-02-22T22:31:46.132 DEBUG:teuthology.orchestra.run.trial144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term /usr/libexec/qemu-kvm -enable-kvm -nographic -cpu host -smp 4 -m 4096 -cdrom /home/ubuntu/cephtest/qemu/client.0.iso -drive file=rbd:rbd/client.0.0:conf=/etc/ceph/ceph.conf:id=0,format=raw,if=virtio,cache=writeback -drive file=rbd:rbd/client.0.1:conf=/etc/ceph/ceph.conf:id=0,format=raw,if=virtio,cache=writeback -drive file=rbd:rbd/client.0.2:conf=/etc/ceph/ceph.conf:id=0,format=raw,if=virtio,cache=writeback 2026-02-22T22:31:46.174 DEBUG:teuthology.run_tasks:Unwinding manager qemu 2026-02-22T22:31:46.190 INFO:tasks.qemu:waiting for qemu tests to finish... 2026-02-22T22:31:46.355 INFO:tasks.qemu.client.0.trial144.stderr:qemu-kvm: warning: Machine type 'pc-i440fx-rhel7.6.0' is deprecated: machines from the previous RHEL major release are subject to deletion in the next RHEL major release 2026-02-22T22:31:46.427 INFO:tasks.qemu.client.0.trial144.stdout:c[?7lSeaBIOS (version 1.16.3-5.el9) 2026-02-22T22:31:46.427 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.427 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.428 INFO:tasks.qemu.client.0.trial144.stdout:iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFCCC40+BEF0CC40 CA00 2026-02-22T22:31:46.428 INFO:tasks.qemu.client.0.trial144.stdout:Press Ctrl-B to configure iPXE (PCI 00:03.0)... 2026-02-22T22:31:46.428 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.428 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.594 INFO:tasks.qemu.client.0.trial144.stdout:Booting from Hard Disk... 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout:GNU GRUB version 1.99-21ubuntu3.4┌──────────────────────────────────────────────────────────────────────────┐││││││││││││││││││││││││││└──────────────────────────────────────────────────────────────────────────┘ 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: Use the ↑ and ↓ keys to select which entry is highlighted. 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: Press enter to boot the selected OS, 'e' to edit the commands 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: before booting or 'c' for a command-line. 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout:  Ubuntu, with Linux 3.2.0-32-virtual  Ubuntu, with Linux 3.2.0-32-virtual (recovery mode) Memory test (memtest86+) Memory test (memtest86+, serial console 115200)           2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:46.857 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.767 INFO:tasks.qemu.client.0.trial144.stdout: The highlighted entry will be executed automatically in 5s.  2026-02-22T22:31:47.767 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.767 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.767 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.767 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.767 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.767 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:47.768 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.758 INFO:tasks.qemu.client.0.trial144.stdout: The highlighted entry will be executed automatically in 4s.  2026-02-22T22:31:48.758 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.758 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.758 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.758 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.758 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:48.759 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.760 INFO:tasks.qemu.client.0.trial144.stdout: The highlighted entry will be executed automatically in 3s.  2026-02-22T22:31:49.760 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.760 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.760 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.760 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.760 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.760 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:49.761 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.762 INFO:tasks.qemu.client.0.trial144.stdout: The highlighted entry will be executed automatically in 2s.  2026-02-22T22:31:50.762 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.762 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:50.763 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.774 INFO:tasks.qemu.client.0.trial144.stdout: The highlighted entry will be executed automatically in 1s.  2026-02-22T22:31:51.774 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.774 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.774 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.775 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.776 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.776 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.776 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.776 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:51.776 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout: The highlighted entry will be executed automatically in 0s. [ 0.000000] Initializing cgroup subsys cpuset 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Initializing cgroup subsys cpu 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Linux version 3.2.0-32-virtual (buildd@batsu) (gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) ) #51-Ubuntu SMP Wed Sep 26 21:53:42 UTC 2012 (Ubuntu 3.2.0-32.51-virtual 3.2.30) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.2.0-32-virtual root=LABEL=cloudimg-rootfs ro console=ttyS0 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] KERNEL supported cpus: 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Intel GenuineIntel 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] AMD AuthenticAMD 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Centaur CentaurHauls 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-provided physical RAM map: 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 0000000000100000 - 00000000bffd7000 (usable) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 00000000bffd7000 - 00000000c0000000 (reserved) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 00000000feffc000 - 00000000ff000000 (reserved) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] BIOS-e820: 0000000100000000 - 0000000140000000 (usable) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] NX (Execute Disable) protection: active 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] DMI 2.8 present. 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] No AGP bridge found 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] last_pfn = 0x140000 max_arch_pfn = 0x400000000 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] last_pfn = 0xbffd7 max_arch_pfn = 0x400000000 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] found SMP MP-table at [ffff8800000f5440] f5440 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Using GB pages for direct mapping 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] init_memory_mapping: 0000000000000000-00000000bffd7000 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] init_memory_mapping: 0000000100000000-0000000140000000 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] RAMDISK: 37786000 - 37bbb000 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: RSDP 00000000000f5400 00014 (v00 BOCHS ) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: RSDT 00000000bffe20a7 00030 (v01 BOCHS BXPC 00000001 BXPC 00000001) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: FACP 00000000bffe1f7b 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: DSDT 00000000bffdfd40 0223B (v01 BOCHS BXPC 00000001 BXPC 00000001) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: FACS 00000000bffdfd00 00040 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: APIC 00000000bffe1fef 00090 (v03 BOCHS BXPC 00000001 BXPC 00000001) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: WAET 00000000bffe207f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) 2026-02-22T22:31:52.384 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] No NUMA configuration found 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Faking a node at 0000000000000000-0000000140000000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Initmem setup node 0 0000000000000000-0000000140000000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] NODE_DATA [000000013fffb000 - 000000013fffffff] 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] kvm-clock: cpu 0, msr 0:1cf6681, boot clock 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Zone PFN ranges: 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] DMA 0x00000010 -> 0x00001000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] DMA32 0x00001000 -> 0x00100000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Normal 0x00100000 -> 0x00140000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Movable zone start PFN for each node 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] early_node_map[3] active PFN ranges 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] 0: 0x00000010 -> 0x0000009f 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] 0: 0x00000100 -> 0x000bffd7 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] 0: 0x00100000 -> 0x00140000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: PM-Timer IO Port: 0x608 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Using ACPI (MADT) for SMP configuration information 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] SMP: Allowing 4 CPUs, 0 hotplug CPUs 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 00000000bffd7000 - 00000000c0000000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 00000000c0000000 - 00000000feffc000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 00000000feffc000 - 00000000ff000000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 00000000ff000000 - 00000000fffc0000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PM: Registered nosave memory: 00000000fffc0000 - 0000000100000000 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Allocating PCI resources starting at c0000000 (gap: c0000000:3effc000) 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Booting paravirtualized kernel on KVM 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PERCPU: Embedded 28 pages/cpu @ffff88013fc00000 s82880 r8192 d23616 u524288 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] kvm-clock: cpu 0, msr 1:3fc13681, primary cpu clock 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] KVM setup async PF for cpu 0 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] kvm-stealtime: cpu 0, msr 13fc0dd40 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027937 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Policy zone: Normal 2026-02-22T22:31:52.385 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.2.0-32-virtual root=LABEL=cloudimg-rootfs ro console=ttyS0 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Checking aperture... 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] No AGP bridge found 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Memory: 4041548k/5242880k available (6532k kernel code, 1049192k absent, 152140k reserved, 6657k data, 924k init) 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Hierarchical RCU implementation. 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] RCU dyntick-idle grace-period acceleration is enabled. 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] NR_IRQS:4352 nr_irqs:712 16 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Console: colour VGA+ 80x25 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] console [ttyS0] enabled 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] allocated 33554432 bytes of page_cgroup 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Detected 3693.052 MHz processor. 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.000000] Marking TSC unstable due to TSCs unsynchronized 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.008000] Calibrating delay loop (skipped) preset value.. 7386.10 BogoMIPS (lpj=14772208) 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.008000] pid_max: default: 32768 minimum: 301 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.008000] Security Framework initialized 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.008008] AppArmor: AppArmor initialized 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.008667] Yama: becoming mindful. 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.009491] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.011186] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.012109] Mount-cache hash table entries: 256 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.012892] Initializing cgroup subsys cpuacct 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.013612] Initializing cgroup subsys memory 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.014315] Initializing cgroup subsys devices 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.015033] Initializing cgroup subsys freezer 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.016004] Initializing cgroup subsys blkio 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.016692] Initializing cgroup subsys perf_event 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.017644] mce: CPU supports 10 MCE banks 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.024798] ACPI: Core revision 20110623 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.025699] ftrace: allocating 27008 entries in 106 pages 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.032169] Enabling x2apic 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.032627] Enabled x2apic 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.033231] Switched APIC routing to physical x2apic. 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.034906] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 2026-02-22T22:31:52.386 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.036003] CPU0: AMD EPYC 4464P 12-Core Processor stepping 02 2026-02-22T22:31:52.477 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.040002] Performance Events: no PMU driver, software events only. 2026-02-22T22:31:52.477 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.040002] NMI watchdog disabled (cpu0): hardware events not enabled 2026-02-22T22:31:52.477 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.040002] Booting Node 0, Processors #1 2026-02-22T22:31:52.492 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.050212] NMI watchdog disabled (cpu1): hardware events not enabled 2026-02-22T22:31:52.492 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.050211] KVM setup async PF for cpu 1 2026-02-22T22:31:52.492 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.050211] kvm-stealtime: cpu 1, msr 13fc8dd40 2026-02-22T22:31:52.492 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.050211] kvm-clock: cpu 1, msr 1:3fc93681, secondary cpu clock 2026-02-22T22:31:52.493 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.052038] #2 2026-02-22T22:31:52.507 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.065259] NMI watchdog disabled (cpu2): hardware events not enabled 2026-02-22T22:31:52.507 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.065258] KVM setup async PF for cpu 2 2026-02-22T22:31:52.507 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.065258] kvm-stealtime: cpu 2, msr 13fd0dd40 2026-02-22T22:31:52.507 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.065258] kvm-clock: cpu 2, msr 1:3fd13681, secondary cpu clock 2026-02-22T22:31:52.507 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.068036] #3 Ok. 2026-02-22T22:31:52.524 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.080457] NMI watchdog disabled (cpu3): hardware events not enabled 2026-02-22T22:31:52.524 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.080456] KVM setup async PF for cpu 3 2026-02-22T22:31:52.524 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.080456] kvm-stealtime: cpu 3, msr 13fd8dd40 2026-02-22T22:31:52.525 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.080456] kvm-clock: cpu 3, msr 1:3fd93681, secondary cpu clock 2026-02-22T22:31:52.525 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.084017] Brought up 4 CPUs 2026-02-22T22:31:52.525 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.084625] Total of 4 processors activated (29544.41 BogoMIPS). 2026-02-22T22:31:52.525 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.086175] devtmpfs: initialized 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.088476] EVM: security.selinux 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.089012] EVM: security.SMACK64 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.089552] EVM: security.capability 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.090145] print_constraints: dummy: 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.090145] RTC time: 22:31:52, date: 02/22/26 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.090145] NET: Registered protocol family 16 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.092745] Extended Config Space enabled on 0 nodes 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.093579] ACPI: bus type pci registered 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.093592] Trying to unpack rootfs image as initramfs... 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.094017] PCI: Using configuration type 1 for base access 2026-02-22T22:31:52.562 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.096006] PCI: Using configuration type 1 for extended access 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.098637] bio: create slab at 0 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.099407] ACPI: Added _OSI(Module Device) 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.099407] ACPI: Added _OSI(Processor Device) 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.100007] ACPI: Added _OSI(3.0 _SCP Extensions) 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.100769] ACPI: Added _OSI(Processor Aggregator Device) 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.102674] ACPI: Interpreter enabled 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.103394] ACPI: (supports S0 S5) 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.104131] ACPI: Using IOAPIC for interrupt routing 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.105786] ACPI: No dock devices found. 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.106421] HEST: Table not found. 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.106969] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.108017] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.109020] pci_root PNP0A03:00: host bridge window [io 0x0000-0x0cf7] 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.110074] pci_root PNP0A03:00: host bridge window [io 0x0d00-0xffff] 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.111126] pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff] 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.112008] pci_root PNP0A03:00: host bridge window [mem 0xc0000000-0xfebfffff] 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.113173] pci_root PNP0A03:00: host bridge window [mem 0x380000000000-0x38007fffffff] 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.119574] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI 2026-02-22T22:31:52.563 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.120018] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB 2026-02-22T22:31:52.568 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.127917] Freeing initrd memory: 4308k freed 2026-02-22T22:31:52.646 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.144249] pci0000:00: Requesting ACPI _OSC control (0x1d) 2026-02-22T22:31:52.646 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.145154] pci0000:00: ACPI _OSC request failed (AE_NOT_FOUND), returned control mask: 0x1d 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.146509] ACPI _OSC control for PCIe not granted, disabling ASPM 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.148058] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.149119] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.150170] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.151222] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.152313] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.153228] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.153310] vgaarb: loaded 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.153773] vgaarb: bridge control possible 0000:00:02.0 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.154658] i2c-core: driver [aat2870] using legacy suspend method 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.156010] i2c-core: driver [aat2870] using legacy resume method 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.157009] SCSI subsystem initialized 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.158977] usbcore: registered new interface driver usbfs 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.158977] usbcore: registered new interface driver hub 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.160782] usbcore: registered new device driver usb 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.160856] PCI: Using ACPI for IRQ routing 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.160916] NetLabel: Initializing 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.161465] NetLabel: domain hash size = 128 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.162168] NetLabel: protocols = UNLABELED CIPSOv4 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.164014] NetLabel: unlabeled traffic allowed by default 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.164921] Switching to clocksource kvm-clock 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.166834] AppArmor: AppArmor Filesystem Enabled 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.166834] pnp: PnP ACPI init 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.167336] ACPI: bus type pnp registered 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.168196] pnp: PnP ACPI: found 9 devices 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.168852] ACPI: ACPI bus type pnp unregistered 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.175225] NET: Registered protocol family 2 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.175954] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.177572] TCP established hash table entries: 524288 (order: 11, 8388608 bytes) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.179511] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.180636] TCP: Hash tables configured (established 524288 bind 65536) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.181695] TCP reno registered 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.182211] UDP hash table entries: 2048 (order: 4, 65536 bytes) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.183178] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.184243] NET: Registered protocol family 1 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.184946] pci 0000:00:00.0: Limiting direct PCI/PCI transfers 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.185903] pci 0000:00:01.0: PIIX3: Enabling Passive Release 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.186858] pci 0000:00:01.0: Activating ISA DMA hang workarounds 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.187923] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.188960] Placing 64MB software IO TLB between ffff8800bbfd7000 - ffff8800bffd7000 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.190196] software IO TLB at phys 0xbbfd7000 - 0xbffd7000 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.191456] audit: initializing netlink socket (disabled) 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.192305] type=2000 audit(1771799512.188:1): initialized 2026-02-22T22:31:52.647 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.202492] HugeTLB registered 2 MB page size, pre-allocated 0 pages 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.204026] VFS: Disk quotas dquot_6.5.2 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.204660] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.205806] fuse init (API version 7.17) 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.206460] msgmni has been set to 7902 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.207289] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253) 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.208487] io scheduler noop registered 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.209104] io scheduler deadline registered (default) 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.209912] io scheduler cfq registered 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.210553] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.211497] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.212605] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.213753] ACPI: Power Button [PWRF] 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.214564] ERST: Table is not found! 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.215144] GHES: HEST is not enabled! 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.215996] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.216907] virtio-pci 0000:00:04.0: PCI INT A -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.218658] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.219568] virtio-pci 0000:00:05.0: PCI INT A -> Link[LNKA] -> GSI 10 (level, high) -> IRQ 10 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.221278] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.222173] virtio-pci 0000:00:06.0: PCI INT A -> Link[LNKB] -> GSI 10 (level, high) -> IRQ 10 2026-02-22T22:31:52.677 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.223644] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled 2026-02-22T22:31:52.691 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.247601] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 2026-02-22T22:31:52.978 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.531391] 00:07: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 2026-02-22T22:31:53.015 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.568102] Linux agpgart interface v0.103 2026-02-22T22:31:53.015 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.569477] brd: module loaded 2026-02-22T22:31:53.015 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.570218] loop: module loaded 2026-02-22T22:31:53.015 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.571801] vda: vda1 2026-02-22T22:31:53.018 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.574377] vdb: unknown partition table 2026-02-22T22:31:53.020 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.576979] vdc: unknown partition table 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.578228] scsi0 : ata_piix 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.578732] scsi1 : ata_piix 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.579230] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.580328] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.581492] Fixed MDIO Bus: probed 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.582053] tun: Universal TUN/TAP device driver, 1.6 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.582859] tun: (C) 1999-2004 Max Krasnyansky 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.584348] PPP generic driver version 2.4.2 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.585106] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.586154] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.587267] uhci_hcd: USB Universal Host Controller Interface driver 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.588877] usbcore: registered new interface driver libusual 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.589940] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.591939] serio: i8042 KBD port at 0x60,0x64 irq 1 2026-02-22T22:31:53.074 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.592747] serio: i8042 AUX port at 0x60,0x64 irq 12 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.593597] mousedev: PS/2 mouse device common for all mice 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.594738] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.596221] rtc_cmos 00:08: RTC can wake from S4 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.597381] rtc_cmos 00:08: rtc core: registered rtc_cmos as rtc0 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.598679] rtc0: alarms up to one day, y3k, 242 bytes nvram 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.599675] device-mapper: uevent: version 1.0.3 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.600460] device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@redhat.com 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.601809] cpuidle: using governor ladder 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.602504] cpuidle: using governor menu 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.603426] EFI Variables Facility v0.08 2004-May-17 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.604653] TCP cubic registered 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.605451] NET: Registered protocol family 10 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.606502] NET: Registered protocol family 17 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.607332] Registering the dns_resolver key type 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.608277] registered taskstats version 1 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.611645] Magic number: 14:441:553 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.612394] tty ttyS29: hash matches 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.613141] pci_link PNP0C0F:04: hash matches 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.614099] rtc_cmos 00:08: setting system clock to 2026-02-22 22:31:52 UTC (1771799512) 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.615597] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found 2026-02-22T22:31:53.075 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.616566] EDD information not available. 2026-02-22T22:31:53.203 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.741257] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.742694] ata2.00: configured for MWDMA2 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.743906] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.745646] sr0: scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.746541] cdrom: Uniform CD-ROM driver Revision: 3.20 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.747562] sr 1:0:0:0: Attached scsi generic sg0 type 5 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.749184] Freeing unused kernel memory: 924k freed 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.750283] Write protecting the kernel read-only data: 12288k 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.753033] Freeing unused kernel memory: 1640k freed 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.755186] Freeing unused kernel memory: 1200k freed 2026-02-22T22:31:53.204 INFO:tasks.qemu.client.0.trial144.stdout:Loading, please wait... 2026-02-22T22:31:53.211 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.761790] udevd[100]: starting version 175 2026-02-22T22:31:53.211 INFO:tasks.qemu.client.0.trial144.stdout:Begin: Loading essential drivers ... done. 2026-02-22T22:31:53.211 INFO:tasks.qemu.client.0.trial144.stdout:Begin: Running /scripts/init-premount ... done. 2026-02-22T22:31:53.211 INFO:tasks.qemu.client.0.trial144.stdout:Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. 2026-02-22T22:31:53.218 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.771142] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI 2026-02-22T22:31:53.218 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.772405] e1000: Copyright (c) 1999-2006 Intel Corporation. 2026-02-22T22:31:53.224 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.776679] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11 2026-02-22T22:31:53.224 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.777799] e1000 0000:00:03.0: PCI INT A -> Link[LNKC] -> GSI 11 (level, high) -> IRQ 11 2026-02-22T22:31:53.229 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.784737] Floppy drive(s): fd0 is 2.88M AMI BIOS 2026-02-22T22:31:53.248 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.804454] FDC 0 is a S82078B 2026-02-22T22:31:53.283 INFO:tasks.qemu.client.0.trial144.stdout:Begin: Running /scripts/local-premount ... done. 2026-02-22T22:31:53.291 INFO:tasks.qemu.client.0.trial144.stdout:[ 0.842512] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null) 2026-02-22T22:31:53.560 INFO:tasks.qemu.client.0.trial144.stdout:Begin: Running /scripts/local-bottom ... [ 1.108708] e1000 0000:00:03.0: eth0: (PCI:33MHz:32-bit) 52:54:00:12:34:56 2026-02-22T22:31:53.561 INFO:tasks.qemu.client.0.trial144.stdout:[ 1.110214] e1000 0000:00:03.0: eth0: Intel(R) PRO/1000 Network Connection 2026-02-22T22:31:53.632 INFO:tasks.qemu.client.0.trial144.stdout:[ 1.176863] vda: vda1 2026-02-22T22:31:53.632 INFO:tasks.qemu.client.0.trial144.stdout:GROWROOT: CHANGED: partition=1 start=16065 old: size=4176900 end=4192965 new: size=20948760,end=20964825 2026-02-22T22:31:53.757 INFO:tasks.qemu.client.0.trial144.stdout:[ 1.305975] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null) 2026-02-22T22:31:53.757 INFO:tasks.qemu.client.0.trial144.stdout:done. 2026-02-22T22:31:53.758 INFO:tasks.qemu.client.0.trial144.stdout:done. 2026-02-22T22:31:53.804 INFO:tasks.qemu.client.0.trial144.stdout:Begin: Running /scripts/init-bottom ... done. 2026-02-22T22:31:54.340 INFO:tasks.qemu.client.0.trial144.stdout:cloud-init start-local running: Sun, 22 Feb 2026 22:31:53 +0000. up 1.67 seconds 2026-02-22T22:31:54.340 INFO:tasks.qemu.client.0.trial144.stdout:no instance data found in start-local 2026-02-22T22:31:55.274 INFO:tasks.qemu.client.0.trial144.stdout:ci-info: lo : 1 127.0.0.1 255.0.0.0 . 2026-02-22T22:31:55.274 INFO:tasks.qemu.client.0.trial144.stdout:ci-info: eth0 : 1 10.0.2.15 255.255.255.0 52:54:00:12:34:56 2026-02-22T22:31:55.274 INFO:tasks.qemu.client.0.trial144.stdout:ci-info: route-0: 0.0.0.0 10.0.2.2 0.0.0.0 eth0 UG 2026-02-22T22:31:55.274 INFO:tasks.qemu.client.0.trial144.stdout:ci-info: route-1: 10.0.2.0 0.0.0.0 255.255.255.0 eth0 U 2026-02-22T22:31:55.274 INFO:tasks.qemu.client.0.trial144.stdout:cloud-init start running: Sun, 22 Feb 2026 22:31:54 +0000. up 2.80 seconds 2026-02-22T22:31:55.353 INFO:tasks.qemu.client.0.trial144.stdout:found data source: DataSourceNoCloud [seed=/dev/sr0] 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:WARN:stdout, stderr changing to (| tee -a /var/log/cloud-init-output.log,| tee -a /var/log/cloud-init-output.log)Generating public/private rsa key pair. 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:Your identification has been saved in /etc/ssh/ssh_host_rsa_key. 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub. 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:The key fingerprint is: 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:9a:a7:a3:5b:44:b6:aa:c7:81:50:8f:54:6f:c3:e9:de root@test 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:The key's randomart image is: 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:+--[ RSA 2048]----+ 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:| .. | 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:| o o . | 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:| o o O | 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:|. . .= o | 2026-02-22T22:31:55.601 INFO:tasks.qemu.client.0.trial144.stdout:| . . + S | 2026-02-22T22:31:55.602 INFO:tasks.qemu.client.0.trial144.stdout:| . .+ + | 2026-02-22T22:31:55.602 INFO:tasks.qemu.client.0.trial144.stdout:| ...= E | 2026-02-22T22:31:55.602 INFO:tasks.qemu.client.0.trial144.stdout:| .o..o | 2026-02-22T22:31:55.602 INFO:tasks.qemu.client.0.trial144.stdout:| ..oo.. | 2026-02-22T22:31:55.602 INFO:tasks.qemu.client.0.trial144.stdout:+-----------------+ 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:Generating public/private dsa key pair. 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:Your identification has been saved in /etc/ssh/ssh_host_dsa_key. 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub. 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:The key fingerprint is: 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:2a:4c:10:43:75:c4:88:a8:f6:f6:18:8e:f7:ff:60:a3 root@test 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:The key's randomart image is: 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:+--[ DSA 1024]----+ 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:| o+o.+o | 2026-02-22T22:31:55.670 INFO:tasks.qemu.client.0.trial144.stdout:|. .o... | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:|. . | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:|.. . | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:|. . . S | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| * . | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| + * .+ | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| . + oo o | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| . .E.... | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:+-----------------+ 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:Generating public/private ecdsa key pair. 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key. 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub. 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:The key fingerprint is: 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:90:f1:e7:f1:dc:65:91:a0:49:dc:7e:68:56:17:6a:1a root@test 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:The key's randomart image is: 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:+--[ECDSA 256]---+ 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| . .....oo| 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| + ..o..oo| 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| o . oE.oo +| 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| . o ++* + | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| S ..= o | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:| | 2026-02-22T22:31:55.671 INFO:tasks.qemu.client.0.trial144.stdout:+-----------------+ 2026-02-22T22:31:55.705 INFO:tasks.qemu.client.0.trial144.stdout:Skipping profile in /etc/apparmor.d/disable: usr.sbin.rsyslogd 2026-02-22T22:31:55.772 INFO:tasks.qemu.client.0.trial144.stdout: * Starting AppArmor profiles  [ OK ] 2026-02-22T22:31:55.787 INFO:tasks.qemu.client.0.trial144.stdout:landscape-client is not configured, please run landscape-config. 2026-02-22T22:31:55.806 INFO:tasks.qemu.client.0.trial144.stdout: * Stopping System V initialisation compatibility[ OK ] 2026-02-22T22:31:55.806 INFO:tasks.qemu.client.0.trial144.stdout: * Starting System V runlevel compatibility[ OK ] 2026-02-22T22:31:55.806 INFO:tasks.qemu.client.0.trial144.stdout: * Starting save kernel messages[ OK ] 2026-02-22T22:31:55.806 INFO:tasks.qemu.client.0.trial144.stdout: * Starting ACPI daemon[ OK ] 2026-02-22T22:31:55.806 INFO:tasks.qemu.client.0.trial144.stdout: * Starting automatic crash report generation[ OK ] 2026-02-22T22:31:55.806 INFO:tasks.qemu.client.0.trial144.stdout: * Starting regular background program processing daemon[ OK ] 2026-02-22T22:31:55.806 INFO:tasks.qemu.client.0.trial144.stdout: * Starting deferred execution scheduler[ OK ] 2026-02-22T22:31:55.811 INFO:tasks.qemu.client.0.trial144.stdout: * Starting CPU interrupts balancing daemon[ OK ] 2026-02-22T22:31:55.811 INFO:tasks.qemu.client.0.trial144.stdout: * Stopping save kernel messages[ OK ] 2026-02-22T22:31:55.813 INFO:tasks.qemu.client.0.trial144.stdout: * Stopping System V runlevel compatibility[ OK ] 2026-02-22T22:31:55.886 INFO:tasks.qemu.client.0.trial144.stdout:Generating locales... 2026-02-22T22:31:56.136 INFO:tasks.qemu.client.0.trial144.stdout: en_US.UTF-8... done 2026-02-22T22:31:56.141 INFO:tasks.qemu.client.0.trial144.stdout:Generation complete. 2026-02-22T22:31:57.227 INFO:tasks.qemu.client.0.trial144.stdout:passwd: password expiry information changed. 2026-02-22T22:31:57.547 INFO:tasks.qemu.client.0.trial144.stdout:Ign http://old-releases.ubuntu.com precise InRelease 2026-02-22T22:31:57.621 INFO:tasks.qemu.client.0.trial144.stdout:Get:1 http://old-releases.ubuntu.com precise-updates InRelease [55.7 kB] 2026-02-22T22:31:57.857 INFO:tasks.qemu.client.0.trial144.stdout:Get:2 http://old-releases.ubuntu.com precise-security InRelease [55.7 kB] 2026-02-22T22:31:57.989 INFO:tasks.qemu.client.0.trial144.stdout:Get:3 http://old-releases.ubuntu.com precise Release.gpg [198 B] 2026-02-22T22:31:58.072 INFO:tasks.qemu.client.0.trial144.stdout:Get:4 http://old-releases.ubuntu.com precise-updates/main Sources [815 kB] 2026-02-22T22:31:58.870 INFO:tasks.qemu.client.0.trial144.stdout:Get:5 http://old-releases.ubuntu.com precise-updates/universe Sources [208 kB] 2026-02-22T22:31:59.162 INFO:tasks.qemu.client.0.trial144.stdout:Get:6 http://old-releases.ubuntu.com precise-updates/main amd64 Packages [1104 kB] 2026-02-22T22:32:00.205 INFO:tasks.qemu.client.0.trial144.stdout:Get:7 http://old-releases.ubuntu.com precise-updates/universe amd64 Packages [406 kB] 2026-02-22T22:32:00.659 INFO:tasks.qemu.client.0.trial144.stdout:Get:8 http://old-releases.ubuntu.com precise-updates/main i386 Packages [1111 kB] 2026-02-22T22:32:01.662 INFO:tasks.qemu.client.0.trial144.stdout:Get:9 http://old-releases.ubuntu.com precise-updates/universe i386 Packages [422 kB] 2026-02-22T22:32:02.112 INFO:tasks.qemu.client.0.trial144.stdout:Get:10 http://old-releases.ubuntu.com precise-updates/main TranslationIndex [208 B] 2026-02-22T22:32:02.192 INFO:tasks.qemu.client.0.trial144.stdout:Get:11 http://old-releases.ubuntu.com precise-updates/universe TranslationIndex [205 B] 2026-02-22T22:32:02.281 INFO:tasks.qemu.client.0.trial144.stdout:Get:12 http://old-releases.ubuntu.com precise-security/main Sources [242 kB] 2026-02-22T22:32:02.579 INFO:tasks.qemu.client.0.trial144.stdout:Get:13 http://old-releases.ubuntu.com precise-security/universe Sources [88.1 kB] 2026-02-22T22:32:02.741 INFO:tasks.qemu.client.0.trial144.stdout:Get:14 http://old-releases.ubuntu.com precise-security/main amd64 Packages [584 kB] 2026-02-22T22:32:03.317 INFO:tasks.qemu.client.0.trial144.stdout:Get:15 http://old-releases.ubuntu.com precise-security/universe amd64 Packages [213 kB] 2026-02-22T22:32:03.602 INFO:tasks.qemu.client.0.trial144.stdout:Get:16 http://old-releases.ubuntu.com precise-security/main i386 Packages [589 kB] 2026-02-22T22:32:04.195 INFO:tasks.qemu.client.0.trial144.stdout:Get:17 http://old-releases.ubuntu.com precise-security/universe i386 Packages [228 kB] 2026-02-22T22:32:04.515 INFO:tasks.qemu.client.0.trial144.stdout:Get:18 http://old-releases.ubuntu.com precise-security/main TranslationIndex [208 B] 2026-02-22T22:32:04.602 INFO:tasks.qemu.client.0.trial144.stdout:Get:19 http://old-releases.ubuntu.com precise-security/universe TranslationIndex [205 B] 2026-02-22T22:32:04.677 INFO:tasks.qemu.client.0.trial144.stdout:Get:20 http://old-releases.ubuntu.com precise Release [49.6 kB] 2026-02-22T22:32:04.806 INFO:tasks.qemu.client.0.trial144.stdout:Get:21 http://old-releases.ubuntu.com precise-updates/main Translation-en [353 kB] 2026-02-22T22:32:05.188 INFO:tasks.qemu.client.0.trial144.stdout:Get:22 http://old-releases.ubuntu.com precise-updates/universe Translation-en [176 kB] 2026-02-22T22:32:05.421 INFO:tasks.qemu.client.0.trial144.stdout:Get:23 http://old-releases.ubuntu.com precise-security/main Translation-en [202 kB] 2026-02-22T22:32:05.700 INFO:tasks.qemu.client.0.trial144.stdout:Get:24 http://old-releases.ubuntu.com precise-security/universe Translation-en [96.4 kB] 2026-02-22T22:32:05.879 INFO:tasks.qemu.client.0.trial144.stdout:Get:25 http://old-releases.ubuntu.com precise/main Sources [934 kB] 2026-02-22T22:32:06.689 INFO:tasks.qemu.client.0.trial144.stdout:Get:26 http://old-releases.ubuntu.com precise/universe Sources [5019 kB] 2026-02-22T22:32:10.444 INFO:tasks.qemu.client.0.trial144.stdout:Get:27 http://old-releases.ubuntu.com precise/main amd64 Packages [1273 kB] 2026-02-22T22:32:11.709 INFO:tasks.qemu.client.0.trial144.stdout:Get:28 http://old-releases.ubuntu.com precise/universe amd64 Packages [4786 kB] 2026-02-22T22:32:15.294 INFO:tasks.qemu.client.0.trial144.stdout:Get:29 http://old-releases.ubuntu.com precise/main i386 Packages [1274 kB] 2026-02-22T22:32:16.407 INFO:tasks.qemu.client.0.trial144.stdout:Get:30 http://old-releases.ubuntu.com precise/universe i386 Packages [4796 kB] 2026-02-22T22:32:20.198 INFO:tasks.qemu.client.0.trial144.stdout:Get:31 http://old-releases.ubuntu.com precise/main TranslationIndex [3706 B] 2026-02-22T22:32:20.278 INFO:tasks.qemu.client.0.trial144.stdout:Get:32 http://old-releases.ubuntu.com precise/universe TranslationIndex [2922 B] 2026-02-22T22:32:20.359 INFO:tasks.qemu.client.0.trial144.stdout:Get:33 http://old-releases.ubuntu.com precise/main Translation-en [726 kB] 2026-02-22T22:32:21.012 INFO:tasks.qemu.client.0.trial144.stdout:Get:34 http://old-releases.ubuntu.com precise/universe Translation-en [3341 kB] 2026-02-22T22:32:23.980 INFO:tasks.qemu.client.0.trial144.stdout:Fetched 29.2 MB in 27s (1068 kB/s) 2026-02-22T22:32:24.682 INFO:tasks.qemu.client.0.trial144.stdout:Reading package lists... 2026-02-22T22:32:24.686 INFO:tasks.qemu.client.0.trial144.stdout:Reading package lists... 2026-02-22T22:32:24.811 INFO:tasks.qemu.client.0.trial144.stdout:Building dependency tree... 2026-02-22T22:32:24.811 INFO:tasks.qemu.client.0.trial144.stdout:Reading state information... 2026-02-22T22:32:24.861 INFO:tasks.qemu.client.0.trial144.stdout:The following packages will be upgraded: 2026-02-22T22:32:24.861 INFO:tasks.qemu.client.0.trial144.stdout: ca-certificates libssl1.0.0 2026-02-22T22:32:25.673 INFO:tasks.qemu.client.0.trial144.stdout:2 upgraded, 0 newly installed, 0 to remove and 226 not upgraded. 2026-02-22T22:32:25.673 INFO:tasks.qemu.client.0.trial144.stdout:Need to get 1233 kB of archives. 2026-02-22T22:32:25.673 INFO:tasks.qemu.client.0.trial144.stdout:After this operation, 108 kB of additional disk space will be used. 2026-02-22T22:32:25.674 INFO:tasks.qemu.client.0.trial144.stdout:Get:1 http://old-releases.ubuntu.com/ubuntu/ precise-updates/main libssl1.0.0 amd64 1.0.1-4ubuntu5.45 [1055 kB] 2026-02-22T22:32:27.174 INFO:tasks.qemu.client.0.trial144.stdout:Get:2 http://old-releases.ubuntu.com/ubuntu/ precise-updates/main ca-certificates all 20190110~12.04.1 [179 kB] 2026-02-22T22:32:27.380 INFO:tasks.qemu.client.0.trial144.stdout:dpkg-preconfigure: unable to re-open stdin: No such file or directory 2026-02-22T22:32:27.389 INFO:tasks.qemu.client.0.trial144.stdout:Fetched 1233 kB in 2s (498 kB/s) 2026-02-22T22:32:27.570 INFO:tasks.qemu.client.0.trial144.stdout:(Reading database ... 36182 files and directories currently installed.) 2026-02-22T22:32:27.570 INFO:tasks.qemu.client.0.trial144.stdout:Preparing to replace libssl1.0.0 1.0.1-4ubuntu5.5 (using .../libssl1.0.0_1.0.1-4ubuntu5.45_amd64.deb) ... 2026-02-22T22:32:27.575 INFO:tasks.qemu.client.0.trial144.stdout:Unpacking replacement libssl1.0.0 ... 2026-02-22T22:32:27.610 INFO:tasks.qemu.client.0.trial144.stdout:Setting up libssl1.0.0 (1.0.1-4ubuntu5.45) ... 2026-02-22T22:32:27.685 INFO:tasks.qemu.client.0.trial144.stdout:Processing triggers for libc-bin ... 2026-02-22T22:32:27.685 INFO:tasks.qemu.client.0.trial144.stdout:ldconfig deferred processing now taking place 2026-02-22T22:32:27.800 INFO:tasks.qemu.client.0.trial144.stdout:(Reading database ... 36182 files and directories currently installed.) 2026-02-22T22:32:27.800 INFO:tasks.qemu.client.0.trial144.stdout:Preparing to replace ca-certificates 20111211 (using .../ca-certificates_20190110~12.04.1_all.deb) ... 2026-02-22T22:32:27.800 INFO:tasks.qemu.client.0.trial144.stdout:Unpacking replacement ca-certificates ... 2026-02-22T22:32:27.824 INFO:tasks.qemu.client.0.trial144.stdout:Processing triggers for man-db ... 2026-02-22T22:32:28.049 INFO:tasks.qemu.client.0.trial144.stdout:Setting up ca-certificates (20190110~12.04.1) ... 2026-02-22T22:32:28.995 INFO:tasks.qemu.client.0.trial144.stdout:Updating certificates in /etc/ssl/certs... 73 added, 78 removed; done. 2026-02-22T22:32:28.996 INFO:tasks.qemu.client.0.trial144.stdout:Running hooks in /etc/ca-certificates/update.d....done. 2026-02-22T22:32:29.581 INFO:tasks.qemu.client.0.trial144.stdout:Updating certificates in /etc/ssl/certs... 0 added, 1 removed; done. 2026-02-22T22:32:29.581 INFO:tasks.qemu.client.0.trial144.stdout:Running hooks in /etc/ca-certificates/update.d....done. 2026-02-22T22:32:29.582 INFO:tasks.qemu.client.0.trial144.stdout:Reading package lists... 2026-02-22T22:32:29.684 INFO:tasks.qemu.client.0.trial144.stdout:Building dependency tree... 2026-02-22T22:32:29.684 INFO:tasks.qemu.client.0.trial144.stdout:Reading state information... 2026-02-22T22:32:29.742 INFO:tasks.qemu.client.0.trial144.stdout:The following extra packages will be installed: 2026-02-22T22:32:29.742 INFO:tasks.qemu.client.0.trial144.stdout: libgssglue1 libnfsidmap2 libtirpc1 rpcbind 2026-02-22T22:32:29.742 INFO:tasks.qemu.client.0.trial144.stdout:The following NEW packages will be installed: 2026-02-22T22:32:29.742 INFO:tasks.qemu.client.0.trial144.stdout: libgssglue1 libnfsidmap2 libtirpc1 nfs-common rpcbind 2026-02-22T22:32:29.930 INFO:tasks.qemu.client.0.trial144.stdout:0 upgraded, 5 newly installed, 0 to remove and 226 not upgraded. 2026-02-22T22:32:29.930 INFO:tasks.qemu.client.0.trial144.stdout:Need to get 424 kB of archives. 2026-02-22T22:32:29.930 INFO:tasks.qemu.client.0.trial144.stdout:After this operation, 1326 kB of additional disk space will be used. 2026-02-22T22:32:29.930 INFO:tasks.qemu.client.0.trial144.stdout:Get:1 http://old-releases.ubuntu.com/ubuntu/ precise-updates/main libgssglue1 amd64 0.3-4ubuntu0.1 [22.5 kB] 2026-02-22T22:32:30.666 INFO:tasks.qemu.client.0.trial144.stdout:Get:2 http://old-releases.ubuntu.com/ubuntu/ precise-updates/main libtirpc1 amd64 0.2.2-5ubuntu0.1 [85.0 kB] 2026-02-22T22:32:30.914 INFO:tasks.qemu.client.0.trial144.stdout:Get:3 http://old-releases.ubuntu.com/ubuntu/ precise-updates/main rpcbind amd64 0.2.0-7ubuntu1.3 [43.1 kB] 2026-02-22T22:32:31.032 INFO:tasks.qemu.client.0.trial144.stdout:Get:4 http://old-releases.ubuntu.com/ubuntu/ precise/main libnfsidmap2 amd64 0.25-1ubuntu2 [32.0 kB] 2026-02-22T22:32:31.168 INFO:tasks.qemu.client.0.trial144.stdout:Get:5 http://old-releases.ubuntu.com/ubuntu/ precise-updates/main nfs-common amd64 1:1.2.5-3ubuntu3.2 [241 kB] 2026-02-22T22:32:31.446 INFO:tasks.qemu.client.0.trial144.stdout:dpkg-preconfigure: unable to re-open stdin: No such file or directory 2026-02-22T22:32:31.453 INFO:tasks.qemu.client.0.trial144.stdout:Fetched 424 kB in 1s (252 kB/s) 2026-02-22T22:32:31.477 INFO:tasks.qemu.client.0.trial144.stdout:Selecting previously unselected package libgssglue1. 2026-02-22T22:32:31.477 INFO:tasks.qemu.client.0.trial144.stdout:(Reading database ... 36174 files and directories currently installed.) 2026-02-22T22:32:31.477 INFO:tasks.qemu.client.0.trial144.stdout:Unpacking libgssglue1 (from .../libgssglue1_0.3-4ubuntu0.1_amd64.deb) ... 2026-02-22T22:32:31.486 INFO:tasks.qemu.client.0.trial144.stdout:Selecting previously unselected package libtirpc1. 2026-02-22T22:32:31.486 INFO:tasks.qemu.client.0.trial144.stdout:Unpacking libtirpc1 (from .../libtirpc1_0.2.2-5ubuntu0.1_amd64.deb) ... 2026-02-22T22:32:31.499 INFO:tasks.qemu.client.0.trial144.stdout:Selecting previously unselected package rpcbind. 2026-02-22T22:32:31.499 INFO:tasks.qemu.client.0.trial144.stdout:Unpacking rpcbind (from .../rpcbind_0.2.0-7ubuntu1.3_amd64.deb) ... 2026-02-22T22:32:31.515 INFO:tasks.qemu.client.0.trial144.stdout:Selecting previously unselected package libnfsidmap2. 2026-02-22T22:32:31.515 INFO:tasks.qemu.client.0.trial144.stdout:Unpacking libnfsidmap2 (from .../libnfsidmap2_0.25-1ubuntu2_amd64.deb) ... 2026-02-22T22:32:31.527 INFO:tasks.qemu.client.0.trial144.stdout:Selecting previously unselected package nfs-common. 2026-02-22T22:32:31.527 INFO:tasks.qemu.client.0.trial144.stdout:Unpacking nfs-common (from .../nfs-common_1%3a1.2.5-3ubuntu3.2_amd64.deb) ... 2026-02-22T22:32:31.537 INFO:tasks.qemu.client.0.trial144.stdout:Processing triggers for man-db ... 2026-02-22T22:32:31.658 INFO:tasks.qemu.client.0.trial144.stdout:Processing triggers for ureadahead ... 2026-02-22T22:32:31.669 INFO:tasks.qemu.client.0.trial144.stdout:Setting up libgssglue1 (0.3-4ubuntu0.1) ... 2026-02-22T22:32:31.675 INFO:tasks.qemu.client.0.trial144.stdout:Setting up libtirpc1 (0.2.2-5ubuntu0.1) ... 2026-02-22T22:32:31.681 INFO:tasks.qemu.client.0.trial144.stdout:Setting up rpcbind (0.2.0-7ubuntu1.3) ... 2026-02-22T22:32:31.696 INFO:tasks.qemu.client.0.trial144.stdout: Removing any system startup links for /etc/init.d/rpcbind ... 2026-02-22T22:32:31.713 INFO:tasks.qemu.client.0.trial144.stdout:portmap start/running, process 8247 2026-02-22T22:32:31.713 INFO:tasks.qemu.client.0.trial144.stdout:Setting up libnfsidmap2 (0.25-1ubuntu2) ... 2026-02-22T22:32:31.713 INFO:tasks.qemu.client.0.trial144.stdout:Setting up nfs-common (1:1.2.5-3ubuntu3.2) ... 2026-02-22T22:32:31.783 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:32:31.783 INFO:tasks.qemu.client.0.trial144.stdout:Creating config file /etc/idmapd.conf with new version 2026-02-22T22:32:31.863 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:32:31.864 INFO:tasks.qemu.client.0.trial144.stdout:Creating config file /etc/default/nfs-common with new version 2026-02-22T22:32:31.902 INFO:tasks.qemu.client.0.trial144.stdout:Adding system user `statd' (UID 106) ... 2026-02-22T22:32:31.902 INFO:tasks.qemu.client.0.trial144.stdout:Adding new user `statd' (UID 106) with group `nogroup' ... 2026-02-22T22:32:31.915 INFO:tasks.qemu.client.0.trial144.stdout:Not creating home directory `/var/lib/nfs'. 2026-02-22T22:32:31.928 INFO:tasks.qemu.client.0.trial144.stdout:statd start/running, process 8481 2026-02-22T22:32:31.937 INFO:tasks.qemu.client.0.trial144.stdout:gssd stop/pre-start, process 8510 2026-02-22T22:32:32.716 INFO:tasks.qemu.client.0.trial144.stdout:idmapd start/running, process 8552 2026-02-22T22:32:32.716 INFO:tasks.qemu.client.0.trial144.stdout:Processing triggers for libc-bin ... 2026-02-22T22:32:32.716 INFO:tasks.qemu.client.0.trial144.stdout:ldconfig deferred processing now taking place 2026-02-22T22:32:32.920 INFO:tasks.qemu.client.0.trial144.stdout:mount.nfs: timeout set for Sun Feb 22 22:34:32 2026 2026-02-22T22:32:32.921 INFO:tasks.qemu.client.0.trial144.stdout:mount.nfs: trying text-based options 'proto=tcp,vers=4,addr=10.0.2.2,clientaddr=10.0.2.15' 2026-02-22T22:32:32.921 INFO:tasks.qemu.client.0.trial144.stdout:10.0.2.2:/export/client.0 on /mnt/log type nfs (rw,proto=tcp) 2026-02-22T22:32:32.921 INFO:tasks.qemu.client.0.trial144.stdout:mount: block device /dev/sr0 is write-protected, mounting read-only 2026-02-22T22:52:17.625 INFO:tasks.qemu.client.0.trial144.stdout:failed: /var/lib/cloud/instance/scripts/part-005 [2] 2026-02-22T22:52:17.692 INFO:tasks.qemu.client.0.trial144.stdout:2026-02-22 22:52:17,716 - cc_scripts_user.py[WARNING]: failed to run-parts in /var/lib/cloud/instance/scripts 2026-02-22T22:52:17.694 INFO:tasks.qemu.client.0.trial144.stdout:acpid: exiting 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout:2026-02-22 22:52:17,731 - __init__.py[WARNING]: Traceback (most recent call last): 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/dist-packages/cloudinit/CloudConfig/__init__.py", line 117, in run_cc_modules 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: cc.handle(name, run_args, freq=freq) 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/dist-packages/cloudinit/CloudConfig/__init__.py", line 78, in handle 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: [name, self.cfg, self.cloud, cloudinit.log, args]) 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/dist-packages/cloudinit/__init__.py", line 326, in sem_and_run 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: func(*args) 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/dist-packages/cloudinit/CloudConfig/cc_scripts_user.py", line 31, in handle 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: util.runparts(runparts_path) 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/dist-packages/cloudinit/util.py", line 223, in runparts 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: raise RuntimeError('runparts: %i failures' % failed) 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout:RuntimeError: runparts: 1 failures 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout:Traceback (most recent call last): 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 807, in emit 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: self._connect_unixsocket(self.address) 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 745, in _connect_unixsocket 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: self.socket.connect(address) 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/socket.py", line 224, in meth 2026-02-22T22:52:17.810 INFO:tasks.qemu.client.0.trial144.stdout: return getattr(self._sock,name)(*args) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:error: [Errno 111] Connection refused 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Logged from file __init__.py, line 119 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:2026-02-22 22:52:17,740 - __init__.py[ERROR]: config handling of scripts-user, None, [] failed 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Traceback (most recent call last): 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 807, in emit 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: self._connect_unixsocket(self.address) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 745, in _connect_unixsocket 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: self.socket.connect(address) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/socket.py", line 224, in meth 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: return getattr(self._sock,name)(*args) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:error: [Errno 111] Connection refused 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Logged from file __init__.py, line 121 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Traceback (most recent call last): 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 807, in emit 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: self._connect_unixsocket(self.address) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 745, in _connect_unixsocket 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: self.socket.connect(address) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/socket.py", line 224, in meth 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: return getattr(self._sock,name)(*args) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:error: [Errno 111] Connection refused 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Logged from file __init__.py, line 116 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:-----BEGIN SSH HOST KEY KEYS----- 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Checking for running unattended-upgrades: 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI717BVNq01/v4rXKtCpT7a3ALDRdIIltVswq76F78JMTD6mRIw/cMSNIE7s8tR5qpMb29zKSI33OkgM9cQ+eks= root@test 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDxdo9slHirL2j5dPamLnF2Kw8DD/ycORNEDZMZOgv/Smu1Yqqi2fFChqqPiNKtWUdQ7N+fCMcGN/BXotq2wWZy5q8s4j5yNP1ym8uOYWbmm7Df6ythp5g8QorSYIp3XLdj8Q19qGSejhjZA9wHgy7VzAxIysyp5vMhuwqEKuFDNDDSfVwTLplPRIRl0T2OrTOe2Ee5eo6wgATm0nO/Iz46Eo+w9Zz2R3jM0nK5Roo/IfdFrwn7R6drSGFE9KIH/4vFMmXFa7ZTTD8LwVIcNlM/DAgQxq8mGKQn5dZZTaQafZBFemCfLtC949U/1W7TgtgC8WQPXgGCPkWdhK1oeYPD root@test 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:-----END SSH HOST KEY KEYS----- 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: ############################################################# 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: -----BEGIN SSH HOST KEY FINGERPRINTS----- 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: 1024 2a:4c:10:43:75:c4:88:a8:f6:f6:18:8e:f7:ff:60:a3 root@test (DSA) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: 256 90:f1:e7:f1:dc:65:91:a0:49:dc:7e:68:56:17:6a:1a root@test (ECDSA) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: 2048 9a:a7:a3:5b:44:b6:aa:c7:81:50:8f:54:6f:c3:e9:de root@test (RSA) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: -----END SSH HOST KEY FINGERPRINTS----- 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:ec2: ############################################################# 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Traceback (most recent call last): 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 807, in emit 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: self._connect_unixsocket(self.address) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 745, in _connect_unixsocket 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: self.socket.connect(address) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/socket.py", line 224, in meth 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: return getattr(self._sock,name)(*args) 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:error: [Errno 111] Connection refused 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Logged from file __init__.py, line 116 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout:Traceback (most recent call last): 2026-02-22T22:52:17.811 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 807, in emit 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: self._connect_unixsocket(self.address) 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 745, in _connect_unixsocket 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: self.socket.connect(address) 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/socket.py", line 224, in meth 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: return getattr(self._sock,name)(*args) 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:error: [Errno 111] Connection refused 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:Logged from file __init__.py, line 116 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:2026-02-22 22:52:17,784 - cloud-init-cfg[ERROR]: errors running cloud_config [final]: ['scripts-user'] 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:Traceback (most recent call last): 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 807, in emit 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: self._connect_unixsocket(self.address) 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/logging/handlers.py", line 745, in _connect_unixsocket 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: self.socket.connect(address) 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: File "/usr/lib/python2.7/socket.py", line 224, in meth 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout: return getattr(self._sock,name)(*args) 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:error: [Errno 111] Connection refused 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:Logged from file cloud-init-cfg, line 106 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:errors running cloud_config [final]: ['scripts-user'] 2026-02-22T22:52:17.812 INFO:tasks.qemu.client.0.trial144.stdout:cloud-init boot finished at Sun, 22 Feb 2026 22:52:17 +0000. Up 1225.32 seconds 2026-02-22T22:52:17.823 INFO:tasks.qemu.client.0.trial144.stdout: * Stopping landscape-client daemon  [fail] 2026-02-22T22:52:17.853 INFO:tasks.qemu.client.0.trial144.stdout: * Asking all remaining processes to terminate...  [ OK ] 2026-02-22T22:52:18.876 INFO:tasks.qemu.client.0.trial144.stdout: * All processes ended within 2 seconds....  [ OK ] 2026-02-22T22:52:18.886 INFO:tasks.qemu.client.0.trial144.stdout:rpcbind: rpcbind terminating on signal. Restart with "rpcbind -w" 2026-02-22T22:52:19.161 INFO:tasks.qemu.client.0.trial144.stdout: * Deconfiguring network interfaces...  [ OK ] 2026-02-22T22:52:19.173 INFO:tasks.qemu.client.0.trial144.stdout: * Deactivating swap...  [ OK ] 2026-02-22T22:52:19.197 INFO:tasks.qemu.client.0.trial144.stdout: * Unmounting local filesystems...  umount2: Device or resource busy 2026-02-22T22:52:19.197 INFO:tasks.qemu.client.0.trial144.stdout:umount: /tmp/cephtest/test_dir.ejRK66oHu6: device is busy. 2026-02-22T22:52:19.197 INFO:tasks.qemu.client.0.trial144.stdout: (In some cases useful info about processes that use 2026-02-22T22:52:19.198 INFO:tasks.qemu.client.0.trial144.stdout: the device is found by lsof(8) or fuser(1)) 2026-02-22T22:52:19.198 INFO:tasks.qemu.client.0.trial144.stdout:umount2: Device or resource busy 2026-02-22T22:52:19.210 INFO:tasks.qemu.client.0.trial144.stdout: [fail] 2026-02-22T22:52:19.321 INFO:tasks.qemu.client.0.trial144.stdout: * Will now halt 2026-02-22T22:52:19.649 INFO:tasks.qemu.client.0.trial144.stdout:[ 1227.232307] Power down. 2026-02-22T22:53:03.243 DEBUG:tasks.qemu:checking that qemu tests succeeded... 2026-02-22T22:53:03.243 DEBUG:teuthology.orchestra.run.trial144:> sudo chmod a+rw -R /home/ubuntu/cephtest/archive/qemu/client.0 2026-02-22T22:53:03.310 INFO:tasks.qemu:Tearing down the nfs mount for ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:53:03.310 INFO:tasks.qemu:Stopping NFS... 2026-02-22T22:53:03.311 DEBUG:teuthology.orchestra.run.trial144:> sudo systemctl stop nfs-server 2026-02-22T22:53:03.442 INFO:tasks.qemu:Unmounting exported directory... 2026-02-22T22:53:03.442 DEBUG:teuthology.orchestra.run.trial144:> sudo umount /export/client.0 2026-02-22T22:53:03.466 INFO:tasks.qemu:Deleting export from /etc/exports... 2026-02-22T22:53:03.466 DEBUG:teuthology.orchestra.run.trial144:> sudo sed -i '\|/export/client.0|d' /etc/exports 2026-02-22T22:53:03.530 INFO:tasks.qemu:Starting NFS... 2026-02-22T22:53:03.530 DEBUG:teuthology.orchestra.run.trial144:> sudo systemctl start nfs-server 2026-02-22T22:53:03.773 DEBUG:teuthology.orchestra.run.trial144:> test -f /home/ubuntu/cephtest/archive/qemu/client.0/success 2026-02-22T22:53:03.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:53:03.788 DEBUG:tasks.qemu:cleaning up base image files 2026-02-22T22:53:03.788 DEBUG:teuthology.orchestra.run.trial144:> rm -f /home/ubuntu/cephtest/qemu/base.client.0.0.qcow2 2026-02-22T22:53:03.962 DEBUG:teuthology.orchestra.run.trial144:> rm -rf /home/ubuntu/cephtest/qemu/client.0.iso /home/ubuntu/cephtest/qemu/userdata.client.0 /home/ubuntu/cephtest/qemu/metadata.client.0 /home/ubuntu/cephtest/qemu/client.0.test.sh /home/ubuntu/cephtest/qemu_clone.client.0 2026-02-22T22:53:04.251 DEBUG:teuthology.orchestra.run.trial144:> sudo yum -y erase qemu-kvm-block-rbd 2026-02-22T22:53:04.415 INFO:teuthology.orchestra.run.trial144.stdout:Dependencies resolved. 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout: Package Arch Version Repository Size 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout:Removing: 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout: qemu-kvm-block-rbd x86_64 17:10.1.0-13.el9 @appstream 37 k 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout:Transaction Summary 2026-02-22T22:53:04.416 INFO:teuthology.orchestra.run.trial144.stdout:================================================================================ 2026-02-22T22:53:04.417 INFO:teuthology.orchestra.run.trial144.stdout:Remove 1 Package 2026-02-22T22:53:04.417 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:53:04.417 INFO:teuthology.orchestra.run.trial144.stdout:Freed space: 37 k 2026-02-22T22:53:04.417 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction check 2026-02-22T22:53:04.417 INFO:teuthology.orchestra.run.trial144.stdout:Transaction check succeeded. 2026-02-22T22:53:04.418 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction test 2026-02-22T22:53:04.431 INFO:teuthology.orchestra.run.trial144.stdout:Transaction test succeeded. 2026-02-22T22:53:04.432 INFO:teuthology.orchestra.run.trial144.stdout:Running transaction 2026-02-22T22:53:04.460 INFO:teuthology.orchestra.run.trial144.stdout: Preparing : 1/1 2026-02-22T22:53:04.614 INFO:teuthology.orchestra.run.trial144.stdout: Erasing : qemu-kvm-block-rbd-17:10.1.0-13.el9.x86_64 1/1 2026-02-22T22:53:04.658 INFO:teuthology.orchestra.run.trial144.stdout: Verifying : qemu-kvm-block-rbd-17:10.1.0-13.el9.x86_64 1/1 2026-02-22T22:53:04.658 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:53:04.658 INFO:teuthology.orchestra.run.trial144.stdout:Removed: 2026-02-22T22:53:04.658 INFO:teuthology.orchestra.run.trial144.stdout: qemu-kvm-block-rbd-17:10.1.0-13.el9.x86_64 2026-02-22T22:53:04.658 INFO:teuthology.orchestra.run.trial144.stdout: 2026-02-22T22:53:04.658 INFO:teuthology.orchestra.run.trial144.stdout:Complete! 2026-02-22T22:53:04.679 DEBUG:teuthology.orchestra.run.trial144:> rmdir /home/ubuntu/cephtest/qemu || true 2026-02-22T22:53:04.696 INFO:tasks.rbd:Deleting rbd images... 2026-02-22T22:53:04.696 DEBUG:teuthology.orchestra.run.trial144:> rm -f /home/ubuntu/cephtest/passphrase 2026-02-22T22:53:04.752 DEBUG:teuthology.orchestra.run.trial144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd --cluster ceph -p rbd rm client.0.2 2026-02-22T22:53:04.850 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:04.848+0000 7f449e7fc640 1 bdev(0x7f44800219e0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) open path /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool 2026-02-22T22:53:04.850 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:04.848+0000 7f449e7fc640 0 bdev(0x7f44800219e0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) ioctl(F_SET_FILE_RW_HINT) on /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool failed: (22) Invalid argument 2026-02-22T22:53:04.850 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:04.848+0000 7f449e7fc640 1 bdev(0x7f44800219e0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) open size 5368709120 (0x140000000, 5 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-22T22:53:04.855 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:04.854+0000 7f447a7fc640 1 bdev(0x7f44800219e0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) close 2026-02-22T22:53:05.130 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:05.129+0000 7f449e7fc640 1 bdev(0x7f448001de50 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) open path /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool 2026-02-22T22:53:05.131 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:05.129+0000 7f449e7fc640 0 bdev(0x7f448001de50 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) ioctl(F_SET_FILE_RW_HINT) on /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool failed: (22) Invalid argument 2026-02-22T22:53:05.131 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:05.129+0000 7f449e7fc640 1 bdev(0x7f448001de50 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) open size 5368709120 (0x140000000, 5 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-22T22:53:05.134 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:05.133+0000 7f4488ff9640 1 bdev(0x7f448001de50 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) close 2026-02-22T22:53:05.428 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:05.426+0000 7f449effd640 1 bdev(0x7f447c003800 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) open path /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool 2026-02-22T22:53:05.428 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:05.426+0000 7f449effd640 0 bdev(0x7f447c003800 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) ioctl(F_SET_FILE_RW_HINT) on /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool failed: (22) Invalid argument 2026-02-22T22:53:05.428 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:05.426+0000 7f449effd640 1 bdev(0x7f447c003800 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) open size 5368709120 (0x140000000, 5 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-22T22:53:06.417 INFO:teuthology.orchestra.run.trial144.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete...2026-02-22T22:53:06.416+0000 7f447a7fc640 1 bdev(0x7f447c003800 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.1071f8f26218.pool) close 2026-02-22T22:53:06.462 INFO:teuthology.orchestra.run.trial144.stderr: Removing image: 100% complete...done. 2026-02-22T22:53:06.467 INFO:tasks.rbd:Deleting rbd images... 2026-02-22T22:53:06.467 DEBUG:teuthology.orchestra.run.trial144:> rm -f /home/ubuntu/cephtest/passphrase 2026-02-22T22:53:06.483 DEBUG:teuthology.orchestra.run.trial144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rbd --cluster ceph -p rbd rm client.0.1 2026-02-22T22:53:06.577 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.576+0000 7f70af7fe640 1 bdev(0x7f709401e8b0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) open path /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool 2026-02-22T22:53:06.577 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.576+0000 7f70af7fe640 0 bdev(0x7f709401e8b0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) ioctl(F_SET_FILE_RW_HINT) on /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool failed: (22) Invalid argument 2026-02-22T22:53:06.578 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.577+0000 7f70af7fe640 1 bdev(0x7f709401e8b0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) open size 5368709120 (0x140000000, 5 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-22T22:53:06.583 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.582+0000 7f70937fe640 1 bdev(0x7f709401e8b0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) close 2026-02-22T22:53:06.863 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.862+0000 7f70af7fe640 1 bdev(0x7f709401bdd0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) open path /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool 2026-02-22T22:53:06.864 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.862+0000 7f70af7fe640 0 bdev(0x7f709401bdd0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) ioctl(F_SET_FILE_RW_HINT) on /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool failed: (22) Invalid argument 2026-02-22T22:53:06.864 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.862+0000 7f70af7fe640 1 bdev(0x7f709401bdd0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) open size 5368709120 (0x140000000, 5 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-22T22:53:06.868 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:06.867+0000 7f7099ffb640 1 bdev(0x7f709401bdd0 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) close 2026-02-22T22:53:07.160 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:07.158+0000 7f70af7fe640 1 bdev(0x7f7094017970 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) open path /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool 2026-02-22T22:53:07.160 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:07.158+0000 7f70af7fe640 0 bdev(0x7f7094017970 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) ioctl(F_SET_FILE_RW_HINT) on /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool failed: (22) Invalid argument 2026-02-22T22:53:07.160 INFO:teuthology.orchestra.run.trial144.stderr:2026-02-22T22:53:07.158+0000 7f70af7fe640 1 bdev(0x7f7094017970 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) open size 5368709120 (0x140000000, 5 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-22T22:53:07.820 INFO:teuthology.orchestra.run.trial144.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete...2026-02-22T22:53:07.819+0000 7f70937fe640 1 bdev(0x7f7094017970 /home/ubuntu/cephtest/rbd-pwl-cache/rbd-pwl.rbd.106b4e0aabbd.pool) close 2026-02-22T22:53:07.944 INFO:teuthology.orchestra.run.trial144.stderr: Removing image: 100% complete...done. 2026-02-22T22:53:07.949 ERROR:teuthology.run_tasks:Manager failed: qemu Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/qemu.py", line 728, in task with contextutil.nested(*managers): File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/qemu.py", line 609, in run_qemu remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial144 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2026-02-22T22:53:07.954 DEBUG:teuthology.run_tasks:Unwinding manager exec_on_cleanup 2026-02-22T22:53:07.970 INFO:tasks.exec_on_cleanup:Executing custom commands... 2026-02-22T22:53:07.971 INFO:tasks.exec_on_cleanup:Running commands on role client.0 host ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:53:07.971 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo umount /home/ubuntu/cephtest/rbd-pwl-cache' 2026-02-22T22:53:08.017 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo umount /home/ubuntu/cephtest/tmpfs' 2026-02-22T22:53:08.967 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'rm -rf /home/ubuntu/cephtest/rbd-pwl-cache' 2026-02-22T22:53:08.993 DEBUG:teuthology.orchestra.run.trial144:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'rm -rf /home/ubuntu/cephtest/tmpfs' 2026-02-22T22:53:09.058 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T22:53:09.074 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T22:53:09.074 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:53:09.248 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:53:09.248 INFO:teuthology.orchestra.run.trial125.stderr:dumped all 2026-02-22T22:53:09.255 INFO:teuthology.orchestra.run.trial125.stdout:{"pg_ready":true,"pg_map":{"version":698,"stamp":"2026-02-22T22:53:07.521293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19821033033,"num_objects":4780,"num_object_clones":0,"num_object_copies":9560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4780,"num_whiteouts":0,"num_read":119727,"num_read_kb":2694646,"num_write":1018101,"num_write_kb":89555214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80617,"ondisk_log_size":80617,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":419430400,"kb_used":36738140,"kb_used_data":34086108,"kb_used_omap":21,"kb_used_meta":2651754,"kb_avail":382692260,"statfs":{"total":429496729600,"available":391876874240,"internally_reserved":0,"allocated":34904174592,"data_stored":34902743378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21850,"internal_metadata":2715396774},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2838,"num_write_kb":4242147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001652"},"pg_stats":[{"pgid":"2.7","version":"20'74969","reported_seq":77339,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.390122+0000","last_change":"2026-02-22T22:30:38.413555+0000","last_active":"2026-02-22T22:53:02.390122+0000","last_peered":"2026-02-22T22:53:02.390122+0000","last_clean":"2026-02-22T22:53:02.390122+0000","last_became_active":"2026-02-22T22:30:36.591519+0000","last_became_peered":"2026-02-22T22:30:36.591519+0000","last_unstale":"2026-02-22T22:53:02.390122+0000","last_undegraded":"2026-02-22T22:53:02.390122+0000","last_fullsized":"2026-02-22T22:53:02.390122+0000","mapping_epoch":15,"log_start":"20'64900","ondisk_log_start":"20'64900","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:19.496798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041129399999999998,"stat_sum":{"num_bytes":2470771378,"num_objects":598,"num_object_clones":0,"num_object_copies":1196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":598,"num_whiteouts":0,"num_read":17707,"num_read_kb":298239,"num_write":77529,"num_write_kb":9740463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'141088","reported_seq":148415,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.584764+0000","last_change":"2026-02-22T22:30:38.415953+0000","last_active":"2026-02-22T22:53:02.584764+0000","last_peered":"2026-02-22T22:53:02.584764+0000","last_clean":"2026-02-22T22:53:02.584764+0000","last_became_active":"2026-02-22T22:30:35.408995+0000","last_became_peered":"2026-02-22T22:30:35.408995+0000","last_unstale":"2026-02-22T22:53:02.584764+0000","last_undegraded":"2026-02-22T22:53:02.584764+0000","last_fullsized":"2026-02-22T22:53:02.584764+0000","mapping_epoch":15,"log_start":"20'131000","ondisk_log_start":"20'131000","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:30:01.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037231999999999999,"stat_sum":{"num_bytes":2496157696,"num_objects":601,"num_object_clones":0,"num_object_copies":1202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":601,"num_whiteouts":0,"num_read":7294,"num_read_kb":302561,"num_write":141088,"num_write_kb":9829106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"20'60898","reported_seq":67452,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.516175+0000","last_change":"2026-02-22T22:30:38.413472+0000","last_active":"2026-02-22T22:53:02.516175+0000","last_peered":"2026-02-22T22:53:02.516175+0000","last_clean":"2026-02-22T22:53:02.516175+0000","last_became_active":"2026-02-22T22:30:36.410557+0000","last_became_peered":"2026-02-22T22:30:36.410557+0000","last_unstale":"2026-02-22T22:53:02.516175+0000","last_undegraded":"2026-02-22T22:53:02.516175+0000","last_fullsized":"2026-02-22T22:53:02.516175+0000","mapping_epoch":15,"log_start":"20'50800","ondisk_log_start":"20'50800","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:45.288096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032036500000000003,"stat_sum":{"num_bytes":2494424064,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":6522,"num_read_kb":275420,"num_write":60898,"num_write_kb":11211940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'96358","reported_seq":101552,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.494305+0000","last_change":"2026-02-22T22:30:38.415783+0000","last_active":"2026-02-22T22:53:02.494305+0000","last_peered":"2026-02-22T22:53:02.494305+0000","last_clean":"2026-02-22T22:53:02.494305+0000","last_became_active":"2026-02-22T22:30:35.887940+0000","last_became_peered":"2026-02-22T22:30:35.887940+0000","last_unstale":"2026-02-22T22:53:02.494305+0000","last_undegraded":"2026-02-22T22:53:02.494305+0000","last_fullsized":"2026-02-22T22:53:02.494305+0000","mapping_epoch":15,"log_start":"20'86300","ondisk_log_start":"20'86300","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:01.676975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000214107,"stat_sum":{"num_bytes":2539498658,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":15452,"num_read_kb":298110,"num_write":98072,"num_write_kb":10576062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'92455","reported_seq":99693,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:03.081238+0000","last_change":"2026-02-22T22:30:38.414683+0000","last_active":"2026-02-22T22:53:03.081238+0000","last_peered":"2026-02-22T22:53:03.081238+0000","last_clean":"2026-02-22T22:53:03.081238+0000","last_became_active":"2026-02-22T22:30:35.409017+0000","last_became_peered":"2026-02-22T22:30:35.409017+0000","last_unstale":"2026-02-22T22:53:03.081238+0000","last_undegraded":"2026-02-22T22:53:03.081238+0000","last_fullsized":"2026-02-22T22:53:03.081238+0000","mapping_epoch":15,"log_start":"20'82400","ondisk_log_start":"20'82400","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:13.064583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070440800000000001,"stat_sum":{"num_bytes":2560414227,"num_objects":617,"num_object_clones":0,"num_object_copies":1234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":617,"num_whiteouts":0,"num_read":12202,"num_read_kb":285950,"num_write":92453,"num_write_kb":12557500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'113671","reported_seq":123166,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.613310+0000","last_change":"2026-02-22T22:30:38.415782+0000","last_active":"2026-02-22T22:53:02.613310+0000","last_peered":"2026-02-22T22:53:02.613310+0000","last_clean":"2026-02-22T22:53:02.613310+0000","last_became_active":"2026-02-22T22:30:35.887963+0000","last_became_peered":"2026-02-22T22:30:35.887963+0000","last_unstale":"2026-02-22T22:53:02.613310+0000","last_undegraded":"2026-02-22T22:53:02.613310+0000","last_fullsized":"2026-02-22T22:53:02.613310+0000","mapping_epoch":15,"log_start":"20'103600","ondisk_log_start":"20'103600","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:41.957432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024748899999999999,"stat_sum":{"num_bytes":2397950992,"num_objects":578,"num_object_clones":0,"num_object_copies":1156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":0,"num_read":9465,"num_read_kb":308673,"num_write":113671,"num_write_kb":10933927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'281887","reported_seq":310589,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.918887+0000","last_change":"2026-02-22T22:30:38.414286+0000","last_active":"2026-02-22T22:53:02.918887+0000","last_peered":"2026-02-22T22:53:02.918887+0000","last_clean":"2026-02-22T22:53:02.918887+0000","last_became_active":"2026-02-22T22:30:35.887628+0000","last_became_peered":"2026-02-22T22:30:35.887628+0000","last_unstale":"2026-02-22T22:53:02.918887+0000","last_undegraded":"2026-02-22T22:53:02.918887+0000","last_fullsized":"2026-02-22T22:53:02.918887+0000","mapping_epoch":15,"log_start":"20'271800","ondisk_log_start":"20'271800","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:35:51.047603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031158800000000001,"stat_sum":{"num_bytes":2404470450,"num_objects":580,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":580,"num_whiteouts":0,"num_read":36360,"num_read_kb":600206,"num_write":282377,"num_write_kb":13218969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"20'151919","reported_seq":162655,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.608320+0000","last_change":"2026-02-22T22:30:38.413409+0000","last_active":"2026-02-22T22:53:02.608320+0000","last_peered":"2026-02-22T22:53:02.608320+0000","last_clean":"2026-02-22T22:53:02.608320+0000","last_became_active":"2026-02-22T22:30:36.591493+0000","last_became_peered":"2026-02-22T22:30:36.591493+0000","last_unstale":"2026-02-22T22:53:02.608320+0000","last_undegraded":"2026-02-22T22:53:02.608320+0000","last_fullsized":"2026-02-22T22:53:02.608320+0000","mapping_epoch":15,"log_start":"20'141900","ondisk_log_start":"20'141900","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:58:56.103153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030094900000000001,"stat_sum":{"num_bytes":2456755200,"num_objects":591,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":0,"num_read":14659,"num_read_kb":325432,"num_write":151912,"num_write_kb":11485619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:50:38.430415+0000","last_change":"2026-02-22T22:30:30.421179+0000","last_active":"2026-02-22T22:50:38.430415+0000","last_peered":"2026-02-22T22:50:38.430415+0000","last_clean":"2026-02-22T22:50:38.430415+0000","last_became_active":"2026-02-22T22:30:30.420650+0000","last_became_peered":"2026-02-22T22:30:30.420650+0000","last_unstale":"2026-02-22T22:50:38.430415+0000","last_undegraded":"2026-02-22T22:50:38.430415+0000","last_fullsized":"2026-02-22T22:50:38.430415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_clean_scrub_stamp":"2026-02-22T22:30:29.389678+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:39.255558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19820442665,"num_objects":4778,"num_object_clones":0,"num_object_copies":9556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":119661,"num_read_kb":2694591,"num_write":1018000,"num_write_kb":89553586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34902298624,"data_stored":34901331010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11371,"internal_metadata":0},"log_size":80545,"ondisk_log_size":80545,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673234,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":12593008,"kb_used_data":11994136,"kb_used_omap":6,"kb_used_meta":598841,"kb_avail":92264592,"statfs":{"total":107374182400,"available":94478942208,"internally_reserved":0,"allocated":12281995264,"data_stored":12281567513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":613213938},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673233,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":7870728,"kb_used_data":7092792,"kb_used_omap":1,"kb_used_meta":777918,"kb_avail":96986872,"statfs":{"total":107374182400,"available":99314556928,"internally_reserved":0,"allocated":7263019008,"data_stored":7262735110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":796588487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673235,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":12538672,"kb_used_data":11870824,"kb_used_omap":7,"kb_used_meta":667640,"kb_avail":92318928,"statfs":{"total":107374182400,"available":94534582272,"internally_reserved":0,"allocated":12155723776,"data_stored":12155338667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7455,"internal_metadata":683664097},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705939,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":3735732,"kb_used_data":3128356,"kb_used_omap":6,"kb_used_meta":607353,"kb_avail":101121868,"statfs":{"total":107374182400,"available":103548792832,"internally_reserved":0,"allocated":3203436544,"data_stored":3203102088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6388,"internal_metadata":621930252},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12155551744,"data_stored":12155280759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5862,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7262253056,"data_stored":7262086834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12281229312,"data_stored":12280919237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1930,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3203264512,"data_stored":3203044180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3579,"internal_metadata":0}]}} 2026-02-22T22:53:09.257 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:53:09.416 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:53:09.416 INFO:teuthology.orchestra.run.trial125.stderr:dumped all 2026-02-22T22:53:09.424 INFO:teuthology.orchestra.run.trial125.stdout:{"pg_ready":true,"pg_map":{"version":698,"stamp":"2026-02-22T22:53:07.521293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19821033033,"num_objects":4780,"num_object_clones":0,"num_object_copies":9560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4780,"num_whiteouts":0,"num_read":119727,"num_read_kb":2694646,"num_write":1018101,"num_write_kb":89555214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80617,"ondisk_log_size":80617,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":419430400,"kb_used":36738140,"kb_used_data":34086108,"kb_used_omap":21,"kb_used_meta":2651754,"kb_avail":382692260,"statfs":{"total":429496729600,"available":391876874240,"internally_reserved":0,"allocated":34904174592,"data_stored":34902743378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21850,"internal_metadata":2715396774},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2838,"num_write_kb":4242147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001652"},"pg_stats":[{"pgid":"2.7","version":"20'74969","reported_seq":77339,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.390122+0000","last_change":"2026-02-22T22:30:38.413555+0000","last_active":"2026-02-22T22:53:02.390122+0000","last_peered":"2026-02-22T22:53:02.390122+0000","last_clean":"2026-02-22T22:53:02.390122+0000","last_became_active":"2026-02-22T22:30:36.591519+0000","last_became_peered":"2026-02-22T22:30:36.591519+0000","last_unstale":"2026-02-22T22:53:02.390122+0000","last_undegraded":"2026-02-22T22:53:02.390122+0000","last_fullsized":"2026-02-22T22:53:02.390122+0000","mapping_epoch":15,"log_start":"20'64900","ondisk_log_start":"20'64900","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:19.496798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041129399999999998,"stat_sum":{"num_bytes":2470771378,"num_objects":598,"num_object_clones":0,"num_object_copies":1196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":598,"num_whiteouts":0,"num_read":17707,"num_read_kb":298239,"num_write":77529,"num_write_kb":9740463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'141088","reported_seq":148415,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.584764+0000","last_change":"2026-02-22T22:30:38.415953+0000","last_active":"2026-02-22T22:53:02.584764+0000","last_peered":"2026-02-22T22:53:02.584764+0000","last_clean":"2026-02-22T22:53:02.584764+0000","last_became_active":"2026-02-22T22:30:35.408995+0000","last_became_peered":"2026-02-22T22:30:35.408995+0000","last_unstale":"2026-02-22T22:53:02.584764+0000","last_undegraded":"2026-02-22T22:53:02.584764+0000","last_fullsized":"2026-02-22T22:53:02.584764+0000","mapping_epoch":15,"log_start":"20'131000","ondisk_log_start":"20'131000","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:30:01.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037231999999999999,"stat_sum":{"num_bytes":2496157696,"num_objects":601,"num_object_clones":0,"num_object_copies":1202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":601,"num_whiteouts":0,"num_read":7294,"num_read_kb":302561,"num_write":141088,"num_write_kb":9829106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"20'60898","reported_seq":67452,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.516175+0000","last_change":"2026-02-22T22:30:38.413472+0000","last_active":"2026-02-22T22:53:02.516175+0000","last_peered":"2026-02-22T22:53:02.516175+0000","last_clean":"2026-02-22T22:53:02.516175+0000","last_became_active":"2026-02-22T22:30:36.410557+0000","last_became_peered":"2026-02-22T22:30:36.410557+0000","last_unstale":"2026-02-22T22:53:02.516175+0000","last_undegraded":"2026-02-22T22:53:02.516175+0000","last_fullsized":"2026-02-22T22:53:02.516175+0000","mapping_epoch":15,"log_start":"20'50800","ondisk_log_start":"20'50800","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:45.288096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032036500000000003,"stat_sum":{"num_bytes":2494424064,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":6522,"num_read_kb":275420,"num_write":60898,"num_write_kb":11211940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'96358","reported_seq":101552,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.494305+0000","last_change":"2026-02-22T22:30:38.415783+0000","last_active":"2026-02-22T22:53:02.494305+0000","last_peered":"2026-02-22T22:53:02.494305+0000","last_clean":"2026-02-22T22:53:02.494305+0000","last_became_active":"2026-02-22T22:30:35.887940+0000","last_became_peered":"2026-02-22T22:30:35.887940+0000","last_unstale":"2026-02-22T22:53:02.494305+0000","last_undegraded":"2026-02-22T22:53:02.494305+0000","last_fullsized":"2026-02-22T22:53:02.494305+0000","mapping_epoch":15,"log_start":"20'86300","ondisk_log_start":"20'86300","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:01.676975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000214107,"stat_sum":{"num_bytes":2539498658,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":15452,"num_read_kb":298110,"num_write":98072,"num_write_kb":10576062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'92455","reported_seq":99693,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:03.081238+0000","last_change":"2026-02-22T22:30:38.414683+0000","last_active":"2026-02-22T22:53:03.081238+0000","last_peered":"2026-02-22T22:53:03.081238+0000","last_clean":"2026-02-22T22:53:03.081238+0000","last_became_active":"2026-02-22T22:30:35.409017+0000","last_became_peered":"2026-02-22T22:30:35.409017+0000","last_unstale":"2026-02-22T22:53:03.081238+0000","last_undegraded":"2026-02-22T22:53:03.081238+0000","last_fullsized":"2026-02-22T22:53:03.081238+0000","mapping_epoch":15,"log_start":"20'82400","ondisk_log_start":"20'82400","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:13.064583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070440800000000001,"stat_sum":{"num_bytes":2560414227,"num_objects":617,"num_object_clones":0,"num_object_copies":1234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":617,"num_whiteouts":0,"num_read":12202,"num_read_kb":285950,"num_write":92453,"num_write_kb":12557500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'113671","reported_seq":123166,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.613310+0000","last_change":"2026-02-22T22:30:38.415782+0000","last_active":"2026-02-22T22:53:02.613310+0000","last_peered":"2026-02-22T22:53:02.613310+0000","last_clean":"2026-02-22T22:53:02.613310+0000","last_became_active":"2026-02-22T22:30:35.887963+0000","last_became_peered":"2026-02-22T22:30:35.887963+0000","last_unstale":"2026-02-22T22:53:02.613310+0000","last_undegraded":"2026-02-22T22:53:02.613310+0000","last_fullsized":"2026-02-22T22:53:02.613310+0000","mapping_epoch":15,"log_start":"20'103600","ondisk_log_start":"20'103600","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:41.957432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024748899999999999,"stat_sum":{"num_bytes":2397950992,"num_objects":578,"num_object_clones":0,"num_object_copies":1156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":0,"num_read":9465,"num_read_kb":308673,"num_write":113671,"num_write_kb":10933927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'281887","reported_seq":310589,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.918887+0000","last_change":"2026-02-22T22:30:38.414286+0000","last_active":"2026-02-22T22:53:02.918887+0000","last_peered":"2026-02-22T22:53:02.918887+0000","last_clean":"2026-02-22T22:53:02.918887+0000","last_became_active":"2026-02-22T22:30:35.887628+0000","last_became_peered":"2026-02-22T22:30:35.887628+0000","last_unstale":"2026-02-22T22:53:02.918887+0000","last_undegraded":"2026-02-22T22:53:02.918887+0000","last_fullsized":"2026-02-22T22:53:02.918887+0000","mapping_epoch":15,"log_start":"20'271800","ondisk_log_start":"20'271800","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:35:51.047603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031158800000000001,"stat_sum":{"num_bytes":2404470450,"num_objects":580,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":580,"num_whiteouts":0,"num_read":36360,"num_read_kb":600206,"num_write":282377,"num_write_kb":13218969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"20'151919","reported_seq":162655,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:02.608320+0000","last_change":"2026-02-22T22:30:38.413409+0000","last_active":"2026-02-22T22:53:02.608320+0000","last_peered":"2026-02-22T22:53:02.608320+0000","last_clean":"2026-02-22T22:53:02.608320+0000","last_became_active":"2026-02-22T22:30:36.591493+0000","last_became_peered":"2026-02-22T22:30:36.591493+0000","last_unstale":"2026-02-22T22:53:02.608320+0000","last_undegraded":"2026-02-22T22:53:02.608320+0000","last_fullsized":"2026-02-22T22:53:02.608320+0000","mapping_epoch":15,"log_start":"20'141900","ondisk_log_start":"20'141900","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:58:56.103153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030094900000000001,"stat_sum":{"num_bytes":2456755200,"num_objects":591,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":0,"num_read":14659,"num_read_kb":325432,"num_write":151912,"num_write_kb":11485619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:50:38.430415+0000","last_change":"2026-02-22T22:30:30.421179+0000","last_active":"2026-02-22T22:50:38.430415+0000","last_peered":"2026-02-22T22:50:38.430415+0000","last_clean":"2026-02-22T22:50:38.430415+0000","last_became_active":"2026-02-22T22:30:30.420650+0000","last_became_peered":"2026-02-22T22:30:30.420650+0000","last_unstale":"2026-02-22T22:50:38.430415+0000","last_undegraded":"2026-02-22T22:50:38.430415+0000","last_fullsized":"2026-02-22T22:50:38.430415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_clean_scrub_stamp":"2026-02-22T22:30:29.389678+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:39.255558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19820442665,"num_objects":4778,"num_object_clones":0,"num_object_copies":9556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":119661,"num_read_kb":2694591,"num_write":1018000,"num_write_kb":89553586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34902298624,"data_stored":34901331010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11371,"internal_metadata":0},"log_size":80545,"ondisk_log_size":80545,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673234,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":12593008,"kb_used_data":11994136,"kb_used_omap":6,"kb_used_meta":598841,"kb_avail":92264592,"statfs":{"total":107374182400,"available":94478942208,"internally_reserved":0,"allocated":12281995264,"data_stored":12281567513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":613213938},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673233,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":7870728,"kb_used_data":7092792,"kb_used_omap":1,"kb_used_meta":777918,"kb_avail":96986872,"statfs":{"total":107374182400,"available":99314556928,"internally_reserved":0,"allocated":7263019008,"data_stored":7262735110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":796588487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673235,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":12538672,"kb_used_data":11870824,"kb_used_omap":7,"kb_used_meta":667640,"kb_avail":92318928,"statfs":{"total":107374182400,"available":94534582272,"internally_reserved":0,"allocated":12155723776,"data_stored":12155338667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7455,"internal_metadata":683664097},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705939,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":3735732,"kb_used_data":3128356,"kb_used_omap":6,"kb_used_meta":607353,"kb_avail":101121868,"statfs":{"total":107374182400,"available":103548792832,"internally_reserved":0,"allocated":3203436544,"data_stored":3203102088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6388,"internal_metadata":621930252},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12155551744,"data_stored":12155280759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5862,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7262253056,"data_stored":7262086834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12281229312,"data_stored":12280919237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1930,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3203264512,"data_stored":3203044180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3579,"internal_metadata":0}]}} 2026-02-22T22:53:09.426 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T22:53:09.426 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:53:09.582 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:53:09.582 INFO:teuthology.orchestra.run.trial125.stderr:dumped all 2026-02-22T22:53:09.590 INFO:teuthology.orchestra.run.trial125.stdout:{"pg_ready":true,"pg_map":{"version":699,"stamp":"2026-02-22T22:53:09.521495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1901846757,"num_objects":500,"num_object_clones":0,"num_object_copies":1000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":119987,"num_read_kb":2694880,"num_write":1022473,"num_write_kb":89555270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80399,"ondisk_log_size":80399,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":419430400,"kb_used":9435424,"kb_used_data":6735004,"kb_used_omap":21,"kb_used_meta":2700330,"kb_avail":409994976,"statfs":{"total":429496729600,"available":419834855424,"internally_reserved":0,"allocated":6896644096,"data_stored":6895237452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21850,"internal_metadata":2765138598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17919186276,"num_objects":-4280,"num_object_clones":0,"num_object_copies":-8560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4280,"num_whiteouts":0,"num_read":266,"num_read_kb":240,"num_write":7210,"num_write_kb":4242203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001608"},"pg_stats":[{"pgid":"2.7","version":"20'75508","reported_seq":77881,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.816473+0000","last_change":"2026-02-22T22:30:38.413555+0000","last_active":"2026-02-22T22:53:07.816473+0000","last_peered":"2026-02-22T22:53:07.816473+0000","last_clean":"2026-02-22T22:53:07.816473+0000","last_became_active":"2026-02-22T22:30:36.591519+0000","last_became_peered":"2026-02-22T22:30:36.591519+0000","last_unstale":"2026-02-22T22:53:07.816473+0000","last_undegraded":"2026-02-22T22:53:07.816473+0000","last_fullsized":"2026-02-22T22:53:07.816473+0000","mapping_epoch":15,"log_start":"20'65500","ondisk_log_start":"20'65500","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:19.496798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041129399999999998,"stat_sum":{"num_bytes":251975696,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":17731,"num_read_kb":298258,"num_write":78070,"num_write_kb":9740467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'141619","reported_seq":148946,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.813180+0000","last_change":"2026-02-22T22:30:38.415953+0000","last_active":"2026-02-22T22:53:07.813180+0000","last_peered":"2026-02-22T22:53:07.813180+0000","last_clean":"2026-02-22T22:53:07.813180+0000","last_became_active":"2026-02-22T22:30:35.408995+0000","last_became_peered":"2026-02-22T22:30:35.408995+0000","last_unstale":"2026-02-22T22:53:07.813180+0000","last_undegraded":"2026-02-22T22:53:07.813180+0000","last_fullsized":"2026-02-22T22:53:07.813180+0000","mapping_epoch":15,"log_start":"20'131600","ondisk_log_start":"20'131600","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:30:01.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037231999999999999,"stat_sum":{"num_bytes":277370880,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":7294,"num_read_kb":302561,"num_write":141617,"num_write_kb":9829106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"20'61432","reported_seq":67986,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.811929+0000","last_change":"2026-02-22T22:30:38.413472+0000","last_active":"2026-02-22T22:53:07.811929+0000","last_peered":"2026-02-22T22:53:07.811929+0000","last_clean":"2026-02-22T22:53:07.811929+0000","last_became_active":"2026-02-22T22:30:36.410557+0000","last_became_peered":"2026-02-22T22:30:36.410557+0000","last_unstale":"2026-02-22T22:53:07.811929+0000","last_undegraded":"2026-02-22T22:53:07.811929+0000","last_fullsized":"2026-02-22T22:53:07.811929+0000","mapping_epoch":15,"log_start":"20'51400","ondisk_log_start":"20'51400","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:45.288096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032036500000000003,"stat_sum":{"num_bytes":254665728,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":6522,"num_read_kb":275420,"num_write":61432,"num_write_kb":11211940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'96921","reported_seq":102124,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.927678+0000","last_change":"2026-02-22T22:30:38.415783+0000","last_active":"2026-02-22T22:53:07.927678+0000","last_peered":"2026-02-22T22:53:07.927678+0000","last_clean":"2026-02-22T22:53:07.927678+0000","last_became_active":"2026-02-22T22:30:35.887940+0000","last_became_peered":"2026-02-22T22:30:35.887940+0000","last_unstale":"2026-02-22T22:53:07.927678+0000","last_undegraded":"2026-02-22T22:53:07.927678+0000","last_fullsized":"2026-02-22T22:53:07.927678+0000","mapping_epoch":15,"log_start":"20'86900","ondisk_log_start":"20'86900","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:01.676975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000214107,"stat_sum":{"num_bytes":224287232,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":15486,"num_read_kb":298139,"num_write":98639,"num_write_kb":10576066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'93043","reported_seq":100368,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.815731+0000","last_change":"2026-02-22T22:30:38.414683+0000","last_active":"2026-02-22T22:53:07.815731+0000","last_peered":"2026-02-22T22:53:07.815731+0000","last_clean":"2026-02-22T22:53:07.815731+0000","last_became_active":"2026-02-22T22:30:35.409017+0000","last_became_peered":"2026-02-22T22:30:35.409017+0000","last_unstale":"2026-02-22T22:53:07.815731+0000","last_undegraded":"2026-02-22T22:53:07.815731+0000","last_fullsized":"2026-02-22T22:53:07.815731+0000","mapping_epoch":15,"log_start":"20'83000","ondisk_log_start":"20'83000","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:13.064583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070440800000000001,"stat_sum":{"num_bytes":254456339,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":12301,"num_read_kb":286041,"num_write":93034,"num_write_kb":12557521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'114192","reported_seq":123687,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.808595+0000","last_change":"2026-02-22T22:30:38.415782+0000","last_active":"2026-02-22T22:53:07.808595+0000","last_peered":"2026-02-22T22:53:07.808595+0000","last_clean":"2026-02-22T22:53:07.808595+0000","last_became_active":"2026-02-22T22:30:35.887963+0000","last_became_peered":"2026-02-22T22:30:35.887963+0000","last_unstale":"2026-02-22T22:53:07.808595+0000","last_undegraded":"2026-02-22T22:53:07.808595+0000","last_fullsized":"2026-02-22T22:53:07.808595+0000","mapping_epoch":15,"log_start":"20'104100","ondisk_log_start":"20'104100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:41.957432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024748899999999999,"stat_sum":{"num_bytes":216912896,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":9465,"num_read_kb":308673,"num_write":114192,"num_write_kb":10933927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'282455","reported_seq":311236,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.931964+0000","last_change":"2026-02-22T22:30:38.414286+0000","last_active":"2026-02-22T22:53:07.931964+0000","last_peered":"2026-02-22T22:53:07.931964+0000","last_clean":"2026-02-22T22:53:07.931964+0000","last_became_active":"2026-02-22T22:30:35.887628+0000","last_became_peered":"2026-02-22T22:30:35.887628+0000","last_unstale":"2026-02-22T22:53:07.931964+0000","last_undegraded":"2026-02-22T22:53:07.931964+0000","last_fullsized":"2026-02-22T22:53:07.931964+0000","mapping_epoch":15,"log_start":"20'272400","ondisk_log_start":"20'272400","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:35:51.047603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031158800000000001,"stat_sum":{"num_bytes":187813538,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":36451,"num_read_kb":600289,"num_write":282938,"num_write_kb":13218990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"20'152457","reported_seq":163201,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.942982+0000","last_change":"2026-02-22T22:30:38.413409+0000","last_active":"2026-02-22T22:53:07.942982+0000","last_peered":"2026-02-22T22:53:07.942982+0000","last_clean":"2026-02-22T22:53:07.942982+0000","last_became_active":"2026-02-22T22:30:36.591493+0000","last_became_peered":"2026-02-22T22:30:36.591493+0000","last_unstale":"2026-02-22T22:53:07.942982+0000","last_undegraded":"2026-02-22T22:53:07.942982+0000","last_fullsized":"2026-02-22T22:53:07.942982+0000","mapping_epoch":15,"log_start":"20'142400","ondisk_log_start":"20'142400","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:58:56.103153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030094900000000001,"stat_sum":{"num_bytes":233774080,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":14671,"num_read_kb":325444,"num_write":152450,"num_write_kb":11485625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:50:38.430415+0000","last_change":"2026-02-22T22:30:30.421179+0000","last_active":"2026-02-22T22:50:38.430415+0000","last_peered":"2026-02-22T22:50:38.430415+0000","last_clean":"2026-02-22T22:50:38.430415+0000","last_became_active":"2026-02-22T22:30:30.420650+0000","last_became_peered":"2026-02-22T22:30:30.420650+0000","last_unstale":"2026-02-22T22:50:38.430415+0000","last_undegraded":"2026-02-22T22:50:38.430415+0000","last_fullsized":"2026-02-22T22:50:38.430415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_clean_scrub_stamp":"2026-02-22T22:30:29.389678+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:39.255558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1901256389,"num_objects":498,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":119921,"num_read_kb":2694825,"num_write":1022372,"num_write_kb":89553642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5804212224,"data_stored":5803271228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11371,"internal_metadata":0},"log_size":80327,"ondisk_log_size":80327,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673235,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1631472,"kb_used_data":1002076,"kb_used_omap":6,"kb_used_meta":629369,"kb_avail":103226128,"statfs":{"total":107374182400,"available":105703555072,"internally_reserved":0,"allocated":1026125824,"data_stored":1025709671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":644474610},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673234,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":2426412,"kb_used_data":1644316,"kb_used_omap":1,"kb_used_meta":782078,"kb_avail":102431188,"statfs":{"total":107374182400,"available":104889536512,"internally_reserved":0,"allocated":1683779584,"data_stored":1683499108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":800848327},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673236,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1641808,"kb_used_data":960256,"kb_used_omap":7,"kb_used_meta":681528,"kb_avail":103215792,"statfs":{"total":107374182400,"available":105692971008,"internally_reserved":0,"allocated":983302144,"data_stored":982926585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7455,"internal_metadata":697885409},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705939,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":3735732,"kb_used_data":3128356,"kb_used_omap":6,"kb_used_meta":607353,"kb_avail":101121868,"statfs":{"total":107374182400,"available":103548792832,"internally_reserved":0,"allocated":3203436544,"data_stored":3203102088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6388,"internal_metadata":621930252},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":983130112,"data_stored":982868677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5862,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":592457728,"data_stored":592296976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1025359872,"data_stored":1025061395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1930,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3203264512,"data_stored":3203044180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3579,"internal_metadata":0}]}} 2026-02-22T22:53:09.592 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:53:09.747 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:53:09.748 INFO:teuthology.orchestra.run.trial125.stdout:{"epoch":20,"fsid":"d59c90c8-7ec2-4873-b6be-8a8b1253060c","created":"2026-02-22T22:30:19.256654+0000","modified":"2026-02-22T22:30:44.025230+0000","last_up_change":"2026-02-22T22:30:27.386471+0000","last_in_change":"2026-02-22T22:30:20.000127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:30:29.380769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:30:33.953209+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9be3c328-d53f-4b08-9d13-b41135afbf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6810","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6811","nonce":489417350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6812","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6813","nonce":489417350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6816","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6817","nonce":489417350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6814","nonce":489417350},{"type":"v1","addr":"10.20.193.125:6815","nonce":489417350}]},"public_addr":"10.20.193.125:6811/489417350","cluster_addr":"10.20.193.125:6813/489417350","heartbeat_back_addr":"10.20.193.125:6817/489417350","heartbeat_front_addr":"10.20.193.125:6815/489417350","state":["exists","up"]},{"osd":1,"uuid":"3f2ef6e5-b1eb-44a4-a94d-10e412019f03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6802","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6803","nonce":4038169865}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6804","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6805","nonce":4038169865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6808","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6809","nonce":4038169865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.125:6806","nonce":4038169865},{"type":"v1","addr":"10.20.193.125:6807","nonce":4038169865}]},"public_addr":"10.20.193.125:6803/4038169865","cluster_addr":"10.20.193.125:6805/4038169865","heartbeat_back_addr":"10.20.193.125:6809/4038169865","heartbeat_front_addr":"10.20.193.125:6807/4038169865","state":["exists","up"]},{"osd":2,"uuid":"4a3c5816-481d-453e-b015-51cd5c58442d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6808","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6809","nonce":304017367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6810","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6811","nonce":304017367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6814","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6815","nonce":304017367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6812","nonce":304017367},{"type":"v1","addr":"10.20.193.144:6813","nonce":304017367}]},"public_addr":"10.20.193.144:6809/304017367","cluster_addr":"10.20.193.144:6811/304017367","heartbeat_back_addr":"10.20.193.144:6815/304017367","heartbeat_front_addr":"10.20.193.144:6813/304017367","state":["exists","up"]},{"osd":3,"uuid":"210204fa-693c-4cd1-94ec-2bdd5376f34b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6800","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6801","nonce":3084229140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6802","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6803","nonce":3084229140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6806","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6807","nonce":3084229140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.144:6804","nonce":3084229140},{"type":"v1","addr":"10.20.193.144:6805","nonce":3084229140}]},"public_addr":"10.20.193.144:6801/3084229140","cluster_addr":"10.20.193.144:6803/3084229140","heartbeat_back_addr":"10.20.193.144:6807/3084229140","heartbeat_front_addr":"10.20.193.144:6805/3084229140","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.566284+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.365959+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.375505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:30:25.156486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:53:10.758 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T22:53:10.758 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:53:10.841 INFO:teuthology.orchestra.run.trial125.stdout:{ 2026-02-22T22:53:10.842 INFO:teuthology.orchestra.run.trial125.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:53:10.842 INFO:teuthology.orchestra.run.trial125.stdout:} 2026-02-22T22:53:10.848 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T22:53:11.006 INFO:teuthology.orchestra.run.trial125.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T22:53:11.016 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T22:53:11.016 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:53:11.096 INFO:teuthology.orchestra.run.trial125.stdout:{ 2026-02-22T22:53:11.096 INFO:teuthology.orchestra.run.trial125.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:53:11.097 INFO:teuthology.orchestra.run.trial125.stdout:} 2026-02-22T22:53:11.102 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T22:53:11.261 INFO:teuthology.orchestra.run.trial125.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T22:53:11.269 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T22:53:11.269 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:53:11.351 INFO:teuthology.orchestra.run.trial125.stdout:{ 2026-02-22T22:53:11.351 INFO:teuthology.orchestra.run.trial125.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:53:11.351 INFO:teuthology.orchestra.run.trial125.stdout:} 2026-02-22T22:53:11.356 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T22:53:11.515 INFO:teuthology.orchestra.run.trial125.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T22:53:11.524 INFO:tasks.ceph:Scrubbing osd.3 2026-02-22T22:53:11.524 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:53:11.605 INFO:teuthology.orchestra.run.trial125.stdout:{ 2026-02-22T22:53:11.605 INFO:teuthology.orchestra.run.trial125.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:53:11.605 INFO:teuthology.orchestra.run.trial125.stdout:} 2026-02-22T22:53:11.611 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-22T22:53:11.769 INFO:teuthology.orchestra.run.trial125.stderr:instructed osd(s) 3 to deep-scrub 2026-02-22T22:53:11.779 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:53:11.936 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:53:11.937 INFO:teuthology.orchestra.run.trial125.stderr:dumped all 2026-02-22T22:53:11.944 INFO:teuthology.orchestra.run.trial125.stdout:{"pg_ready":true,"pg_map":{"version":700,"stamp":"2026-02-22T22:53:11.521731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1901846757,"num_objects":500,"num_object_clones":0,"num_object_copies":1000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":119987,"num_read_kb":2694880,"num_write":1022473,"num_write_kb":89555270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80399,"ondisk_log_size":80399,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":419430400,"kb_used":6807692,"kb_used_data":4103108,"kb_used_omap":21,"kb_used_meta":2704490,"kb_avail":412622708,"statfs":{"total":429496729600,"available":422525652992,"internally_reserved":0,"allocated":4201582592,"data_stored":4200187546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21850,"internal_metadata":2769398438},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17919186276,"num_objects":-4280,"num_object_clones":0,"num_object_copies":-8560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4280,"num_whiteouts":0,"num_read":266,"num_read_kb":240,"num_write":5519,"num_write_kb":2055312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001602"},"pg_stats":[{"pgid":"2.7","version":"20'75508","reported_seq":77881,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.816473+0000","last_change":"2026-02-22T22:30:38.413555+0000","last_active":"2026-02-22T22:53:07.816473+0000","last_peered":"2026-02-22T22:53:07.816473+0000","last_clean":"2026-02-22T22:53:07.816473+0000","last_became_active":"2026-02-22T22:30:36.591519+0000","last_became_peered":"2026-02-22T22:30:36.591519+0000","last_unstale":"2026-02-22T22:53:07.816473+0000","last_undegraded":"2026-02-22T22:53:07.816473+0000","last_fullsized":"2026-02-22T22:53:07.816473+0000","mapping_epoch":15,"log_start":"20'65500","ondisk_log_start":"20'65500","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:36:19.496798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041129399999999998,"stat_sum":{"num_bytes":251975696,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":17731,"num_read_kb":298258,"num_write":78070,"num_write_kb":9740467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'141619","reported_seq":148946,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.813180+0000","last_change":"2026-02-22T22:30:38.415953+0000","last_active":"2026-02-22T22:53:07.813180+0000","last_peered":"2026-02-22T22:53:07.813180+0000","last_clean":"2026-02-22T22:53:07.813180+0000","last_became_active":"2026-02-22T22:30:35.408995+0000","last_became_peered":"2026-02-22T22:30:35.408995+0000","last_unstale":"2026-02-22T22:53:07.813180+0000","last_undegraded":"2026-02-22T22:53:07.813180+0000","last_fullsized":"2026-02-22T22:53:07.813180+0000","mapping_epoch":15,"log_start":"20'131600","ondisk_log_start":"20'131600","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:30:01.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037231999999999999,"stat_sum":{"num_bytes":277370880,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":7294,"num_read_kb":302561,"num_write":141617,"num_write_kb":9829106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"20'61432","reported_seq":67986,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.811929+0000","last_change":"2026-02-22T22:30:38.413472+0000","last_active":"2026-02-22T22:53:07.811929+0000","last_peered":"2026-02-22T22:53:07.811929+0000","last_clean":"2026-02-22T22:53:07.811929+0000","last_became_active":"2026-02-22T22:30:36.410557+0000","last_became_peered":"2026-02-22T22:30:36.410557+0000","last_unstale":"2026-02-22T22:53:07.811929+0000","last_undegraded":"2026-02-22T22:53:07.811929+0000","last_fullsized":"2026-02-22T22:53:07.811929+0000","mapping_epoch":15,"log_start":"20'51400","ondisk_log_start":"20'51400","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:45.288096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032036500000000003,"stat_sum":{"num_bytes":254665728,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":6522,"num_read_kb":275420,"num_write":61432,"num_write_kb":11211940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'96921","reported_seq":102124,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.927678+0000","last_change":"2026-02-22T22:30:38.415783+0000","last_active":"2026-02-22T22:53:07.927678+0000","last_peered":"2026-02-22T22:53:07.927678+0000","last_clean":"2026-02-22T22:53:07.927678+0000","last_became_active":"2026-02-22T22:30:35.887940+0000","last_became_peered":"2026-02-22T22:30:35.887940+0000","last_unstale":"2026-02-22T22:53:07.927678+0000","last_undegraded":"2026-02-22T22:53:07.927678+0000","last_fullsized":"2026-02-22T22:53:07.927678+0000","mapping_epoch":15,"log_start":"20'86900","ondisk_log_start":"20'86900","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:01:01.676975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000214107,"stat_sum":{"num_bytes":224287232,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":15486,"num_read_kb":298139,"num_write":98639,"num_write_kb":10576066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'93043","reported_seq":100368,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.815731+0000","last_change":"2026-02-22T22:30:38.414683+0000","last_active":"2026-02-22T22:53:07.815731+0000","last_peered":"2026-02-22T22:53:07.815731+0000","last_clean":"2026-02-22T22:53:07.815731+0000","last_became_active":"2026-02-22T22:30:35.409017+0000","last_became_peered":"2026-02-22T22:30:35.409017+0000","last_unstale":"2026-02-22T22:53:07.815731+0000","last_undegraded":"2026-02-22T22:53:07.815731+0000","last_fullsized":"2026-02-22T22:53:07.815731+0000","mapping_epoch":15,"log_start":"20'83000","ondisk_log_start":"20'83000","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:13.064583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070440800000000001,"stat_sum":{"num_bytes":254456339,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":12301,"num_read_kb":286041,"num_write":93034,"num_write_kb":12557521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'114192","reported_seq":123687,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.808595+0000","last_change":"2026-02-22T22:30:38.415782+0000","last_active":"2026-02-22T22:53:07.808595+0000","last_peered":"2026-02-22T22:53:07.808595+0000","last_clean":"2026-02-22T22:53:07.808595+0000","last_became_active":"2026-02-22T22:30:35.887963+0000","last_became_peered":"2026-02-22T22:30:35.887963+0000","last_unstale":"2026-02-22T22:53:07.808595+0000","last_undegraded":"2026-02-22T22:53:07.808595+0000","last_fullsized":"2026-02-22T22:53:07.808595+0000","mapping_epoch":15,"log_start":"20'104100","ondisk_log_start":"20'104100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:22:41.957432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024748899999999999,"stat_sum":{"num_bytes":216912896,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":9465,"num_read_kb":308673,"num_write":114192,"num_write_kb":10933927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'282455","reported_seq":311236,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.931964+0000","last_change":"2026-02-22T22:30:38.414286+0000","last_active":"2026-02-22T22:53:07.931964+0000","last_peered":"2026-02-22T22:53:07.931964+0000","last_clean":"2026-02-22T22:53:07.931964+0000","last_became_active":"2026-02-22T22:30:35.887628+0000","last_became_peered":"2026-02-22T22:30:35.887628+0000","last_unstale":"2026-02-22T22:53:07.931964+0000","last_undegraded":"2026-02-22T22:53:07.931964+0000","last_fullsized":"2026-02-22T22:53:07.931964+0000","mapping_epoch":15,"log_start":"20'272400","ondisk_log_start":"20'272400","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:35:51.047603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031158800000000001,"stat_sum":{"num_bytes":187813538,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":36451,"num_read_kb":600289,"num_write":282938,"num_write_kb":13218990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"20'152457","reported_seq":163201,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:07.942982+0000","last_change":"2026-02-22T22:30:38.413409+0000","last_active":"2026-02-22T22:53:07.942982+0000","last_peered":"2026-02-22T22:53:07.942982+0000","last_clean":"2026-02-22T22:53:07.942982+0000","last_became_active":"2026-02-22T22:30:36.591493+0000","last_became_peered":"2026-02-22T22:30:36.591493+0000","last_unstale":"2026-02-22T22:53:07.942982+0000","last_undegraded":"2026-02-22T22:53:07.942982+0000","last_fullsized":"2026-02-22T22:53:07.942982+0000","mapping_epoch":15,"log_start":"20'142400","ondisk_log_start":"20'142400","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:34.399845+0000","last_clean_scrub_stamp":"2026-02-22T22:30:34.399845+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:58:56.103153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030094900000000001,"stat_sum":{"num_bytes":233774080,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":14671,"num_read_kb":325444,"num_write":152450,"num_write_kb":11485625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:50:38.430415+0000","last_change":"2026-02-22T22:30:30.421179+0000","last_active":"2026-02-22T22:50:38.430415+0000","last_peered":"2026-02-22T22:50:38.430415+0000","last_clean":"2026-02-22T22:50:38.430415+0000","last_became_active":"2026-02-22T22:30:30.420650+0000","last_became_peered":"2026-02-22T22:30:30.420650+0000","last_unstale":"2026-02-22T22:50:38.430415+0000","last_undegraded":"2026-02-22T22:50:38.430415+0000","last_fullsized":"2026-02-22T22:50:38.430415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:30:29.389678+0000","last_clean_scrub_stamp":"2026-02-22T22:30:29.389678+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:48:39.255558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1901256389,"num_objects":498,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":119921,"num_read_kb":2694825,"num_write":1022372,"num_write_kb":89553642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3109150720,"data_stored":3108221322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11371,"internal_metadata":0},"log_size":80327,"ondisk_log_size":80327,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673235,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1631472,"kb_used_data":1002076,"kb_used_omap":6,"kb_used_meta":629369,"kb_avail":103226128,"statfs":{"total":107374182400,"available":105703555072,"internally_reserved":0,"allocated":1026125824,"data_stored":1025709671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":644474610},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673234,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":2426412,"kb_used_data":1644316,"kb_used_omap":1,"kb_used_meta":782078,"kb_avail":102431188,"statfs":{"total":107374182400,"available":104889536512,"internally_reserved":0,"allocated":1683779584,"data_stored":1683499108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":800848327},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673236,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1641808,"kb_used_data":960256,"kb_used_omap":7,"kb_used_meta":681528,"kb_avail":103215792,"statfs":{"total":107374182400,"available":105692971008,"internally_reserved":0,"allocated":983302144,"data_stored":982926585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7455,"internal_metadata":697885409},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705940,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1108000,"kb_used_data":496460,"kb_used_omap":6,"kb_used_meta":611513,"kb_avail":103749600,"statfs":{"total":107374182400,"available":106239590400,"internally_reserved":0,"allocated":508375040,"data_stored":508052182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6388,"internal_metadata":626190092},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":983130112,"data_stored":982868677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5862,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":592457728,"data_stored":592296976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1025359872,"data_stored":1025061395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1930,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":508203008,"data_stored":507994274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3579,"internal_metadata":0}]}} 2026-02-22T22:53:11.949 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.950 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.950 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.950 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.950 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.950 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.951 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.951 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-22T22:30:34.399845+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.951 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T22:30:29.389678+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=30, tm_sec=29, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=53, tm_sec=9, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:53:11.951 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T22:53:31.952 DEBUG:teuthology.orchestra.run.trial125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:53:32.111 INFO:teuthology.orchestra.run.trial125.stdout: 2026-02-22T22:53:32.112 INFO:teuthology.orchestra.run.trial125.stderr:dumped all 2026-02-22T22:53:32.120 INFO:teuthology.orchestra.run.trial125.stdout:{"pg_ready":true,"pg_map":{"version":710,"stamp":"2026-02-22T22:53:31.523657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1901846757,"num_objects":500,"num_object_clones":0,"num_object_copies":1000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":119987,"num_read_kb":2694880,"num_write":1022473,"num_write_kb":89555270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":104,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80497,"ondisk_log_size":80497,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":419430400,"kb_used":5730208,"kb_used_data":3038112,"kb_used_omap":21,"kb_used_meta":2692010,"kb_avail":413700192,"statfs":{"total":429496729600,"available":423628996608,"internally_reserved":0,"allocated":3111026688,"data_stored":3109633690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21850,"internal_metadata":2756618918},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000920"},"pg_stats":[{"pgid":"2.7","version":"20'75575","reported_seq":77961,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:13.893511+0000","last_change":"2026-02-22T22:53:13.893524+0000","last_active":"2026-02-22T22:53:13.893511+0000","last_peered":"2026-02-22T22:53:13.893511+0000","last_clean":"2026-02-22T22:53:13.893511+0000","last_became_active":"2026-02-22T22:30:36.591519+0000","last_became_peered":"2026-02-22T22:30:36.591519+0000","last_unstale":"2026-02-22T22:53:13.893511+0000","last_undegraded":"2026-02-22T22:53:13.893511+0000","last_fullsized":"2026-02-22T22:53:13.893511+0000","mapping_epoch":15,"log_start":"20'65500","ondisk_log_start":"20'65500","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'75575","last_scrub_stamp":"2026-02-22T22:53:13.893487+0000","last_deep_scrub":"20'75575","last_deep_scrub_stamp":"2026-02-22T22:53:13.893487+0000","last_clean_scrub_stamp":"2026-02-22T22:53:13.893487+0000","objects_scrubbed":67,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:50:49.466801+0000","scrub_duration":370,"objects_trimmed":0,"snaptrim_duration":0.00041129399999999998,"stat_sum":{"num_bytes":251975696,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":17731,"num_read_kb":298258,"num_write":78070,"num_write_kb":9740467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'141691","reported_seq":149031,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:12.628813+0000","last_change":"2026-02-22T22:53:12.628835+0000","last_active":"2026-02-22T22:53:12.628813+0000","last_peered":"2026-02-22T22:53:12.628813+0000","last_clean":"2026-02-22T22:53:12.628813+0000","last_became_active":"2026-02-22T22:30:35.408995+0000","last_became_peered":"2026-02-22T22:30:35.408995+0000","last_unstale":"2026-02-22T22:53:12.628813+0000","last_undegraded":"2026-02-22T22:53:12.628813+0000","last_fullsized":"2026-02-22T22:53:12.628813+0000","mapping_epoch":15,"log_start":"20'131600","ondisk_log_start":"20'131600","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'141691","last_scrub_stamp":"2026-02-22T22:53:12.628781+0000","last_deep_scrub":"20'141691","last_deep_scrub_stamp":"2026-02-22T22:53:12.628781+0000","last_clean_scrub_stamp":"2026-02-22T22:53:12.628781+0000","objects_scrubbed":72,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:18:45.013974+0000","scrub_duration":433,"objects_trimmed":0,"snaptrim_duration":0.00037231999999999999,"stat_sum":{"num_bytes":277370880,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":7294,"num_read_kb":302561,"num_write":141617,"num_write_kb":9829106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"20'61497","reported_seq":68064,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:12.875257+0000","last_change":"2026-02-22T22:53:12.875268+0000","last_active":"2026-02-22T22:53:12.875257+0000","last_peered":"2026-02-22T22:53:12.875257+0000","last_clean":"2026-02-22T22:53:12.875257+0000","last_became_active":"2026-02-22T22:30:36.410557+0000","last_became_peered":"2026-02-22T22:30:36.410557+0000","last_unstale":"2026-02-22T22:53:12.875257+0000","last_undegraded":"2026-02-22T22:53:12.875257+0000","last_fullsized":"2026-02-22T22:53:12.875257+0000","mapping_epoch":15,"log_start":"20'51400","ondisk_log_start":"20'51400","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'61497","last_scrub_stamp":"2026-02-22T22:53:12.875233+0000","last_deep_scrub":"20'61497","last_deep_scrub_stamp":"2026-02-22T22:53:12.875233+0000","last_clean_scrub_stamp":"2026-02-22T22:53:12.875233+0000","objects_scrubbed":65,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:11:16.941209+0000","scrub_duration":371,"objects_trimmed":0,"snaptrim_duration":0.00032036500000000003,"stat_sum":{"num_bytes":254665728,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":6522,"num_read_kb":275420,"num_write":61432,"num_write_kb":11211940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'96981","reported_seq":102197,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:13.513437+0000","last_change":"2026-02-22T22:53:13.513448+0000","last_active":"2026-02-22T22:53:13.513437+0000","last_peered":"2026-02-22T22:53:13.513437+0000","last_clean":"2026-02-22T22:53:13.513437+0000","last_became_active":"2026-02-22T22:30:35.887940+0000","last_became_peered":"2026-02-22T22:30:35.887940+0000","last_unstale":"2026-02-22T22:53:13.513437+0000","last_undegraded":"2026-02-22T22:53:13.513437+0000","last_fullsized":"2026-02-22T22:53:13.513437+0000","mapping_epoch":15,"log_start":"20'86900","ondisk_log_start":"20'86900","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'96981","last_scrub_stamp":"2026-02-22T22:53:13.513415+0000","last_deep_scrub":"20'96981","last_deep_scrub_stamp":"2026-02-22T22:53:13.513415+0000","last_clean_scrub_stamp":"2026-02-22T22:53:13.513415+0000","objects_scrubbed":61,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:39:16.075219+0000","scrub_duration":326,"objects_trimmed":0,"snaptrim_duration":0.000214107,"stat_sum":{"num_bytes":224287232,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":15486,"num_read_kb":298139,"num_write":98639,"num_write_kb":10576066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'93109","reported_seq":100447,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:11.839979+0000","last_change":"2026-02-22T22:53:11.839994+0000","last_active":"2026-02-22T22:53:11.839979+0000","last_peered":"2026-02-22T22:53:11.839979+0000","last_clean":"2026-02-22T22:53:11.839979+0000","last_became_active":"2026-02-22T22:30:35.409017+0000","last_became_peered":"2026-02-22T22:30:35.409017+0000","last_unstale":"2026-02-22T22:53:11.839979+0000","last_undegraded":"2026-02-22T22:53:11.839979+0000","last_fullsized":"2026-02-22T22:53:11.839979+0000","mapping_epoch":15,"log_start":"20'83100","ondisk_log_start":"20'83100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'93109","last_scrub_stamp":"2026-02-22T22:53:11.839954+0000","last_deep_scrub":"20'93109","last_deep_scrub_stamp":"2026-02-22T22:53:11.839954+0000","last_clean_scrub_stamp":"2026-02-22T22:53:11.839954+0000","objects_scrubbed":66,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:25:14.010175+0000","scrub_duration":378,"objects_trimmed":0,"snaptrim_duration":0.00070440800000000001,"stat_sum":{"num_bytes":254456339,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":12301,"num_read_kb":286041,"num_write":93034,"num_write_kb":12557521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'114249","reported_seq":123756,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:14.554112+0000","last_change":"2026-02-22T22:53:14.554128+0000","last_active":"2026-02-22T22:53:14.554112+0000","last_peered":"2026-02-22T22:53:14.554112+0000","last_clean":"2026-02-22T22:53:14.554112+0000","last_became_active":"2026-02-22T22:30:35.887963+0000","last_became_peered":"2026-02-22T22:30:35.887963+0000","last_unstale":"2026-02-22T22:53:14.554112+0000","last_undegraded":"2026-02-22T22:53:14.554112+0000","last_fullsized":"2026-02-22T22:53:14.554112+0000","mapping_epoch":15,"log_start":"20'104200","ondisk_log_start":"20'104200","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'114249","last_scrub_stamp":"2026-02-22T22:53:14.554085+0000","last_deep_scrub":"20'114249","last_deep_scrub_stamp":"2026-02-22T22:53:14.554085+0000","last_clean_scrub_stamp":"2026-02-22T22:53:14.554085+0000","objects_scrubbed":57,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:43:47.005746+0000","scrub_duration":333,"objects_trimmed":0,"snaptrim_duration":0.00024748899999999999,"stat_sum":{"num_bytes":216912896,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":9465,"num_read_kb":308673,"num_write":114192,"num_write_kb":10933927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'282504","reported_seq":311297,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:12.717117+0000","last_change":"2026-02-22T22:53:12.717130+0000","last_active":"2026-02-22T22:53:12.717117+0000","last_peered":"2026-02-22T22:53:12.717117+0000","last_clean":"2026-02-22T22:53:12.717117+0000","last_became_active":"2026-02-22T22:30:35.887628+0000","last_became_peered":"2026-02-22T22:30:35.887628+0000","last_unstale":"2026-02-22T22:53:12.717117+0000","last_undegraded":"2026-02-22T22:53:12.717117+0000","last_fullsized":"2026-02-22T22:53:12.717117+0000","mapping_epoch":15,"log_start":"20'272500","ondisk_log_start":"20'272500","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'282504","last_scrub_stamp":"2026-02-22T22:53:12.717095+0000","last_deep_scrub":"20'282504","last_deep_scrub_stamp":"2026-02-22T22:53:12.717095+0000","last_clean_scrub_stamp":"2026-02-22T22:53:12.717095+0000","objects_scrubbed":49,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:15:41.705380+0000","scrub_duration":276,"objects_trimmed":0,"snaptrim_duration":0.00031158800000000001,"stat_sum":{"num_bytes":187813538,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":36451,"num_read_kb":600289,"num_write":282938,"num_write_kb":13218990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"20'152517","reported_seq":163274,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:14.820780+0000","last_change":"2026-02-22T22:53:14.820791+0000","last_active":"2026-02-22T22:53:14.820780+0000","last_peered":"2026-02-22T22:53:14.820780+0000","last_clean":"2026-02-22T22:53:14.820780+0000","last_became_active":"2026-02-22T22:30:36.591493+0000","last_became_peered":"2026-02-22T22:30:36.591493+0000","last_unstale":"2026-02-22T22:53:14.820780+0000","last_undegraded":"2026-02-22T22:53:14.820780+0000","last_fullsized":"2026-02-22T22:53:14.820780+0000","mapping_epoch":15,"log_start":"20'142500","ondisk_log_start":"20'142500","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'152517","last_scrub_stamp":"2026-02-22T22:53:14.820755+0000","last_deep_scrub":"20'152517","last_deep_scrub_stamp":"2026-02-22T22:53:14.820755+0000","last_clean_scrub_stamp":"2026-02-22T22:53:14.820755+0000","objects_scrubbed":61,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:52:17.532823+0000","scrub_duration":334,"objects_trimmed":0,"snaptrim_duration":0.00030094900000000001,"stat_sum":{"num_bytes":233774080,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":14671,"num_read_kb":325444,"num_write":152450,"num_write_kb":11485625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"20'74","reported_seq":135,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T22:53:11.516195+0000","last_change":"2026-02-22T22:53:11.516211+0000","last_active":"2026-02-22T22:53:11.516195+0000","last_peered":"2026-02-22T22:53:11.516195+0000","last_clean":"2026-02-22T22:53:11.516195+0000","last_became_active":"2026-02-22T22:30:30.420650+0000","last_became_peered":"2026-02-22T22:30:30.420650+0000","last_unstale":"2026-02-22T22:53:11.516195+0000","last_undegraded":"2026-02-22T22:53:11.516195+0000","last_fullsized":"2026-02-22T22:53:11.516195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'74","last_scrub_stamp":"2026-02-22T22:53:11.516163+0000","last_deep_scrub":"20'74","last_deep_scrub_stamp":"2026-02-22T22:53:11.516163+0000","last_clean_scrub_stamp":"2026-02-22T22:53:11.516163+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:42:55.996271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1901256389,"num_objects":498,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":119921,"num_read_kb":2694825,"num_write":1022372,"num_write_kb":89553642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":104,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3109150720,"data_stored":3108221322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11371,"internal_metadata":0},"log_size":80423,"ondisk_log_size":80423,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673239,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1631468,"kb_used_data":1002076,"kb_used_omap":6,"kb_used_meta":629369,"kb_avail":103226132,"statfs":{"total":107374182400,"available":105703559168,"internally_reserved":0,"allocated":1026125824,"data_stored":1025709671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6414,"internal_metadata":644474610},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673238,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1365576,"kb_used_data":579320,"kb_used_omap":1,"kb_used_meta":786238,"kb_avail":103492024,"statfs":{"total":107374182400,"available":105975832576,"internally_reserved":0,"allocated":593223680,"data_stored":592945252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":805108167},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673240,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1641808,"kb_used_data":960256,"kb_used_omap":7,"kb_used_meta":681528,"kb_avail":103215792,"statfs":{"total":107374182400,"available":105692971008,"internally_reserved":0,"allocated":983302144,"data_stored":982926585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7455,"internal_metadata":697885409},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705944,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1091356,"kb_used_data":496460,"kb_used_omap":6,"kb_used_meta":594873,"kb_avail":103766244,"statfs":{"total":107374182400,"available":106256633856,"internally_reserved":0,"allocated":508375040,"data_stored":508052182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6388,"internal_metadata":609150732},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":983130112,"data_stored":982868677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5862,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":592457728,"data_stored":592296976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1025359872,"data_stored":1025061395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1930,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":508203008,"data_stored":507994274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3579,"internal_metadata":0}]}} 2026-02-22T22:53:32.122 DEBUG:teuthology.orchestra.run.trial125:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T22:53:32.285 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/ceph.py", line 1924, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/qemu.py", line 728, in task with contextutil.nested(*managers): File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/qemu.py", line 609, in run_qemu remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial144 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2026-02-22T22:53:32.288 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T22:53:32.288 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T22:53:32.288 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T22:53:32.288 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.347 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T22:53:32.348 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T22:53:32.348 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.412 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T22:53:32.412 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T22:53:32.412 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.469 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T22:53:32.469 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-22T22:53:32.469 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.523 INFO:tasks.ceph.osd.3:Stopped 2026-02-22T22:53:32.523 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T22:53:32.523 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T22:53:32.524 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.556 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T22:53:32.557 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-22T22:53:32.557 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.588 INFO:tasks.ceph.mgr.y:Stopped 2026-02-22T22:53:32.588 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T22:53:32.588 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T22:53:32.588 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.606 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T22:53:32.606 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T22:53:32.606 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:53:32.637 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T22:53:32.638 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T22:53:32.638 DEBUG:teuthology.orchestra.run.trial125:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-22T22:53:32.673 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial125.front.sepia.ceph.com 2026-02-22T22:53:32.673 DEBUG:teuthology.orchestra.run.trial125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T22:53:32.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial125.front.sepia.ceph.com 2026-02-22T22:53:32.880 DEBUG:teuthology.orchestra.run.trial125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T22:53:32.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:53:32.973 DEBUG:teuthology.orchestra.run.trial144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T22:53:33.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:53:33.130 DEBUG:teuthology.orchestra.run.trial144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-22T22:53:33.259 INFO:tasks.ceph:Archiving mon data... 2026-02-22T22:53:33.260 DEBUG:teuthology.misc:Transferring archived files from trial125:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/data/mon.a.tgz 2026-02-22T22:53:33.261 DEBUG:teuthology.orchestra.run.trial125:> mktemp 2026-02-22T22:53:33.279 INFO:teuthology.orchestra.run.trial125.stdout:/tmp/tmp.PDWflWp3m5 2026-02-22T22:53:33.279 DEBUG:teuthology.orchestra.run.trial125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PDWflWp3m5 2026-02-22T22:53:33.375 DEBUG:teuthology.orchestra.run.trial125:> sudo chmod 0666 /tmp/tmp.PDWflWp3m5 2026-02-22T22:53:33.456 DEBUG:teuthology.orchestra.remote:trial125:/tmp/tmp.PDWflWp3m5 is 260KB 2026-02-22T22:53:33.600 DEBUG:teuthology.orchestra.run.trial125:> rm -fr /tmp/tmp.PDWflWp3m5 2026-02-22T22:53:33.621 DEBUG:teuthology.misc:Transferring archived files from trial144:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/data/mon.b.tgz 2026-02-22T22:53:33.622 DEBUG:teuthology.orchestra.run.trial144:> mktemp 2026-02-22T22:53:33.639 INFO:teuthology.orchestra.run.trial144.stdout:/tmp/tmp.G0k3TzhQFb 2026-02-22T22:53:33.640 DEBUG:teuthology.orchestra.run.trial144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.G0k3TzhQFb 2026-02-22T22:53:33.736 DEBUG:teuthology.orchestra.run.trial144:> sudo chmod 0666 /tmp/tmp.G0k3TzhQFb 2026-02-22T22:53:33.817 DEBUG:teuthology.orchestra.remote:trial144:/tmp/tmp.G0k3TzhQFb is 266KB 2026-02-22T22:53:33.910 DEBUG:teuthology.orchestra.run.trial144:> rm -fr /tmp/tmp.G0k3TzhQFb 2026-02-22T22:53:33.926 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T22:53:33.926 DEBUG:teuthology.orchestra.run.trial125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T22:53:33.928 DEBUG:teuthology.orchestra.run.trial144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T22:53:34.009 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T22:53:34.047 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T22:53:34.048 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T22:53:34.049 DEBUG:teuthology.misc:Transferring archived files from trial125:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/remote/trial125/crash 2026-02-22T22:53:34.050 DEBUG:teuthology.orchestra.run.trial125:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T22:53:34.110 DEBUG:teuthology.misc:Transferring archived files from trial144:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/remote/trial144/crash 2026-02-22T22:53:34.112 DEBUG:teuthology.orchestra.run.trial144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T22:53:34.136 INFO:tasks.ceph:Compressing logs... 2026-02-22T22:53:34.137 DEBUG:teuthology.orchestra.run.trial125:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:53:34.156 DEBUG:teuthology.orchestra.run.trial144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:53:34.178 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T22:53:34.195 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41993.log 2026-02-22T22:53:34.195 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T22:53:34.195 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.41993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42120.log 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41993.log.gz 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42630.log 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.42120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42515.log 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42120.log.gz 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43321.log 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42630.log.gz 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42515.log.gz 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41830.log 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41805.log 2026-02-22T22:53:34.196 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43321.log.gz 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.41830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41830.log.gz 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43713.log 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.41805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42317.log 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41805.log.gz 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43713.log.gz 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42317.log.gz 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2026-02-22T22:53:34.197 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42460.log 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42728.log 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42460.log.gz 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42728.log.gz 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41895.log 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43760.log: /var/log/ceph/ceph.tmp-client.admin.37764.log 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2026-02-22T22:53:34.198 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.41895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40615.log 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41895.log.gz 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph.tmp-client.admin.37764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37764.log.gz 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.40615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42123.log 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40615.log.gz 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42461.log 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42123.log.gz 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40391.log 2026-02-22T22:53:34.199 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42461.log.gz 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41735.log 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.40391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40391.log.gz 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41944.log 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.41735.log: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41735.log.gz 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43272.log 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.41944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41944.log.gz 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42318.log 2026-02-22T22:53:34.200 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43272.log.gz 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41652.log 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42318.log.gz 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.41652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41652.log.gz 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.42122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43125.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2026-02-22T22:53:34.201 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43615.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz -- 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr: /var/log/ceph/ceph-client.admin.43517.log 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43664.log 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43517.log.gz 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:gzip/var/log/ceph/ceph-client.admin.43664.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42121.log 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43664.log.gz 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43566.log 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph.log: gzip/var/log/ceph/ceph-client.admin.42121.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40590.log 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42121.log.gz 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43566.log.gz 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43174.log 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.40590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40590.log.gz 2026-02-22T22:53:34.202 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2026-02-22T22:53:34.203 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43174.log.gz 2026-02-22T22:53:34.203 INFO:teuthology.orchestra.run.trial125.stderr:/var/log/ceph/ceph-client.admin.43370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2026-02-22T22:53:34.203 INFO:teuthology.orchestra.run.trial125.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41943.log 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40336.log 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.41943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40430.log 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.41943.log.gz 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.40336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40336.log.gz 2026-02-22T22:53:34.208 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40289.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.40430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42369.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.40289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40430.log.gz 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40289.log.gz 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43147.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.0.42369.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.0.42369.log.gz 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.43147.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.43147.log.gz 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40383.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41655.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.40383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43065.log 2026-02-22T22:53:34.209 INFO:teuthology.orchestra.run.trial144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40383.log.gz 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.41655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41655.log.gz 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41695.log 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.43065.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.43065.log.gz 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph-client.admin.41695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41695.log.gz 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42062.log 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.42062.log: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.42062.log.gz 2026-02-22T22:53:34.210 INFO:teuthology.orchestra.run.trial144.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T22:53:34.211 INFO:teuthology.orchestra.run.trial144.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-22T22:53:34.254 INFO:teuthology.orchestra.run.trial125.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T22:53:34.309 INFO:teuthology.orchestra.run.trial144.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-22T22:53:34.423 INFO:teuthology.orchestra.run.trial125.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T22:53:52.717 INFO:teuthology.orchestra.run.trial144.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-22T22:54:12.083 INFO:teuthology.orchestra.run.trial125.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T22:54:27.586 INFO:teuthology.orchestra.run.trial144.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T22:54:27.588 INFO:teuthology.orchestra.run.trial144.stderr: 2026-02-22T22:54:27.588 INFO:teuthology.orchestra.run.trial144.stderr:real 0m53.394s 2026-02-22T22:54:27.588 INFO:teuthology.orchestra.run.trial144.stderr:user 1m8.530s 2026-02-22T22:54:27.589 INFO:teuthology.orchestra.run.trial144.stderr:sys 0m3.338s 2026-02-22T22:54:40.131 INFO:teuthology.orchestra.run.trial125.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T22:54:40.132 INFO:teuthology.orchestra.run.trial125.stderr: 2026-02-22T22:54:40.132 INFO:teuthology.orchestra.run.trial125.stderr:real 1m5.962s 2026-02-22T22:54:40.132 INFO:teuthology.orchestra.run.trial125.stderr:user 1m39.366s 2026-02-22T22:54:40.132 INFO:teuthology.orchestra.run.trial125.stderr:sys 0m4.598s 2026-02-22T22:54:40.133 INFO:tasks.ceph:Archiving logs... 2026-02-22T22:54:40.133 DEBUG:teuthology.misc:Transferring archived files from trial125:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/remote/trial125/log 2026-02-22T22:54:40.134 DEBUG:teuthology.orchestra.run.trial125:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T22:54:47.387 DEBUG:teuthology.misc:Transferring archived files from trial144:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/remote/trial144/log 2026-02-22T22:54:47.388 DEBUG:teuthology.orchestra.run.trial144:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T22:54:52.345 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T22:54:52.355 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/qemu.py", line 728, in task with contextutil.nested(*managers): File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks/qemu.py", line 609, in run_qemu remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial144 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2026-02-22T22:54:52.356 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T22:54:52.356 DEBUG:teuthology.orchestra.run.trial125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T22:54:52.362 DEBUG:teuthology.orchestra.run.trial144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T22:54:52.503 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T22:54:52.517 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T22:54:52.517 DEBUG:teuthology.orchestra.run.trial125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:54:52.519 DEBUG:teuthology.orchestra.run.trial144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:54:52.534 INFO:teuthology.orchestra.run.trial125.stderr:bash: line 1: ntpq: command not found 2026-02-22T22:54:52.535 INFO:teuthology.orchestra.run.trial144.stderr:bash: line 1: ntpq: command not found 2026-02-22T22:54:52.550 INFO:teuthology.orchestra.run.trial144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T22:54:52.550 INFO:teuthology.orchestra.run.trial144.stdout:=============================================================================== 2026-02-22T22:54:52.550 INFO:teuthology.orchestra.run.trial144.stdout:^- ntp.maxhost.io 2 7 367 9 +564us[ +564us] +/- 56ms 2026-02-22T22:54:52.550 INFO:teuthology.orchestra.run.trial144.stdout:^- baron.cgee.net 2 7 377 71 +1354us[+1354us] +/- 27ms 2026-02-22T22:54:52.550 INFO:teuthology.orchestra.run.trial144.stdout:^* time.cloudflare.com 3 7 377 74 +14us[ +19us] +/- 6518us 2026-02-22T22:54:52.550 INFO:teuthology.orchestra.run.trial144.stdout:^- 23-95-35-34-host.colocro> 2 7 300 589 +29us[ +24us] +/- 36ms 2026-02-22T22:54:52.562 INFO:teuthology.orchestra.run.trial125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T22:54:52.562 INFO:teuthology.orchestra.run.trial125.stdout:=============================================================================== 2026-02-22T22:54:52.562 INFO:teuthology.orchestra.run.trial125.stdout:^+ rn-03.koehn.com 2 7 377 6 -236us[ -236us] +/- 37ms 2026-02-22T22:54:52.562 INFO:teuthology.orchestra.run.trial125.stdout:^* vps5.drown.org 2 7 377 69 -73us[ -63us] +/- 22ms 2026-02-22T22:54:52.562 INFO:teuthology.orchestra.run.trial125.stdout:^+ ntp.maxhost.io 2 7 377 136 +120us[ +125us] +/- 55ms 2026-02-22T22:54:52.562 INFO:teuthology.orchestra.run.trial125.stdout:^+ wdc1.us.ntp.li 3 7 377 70 +219us[ +229us] +/- 30ms 2026-02-22T22:54:52.563 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T22:54:52.573 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T22:54:52.573 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T22:54:52.586 DEBUG:teuthology.orchestra.run.trial125:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T22:54:52.656 DEBUG:teuthology.orchestra.run.trial144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T22:54:52.710 DEBUG:teuthology.orchestra.run.trial125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T22:54:52.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:54:52.738 DEBUG:teuthology.orchestra.run.trial144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T22:54:52.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:54:52.764 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T22:54:52.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T22:54:52.796 INFO:teuthology.task.internal:Duration was 1727.800298 seconds 2026-02-22T22:54:52.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T22:54:52.812 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T22:54:52.813 DEBUG:teuthology.orchestra.run.trial125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T22:54:52.816 DEBUG:teuthology.orchestra.run.trial144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T22:54:52.851 INFO:teuthology.orchestra.run.trial125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T22:54:52.854 INFO:teuthology.orchestra.run.trial144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T22:54:53.078 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T22:54:53.079 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial125.front.sepia.ceph.com 2026-02-22T22:54:53.079 DEBUG:teuthology.orchestra.run.trial125:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T22:54:53.137 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial144.front.sepia.ceph.com 2026-02-22T22:54:53.137 DEBUG:teuthology.orchestra.run.trial144:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T22:54:53.158 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T22:54:53.158 DEBUG:teuthology.orchestra.run.trial125:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:54:53.179 DEBUG:teuthology.orchestra.run.trial144:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:54:53.262 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T22:54:53.262 DEBUG:teuthology.orchestra.run.trial125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:54:53.265 DEBUG:teuthology.orchestra.run.trial144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:54:53.285 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:54:53.286 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:54:53.287 INFO:teuthology.orchestra.run.trial125.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T22:54:53.287 INFO:teuthology.orchestra.run.trial125.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:54:53.287 INFO:teuthology.orchestra.run.trial125.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T22:54:53.288 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:54:53.289 INFO:teuthology.orchestra.run.trial144.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:54:53.289 INFO:teuthology.orchestra.run.trial144.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:54:53.289 INFO:teuthology.orchestra.run.trial144.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T22:54:53.289 INFO:teuthology.orchestra.run.trial144.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T22:54:53.297 INFO:teuthology.orchestra.run.trial125.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T22:54:53.300 INFO:teuthology.orchestra.run.trial144.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T22:54:53.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T22:54:53.317 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T22:54:53.317 DEBUG:teuthology.orchestra.run.trial125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T22:54:53.364 DEBUG:teuthology.orchestra.run.trial144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T22:54:53.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T22:54:53.409 DEBUG:teuthology.orchestra.run.trial125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:54:53.412 DEBUG:teuthology.orchestra.run.trial144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:54:53.434 INFO:teuthology.orchestra.run.trial125.stdout:kernel.core_pattern = core 2026-02-22T22:54:53.454 INFO:teuthology.orchestra.run.trial144.stdout:kernel.core_pattern = core 2026-02-22T22:54:53.467 DEBUG:teuthology.orchestra.run.trial125:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:54:53.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:54:53.503 DEBUG:teuthology.orchestra.run.trial144:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:54:53.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:54:53.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T22:54:53.541 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T22:54:53.542 DEBUG:teuthology.misc:Transferring archived files from trial125:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/remote/trial125 2026-02-22T22:54:53.543 DEBUG:teuthology.orchestra.run.trial125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T22:54:53.580 DEBUG:teuthology.misc:Transferring archived files from trial144:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64238/remote/trial144 2026-02-22T22:54:53.581 DEBUG:teuthology.orchestra.run.trial144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T22:54:53.623 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T22:54:53.623 DEBUG:teuthology.orchestra.run.trial125:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T22:54:53.626 DEBUG:teuthology.orchestra.run.trial144:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T22:54:53.670 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T22:54:53.689 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T22:54:53.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T22:54:53.706 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T22:54:53.707 DEBUG:teuthology.orchestra.run.trial125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T22:54:53.709 DEBUG:teuthology.orchestra.run.trial144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T22:54:53.724 INFO:teuthology.orchestra.run.trial125.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 22:54 /home/ubuntu/cephtest 2026-02-22T22:54:53.725 INFO:teuthology.orchestra.run.trial144.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 22:54 /home/ubuntu/cephtest 2026-02-22T22:54:53.727 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T22:54:53.744 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T22:54:53.764 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial144 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2026-02-22T22:54:53.768 INFO:teuthology.run:Summary data: description: rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{centos_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests conf/{disable-pool-app}} duration: 1727.8002984523773 failure_reason: 'Command failed on trial144 with status 1: ''test -f /home/ubuntu/cephtest/archive/qemu/client.0/success''' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com status: fail success: false 2026-02-22T22:54:53.768 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T22:54:53.900 INFO:teuthology.run:FAIL