2026-02-22T19:42:06.611 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T19:42:06.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T19:42:06.701 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/63962 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rbd/singleton/{all/rbd-vs-unmanaged-snaps conf/{disable-pool-app} objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_latest}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '63962' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 2 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: global: mon warn on pool no app: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - client.0 seed: 9196 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFEzP5yqX21gfdv0EBN7sk9i2UzRKMZ5AMqPIM4dZEETtXGm70M3dt3igAKv8qdr8CfwTdKT2aFLwhpXF0At7cI= tasks: - install: null - ceph: conf: client: rbd validate pool: false fs: xfs - workunit: clients: all: - mon/rbd_snaps_ops.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:38 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T19:42:06.701 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T19:42:06.701 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T19:42:06.701 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T19:42:06.703 INFO:teuthology.task.internal:Checking packages... 2026-02-22T19:42:06.703 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T19:42:06.703 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T19:42:06.703 INFO:teuthology.packaging:ref: None 2026-02-22T19:42:06.703 INFO:teuthology.packaging:tag: None 2026-02-22T19:42:06.703 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T19:42:06.703 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:42:06.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T19:42:06.833 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.gf90f4eae 2026-02-22T19:42:06.834 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T19:42:06.846 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T19:42:06.846 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T19:42:06.860 INFO:teuthology.task.internal:Saving configuration 2026-02-22T19:42:06.868 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T19:42:06.881 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T19:42:06.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial152.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/63962', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 19:37:49.764145', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFEzP5yqX21gfdv0EBN7sk9i2UzRKMZ5AMqPIM4dZEETtXGm70M3dt3igAKv8qdr8CfwTdKT2aFLwhpXF0At7cI='} 2026-02-22T19:42:06.956 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T19:42:06.968 INFO:teuthology.task.internal:roles: ubuntu@trial152.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0'] 2026-02-22T19:42:06.968 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T19:42:07.042 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x746a517e74c0>, signals=[15]) 2026-02-22T19:42:07.043 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T19:42:07.054 INFO:teuthology.task.internal:Opening connections... 2026-02-22T19:42:07.054 DEBUG:teuthology.task.internal:connecting to ubuntu@trial152.front.sepia.ceph.com 2026-02-22T19:42:07.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T19:42:07.116 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T19:42:07.128 DEBUG:teuthology.orchestra.run.trial152:> uname -m 2026-02-22T19:42:07.190 INFO:teuthology.orchestra.run.trial152.stdout:x86_64 2026-02-22T19:42:07.190 DEBUG:teuthology.orchestra.run.trial152:> cat /etc/os-release 2026-02-22T19:42:07.245 INFO:teuthology.orchestra.run.trial152.stdout:NAME="CentOS Stream" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:VERSION="9" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:ID="centos" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:ID_LIKE="rhel fedora" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:VERSION_ID="9" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:PLATFORM_ID="platform:el9" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:ANSI_COLOR="0;31" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:LOGO="fedora-logo-icon" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:HOME_URL="https://centos.org/" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T19:42:07.246 INFO:teuthology.orchestra.run.trial152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T19:42:07.246 INFO:teuthology.lock.ops:Updating trial152.front.sepia.ceph.com on lock server 2026-02-22T19:42:07.310 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T19:42:07.322 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T19:42:07.335 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T19:42:07.335 DEBUG:teuthology.orchestra.run.trial152:> test '!' -e /home/ubuntu/cephtest 2026-02-22T19:42:07.349 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T19:42:07.360 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T19:42:07.360 DEBUG:teuthology.orchestra.run.trial152:> test -z $(ls -A /var/lib/ceph) 2026-02-22T19:42:07.406 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T19:42:07.655 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T19:42:07.678 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T19:42:07.678 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T19:42:07.679 DEBUG:teuthology.orchestra.run.trial152:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T19:42:07.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:42:07.694 DEBUG:teuthology.orchestra.run.trial152:> uname -r 2026-02-22T19:42:07.751 INFO:teuthology.orchestra.run.trial152.stdout:5.14.0-681.el9.x86_64 2026-02-22T19:42:07.751 INFO:teuthology.task.kernel:Running kernel on trial152: 5.14.0-681.el9.x86_64 2026-02-22T19:42:07.751 DEBUG:teuthology.orchestra.run.trial152:> sudo yum install -y kernel 2026-02-22T19:42:09.001 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-22T19:42:19.618 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 27 MB 00:10 2026-02-22T19:42:23.019 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-22T19:42:23.901 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - Extras packages 121 kB/s | 20 kB 00:00 2026-02-22T19:42:24.847 INFO:teuthology.orchestra.run.trial152.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-22T19:42:27.991 INFO:teuthology.orchestra.run.trial152.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-22T19:42:29.004 INFO:teuthology.orchestra.run.trial152.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T19:42:29.004 INFO:teuthology.orchestra.run.trial152.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T19:42:29.023 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:42:29.024 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:42:29.024 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:42:29.048 DEBUG:teuthology.orchestra.run.trial152:> echo no | sudo yum reinstall kernel || true 2026-02-22T19:42:29.357 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 07:42:27 PM UTC. 2026-02-22T19:42:29.437 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout: Package Architecture Version Repository Size 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout:Reinstalling: 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 803 k 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 0 2026-02-22T19:42:29.438 INFO:teuthology.orchestra.run.trial152.stderr:Operation aborted. 2026-02-22T19:42:29.459 INFO:teuthology.orchestra.run.trial152.stdout:Is this ok [y/N]: 2026-02-22T19:42:29.459 DEBUG:teuthology.orchestra.run.trial152:> sudo yum reinstall -y kernel || true 2026-02-22T19:42:29.758 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 07:42:27 PM UTC. 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout: Package Architecture Version Repository Size 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout:Reinstalling: 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:42:29.837 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:42:29.838 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:42:29.838 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 803 k 2026-02-22T19:42:29.838 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 0 2026-02-22T19:42:29.838 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:42:31.248 INFO:teuthology.orchestra.run.trial152.stdout:kernel-5.14.0-681.el9.x86_64.rpm 594 kB/s | 803 kB 00:01 2026-02-22T19:42:31.248 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:42:31.248 INFO:teuthology.orchestra.run.trial152.stdout:Total 570 kB/s | 803 kB 00:01 2026-02-22T19:42:31.260 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:42:31.294 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:42:31.294 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:42:31.298 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:42:31.298 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:42:31.322 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:42:31.326 INFO:teuthology.orchestra.run.trial152.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T19:42:31.326 INFO:teuthology.orchestra.run.trial152.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T19:42:31.434 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T19:42:31.435 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T19:42:31.485 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T19:42:31.485 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:42:31.485 INFO:teuthology.orchestra.run.trial152.stdout:Reinstalled: 2026-02-22T19:42:31.485 INFO:teuthology.orchestra.run.trial152.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T19:42:31.486 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:42:31.486 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:42:31.512 DEBUG:teuthology.orchestra.run.trial152:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T19:42:31.537 INFO:teuthology.orchestra.run.trial152.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T19:42:31.537 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T19:42:31.537 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T19:42:31.538 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T19:42:31.538 DEBUG:teuthology.orchestra.run.trial152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T19:42:31.601 INFO:teuthology.orchestra.run.trial152.stdout:ttyS1 2026-02-22T19:42:31.621 DEBUG:teuthology.parallel:result is None 2026-02-22T19:42:31.621 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T19:42:31.634 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T19:42:31.634 DEBUG:teuthology.orchestra.run.trial152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T19:42:31.676 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T19:42:31.687 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T19:42:31.701 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T19:42:31.701 DEBUG:teuthology.orchestra.run.trial152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T19:42:31.735 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T19:42:31.746 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T19:42:31.747 DEBUG:teuthology.orchestra.run.trial152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T19:42:31.799 INFO:teuthology.orchestra.run.trial152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T19:42:31.808 INFO:teuthology.orchestra.run.trial152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T19:42:31.810 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T19:42:31.823 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T19:42:31.823 DEBUG:teuthology.orchestra.run.trial152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T19:42:31.876 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T19:42:31.892 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T19:42:31.892 DEBUG:teuthology.orchestra.run.trial152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T19:42:31.933 DEBUG:teuthology.orchestra.run.trial152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T19:42:32.051 DEBUG:teuthology.orchestra.run.trial152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T19:42:32.075 DEBUG:teuthology.orchestra.run.trial152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T19:42:32.192 DEBUG:teuthology.orchestra.run.trial152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T19:42:32.217 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:42:32.217 DEBUG:teuthology.orchestra.run.trial152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T19:42:32.280 DEBUG:teuthology.orchestra.run.trial152:> sudo service rsyslog restart 2026-02-22T19:42:32.347 INFO:teuthology.orchestra.run.trial152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T19:42:32.870 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T19:42:32.886 INFO:teuthology.task.internal:Starting timer... 2026-02-22T19:42:32.886 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T19:42:32.907 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T19:42:32.926 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-22T19:42:32.927 DEBUG:teuthology.orchestra.run.trial152:> sudo service auditd rotate 2026-02-22T19:42:32.955 INFO:teuthology.orchestra.run.trial152.stdout:Rotating logs: 2026-02-22T19:42:32.956 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T19:42:32.957 DEBUG:teuthology.orchestra.run.trial152:> /usr/sbin/getenforce 2026-02-22T19:42:33.012 INFO:teuthology.orchestra.run.trial152.stdout:Permissive 2026-02-22T19:42:33.013 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial152.front.sepia.ceph.com': 'permissive'} 2026-02-22T19:42:33.013 DEBUG:teuthology.orchestra.run.trial152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T19:42:33.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:42:33.077 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T19:42:33.078 DEBUG:teuthology.orchestra.run.trial152:> sudo /usr/sbin/setenforce permissive 2026-02-22T19:42:33.143 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T19:42:33.161 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T19:42:33.168 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T19:42:33.168 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T19:45:00.436 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial152.front.sepia.ceph.com')] 2026-02-22T19:45:00.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial152.front.sepia.ceph.com' 2026-02-22T19:45:00.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T19:45:00.501 DEBUG:teuthology.orchestra.run.trial152:> true 2026-02-22T19:45:00.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial152.front.sepia.ceph.com' 2026-02-22T19:45:00.579 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T19:45:00.593 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T19:45:00.593 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T19:45:00.593 DEBUG:teuthology.orchestra.run.trial152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T19:45:00.646 INFO:teuthology.orchestra.run.trial152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T19:45:00.659 INFO:teuthology.orchestra.run.trial152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T19:45:00.680 INFO:teuthology.orchestra.run.trial152.stderr:sudo: ntpd: command not found 2026-02-22T19:45:00.689 INFO:teuthology.orchestra.run.trial152.stdout:506 Cannot talk to daemon 2026-02-22T19:45:00.701 INFO:teuthology.orchestra.run.trial152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T19:45:00.713 INFO:teuthology.orchestra.run.trial152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T19:45:00.760 INFO:teuthology.orchestra.run.trial152.stderr:bash: line 1: ntpq: command not found 2026-02-22T19:45:01.028 INFO:teuthology.orchestra.run.trial152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T19:45:01.028 INFO:teuthology.orchestra.run.trial152.stdout:=============================================================================== 2026-02-22T19:45:01.028 INFO:teuthology.orchestra.run.trial152.stdout:^? ntp2.zeus.frumentum.media 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T19:45:01.028 INFO:teuthology.orchestra.run.trial152.stdout:^? ip216-250-115-174.pbiaas> 2 6 1 1 -4039us[-4039us] +/- 111ms 2026-02-22T19:45:01.028 INFO:teuthology.orchestra.run.trial152.stdout:^? 216-144-228-179-host.col> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T19:45:01.028 INFO:teuthology.orchestra.run.trial152.stdout:^? 149.28.61.105.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-22T19:45:01.029 INFO:teuthology.run_tasks:Running task install... 2026-02-22T19:45:01.039 DEBUG:teuthology.task.install:project ceph 2026-02-22T19:45:01.039 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T19:45:01.039 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T19:45:01.040 INFO:teuthology.task.install:Using flavor: default 2026-02-22T19:45:01.042 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T19:45:01.042 INFO:teuthology.task.install:extra packages: [] 2026-02-22T19:45:01.042 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T19:45:01.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:45:01.188 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T19:45:01.188 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T19:45:01.535 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T19:45:01.535 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:45:01.535 DEBUG:teuthology.orchestra.run.trial152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T19:45:01.561 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-22T19:45:01.561 DEBUG:teuthology.orchestra.run.trial152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T19:45:01.625 DEBUG:teuthology.orchestra.run.trial152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T19:45:01.699 DEBUG:teuthology.orchestra.run.trial152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T19:45:01.764 INFO:teuthology.orchestra.run.trial152.stdout:check_obsoletes = 1 2026-02-22T19:45:01.765 DEBUG:teuthology.orchestra.run.trial152:> sudo yum clean all 2026-02-22T19:45:01.924 INFO:teuthology.orchestra.run.trial152.stdout:41 files removed 2026-02-22T19:45:01.938 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-radosgw 2026-02-22T19:45:02.602 INFO:teuthology.orchestra.run.trial152.stdout:ceph packages for x86_64 164 kB/s | 86 kB 00:00 2026-02-22T19:45:03.169 INFO:teuthology.orchestra.run.trial152.stdout:ceph noarch packages 22 kB/s | 12 kB 00:00 2026-02-22T19:45:03.715 INFO:teuthology.orchestra.run.trial152.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2026-02-22T19:45:05.447 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.9 MB 00:01 2026-02-22T19:45:08.631 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-22T19:45:13.242 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 7.8 MB 00:02 2026-02-22T19:45:14.754 INFO:teuthology.orchestra.run.trial152.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-22T19:45:16.288 INFO:teuthology.orchestra.run.trial152.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-22T19:45:19.488 INFO:teuthology.orchestra.run.trial152.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-22T19:45:20.694 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:45:20.695 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:20.695 INFO:teuthology.orchestra.run.trial152.stdout: Package Arch Version Repository Size 2026-02-22T19:45:20.695 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout:Upgrading: 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout:Installing dependencies: 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout:Installing weak dependencies: 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:20.696 INFO:teuthology.orchestra.run.trial152.stdout:Install 33 Packages 2026-02-22T19:45:20.697 INFO:teuthology.orchestra.run.trial152.stdout:Upgrade 2 Packages 2026-02-22T19:45:20.697 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:20.697 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 63 M 2026-02-22T19:45:20.697 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:45:22.949 INFO:teuthology.orchestra.run.trial152.stdout:(1/35): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 3.5 MB/s | 5.5 MB 00:01 2026-02-22T19:45:23.008 INFO:teuthology.orchestra.run.trial152.stdout:(2/35): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 427 kB/s | 25 kB 00:00 2026-02-22T19:45:23.195 INFO:teuthology.orchestra.run.trial152.stdout:(3/35): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 5.2 MB/s | 999 kB 00:00 2026-02-22T19:45:23.318 INFO:teuthology.orchestra.run.trial152.stdout:(4/35): libradosstriper1-19.2.3-689.gf90f4eae.e 4.0 MB/s | 503 kB 00:00 2026-02-22T19:45:24.287 INFO:teuthology.orchestra.run.trial152.stdout:(5/35): librgw2-19.2.3-689.gf90f4eae.el9.x86_64 5.6 MB/s | 5.4 MB 00:00 2026-02-22T19:45:24.347 INFO:teuthology.orchestra.run.trial152.stdout:(6/35): python3-ceph-argparse-19.2.3-689.gf90f4 752 kB/s | 45 kB 00:00 2026-02-22T19:45:24.391 INFO:teuthology.orchestra.run.trial152.stdout:(7/35): python3-ceph-common-19.2.3-689.gf90f4ea 3.2 MB/s | 142 kB 00:00 2026-02-22T19:45:24.434 INFO:teuthology.orchestra.run.trial152.stdout:(8/35): python3-cephfs-19.2.3-689.gf90f4eae.el9 3.8 MB/s | 165 kB 00:00 2026-02-22T19:45:24.480 INFO:teuthology.orchestra.run.trial152.stdout:(9/35): python3-rados-19.2.3-689.gf90f4eae.el9. 6.8 MB/s | 322 kB 00:00 2026-02-22T19:45:24.528 INFO:teuthology.orchestra.run.trial152.stdout:(10/35): python3-rbd-19.2.3-689.gf90f4eae.el9.x 6.3 MB/s | 303 kB 00:00 2026-02-22T19:45:24.572 INFO:teuthology.orchestra.run.trial152.stdout:(11/35): python3-rgw-19.2.3-689.gf90f4eae.el9.x 2.2 MB/s | 100 kB 00:00 2026-02-22T19:45:24.750 INFO:teuthology.orchestra.run.trial152.stdout:(12/35): ceph-common-19.2.3-689.gf90f4eae.el9.x 6.5 MB/s | 22 MB 00:03 2026-02-22T19:45:24.964 INFO:teuthology.orchestra.run.trial152.stdout:(13/35): ceph-radosgw-19.2.3-689.gf90f4eae.el9. 3.0 MB/s | 11 MB 00:03 2026-02-22T19:45:25.150 INFO:teuthology.orchestra.run.trial152.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 57 kB/s | 33 kB 00:00 2026-02-22T19:45:25.168 INFO:teuthology.orchestra.run.trial152.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 5.8 MB/s | 104 kB 00:00 2026-02-22T19:45:25.177 INFO:teuthology.orchestra.run.trial152.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-22T19:45:25.184 INFO:teuthology.orchestra.run.trial152.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 23 MB/s | 160 kB 00:00 2026-02-22T19:45:25.188 INFO:teuthology.orchestra.run.trial152.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-22T19:45:25.198 INFO:teuthology.orchestra.run.trial152.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 64 MB/s | 662 kB 00:00 2026-02-22T19:45:25.205 INFO:teuthology.orchestra.run.trial152.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 45 MB/s | 292 kB 00:00 2026-02-22T19:45:25.211 INFO:teuthology.orchestra.run.trial152.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 39 MB/s | 240 kB 00:00 2026-02-22T19:45:25.215 INFO:teuthology.orchestra.run.trial152.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 8.7 MB/s | 37 kB 00:00 2026-02-22T19:45:25.220 INFO:teuthology.orchestra.run.trial152.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-22T19:45:25.486 INFO:teuthology.orchestra.run.trial152.stdout:(24/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.1 MB/s | 308 kB 00:00 2026-02-22T19:45:25.594 INFO:teuthology.orchestra.run.trial152.stdout:(25/35): pciutils-3.7.0-7.el9.x86_64.rpm 148 kB/s | 93 kB 00:00 2026-02-22T19:45:25.690 INFO:teuthology.orchestra.run.trial152.stdout:(26/35): libarrow-9.0.0-15.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2026-02-22T19:45:25.709 INFO:teuthology.orchestra.run.trial152.stdout:(27/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 215 kB/s | 25 kB 00:00 2026-02-22T19:45:25.735 INFO:teuthology.orchestra.run.trial152.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2026-02-22T19:45:25.788 INFO:teuthology.orchestra.run.trial152.stdout:(29/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 15 MB/s | 838 kB 00:00 2026-02-22T19:45:25.799 INFO:teuthology.orchestra.run.trial152.stdout:(30/35): libunwind-1.6.2-1.el9.x86_64.rpm 750 kB/s | 67 kB 00:00 2026-02-22T19:45:25.835 INFO:teuthology.orchestra.run.trial152.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 4.0 MB/s | 191 kB 00:00 2026-02-22T19:45:25.928 INFO:teuthology.orchestra.run.trial152.stdout:(32/35): nvme-cli-2.16-1.el9.x86_64.rpm 1.0 MB/s | 1.2 MB 00:01 2026-02-22T19:45:26.004 INFO:teuthology.orchestra.run.trial152.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 7.8 MB/s | 1.6 MB 00:00 2026-02-22T19:45:26.381 INFO:teuthology.orchestra.run.trial152.stdout:(34/35): librados2-19.2.3-689.gf90f4eae.el9.x86 6.3 MB/s | 3.4 MB 00:00 2026-02-22T19:45:26.414 INFO:teuthology.orchestra.run.trial152.stdout:(35/35): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 6.5 MB/s | 3.2 MB 00:00 2026-02-22T19:45:26.417 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:45:26.418 INFO:teuthology.orchestra.run.trial152.stdout:Total 11 MB/s | 63 MB 00:05 2026-02-22T19:45:26.510 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:45:26.528 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:45:26.528 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:45:26.783 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:45:26.783 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:45:27.080 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:45:27.089 INFO:teuthology.orchestra.run.trial152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-22T19:45:27.092 INFO:teuthology.orchestra.run.trial152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-22T19:45:27.103 INFO:teuthology.orchestra.run.trial152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-22T19:45:27.254 INFO:teuthology.orchestra.run.trial152.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-22T19:45:27.259 INFO:teuthology.orchestra.run.trial152.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T19:45:27.289 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T19:45:27.331 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T19:45:27.332 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T19:45:27.343 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T19:45:27.347 INFO:teuthology.orchestra.run.trial152.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-22T19:45:27.357 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/37 2026-02-22T19:45:27.379 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T19:45:27.379 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T19:45:27.390 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T19:45:27.421 INFO:teuthology.orchestra.run.trial152.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-22T19:45:27.426 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-22T19:45:27.433 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-22T19:45:27.435 INFO:teuthology.orchestra.run.trial152.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-22T19:45:27.438 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-22T19:45:27.444 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-22T19:45:27.583 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T19:45:27.584 INFO:teuthology.orchestra.run.trial152.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T19:45:27.608 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T19:45:27.611 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/37 2026-02-22T19:45:27.617 INFO:teuthology.orchestra.run.trial152.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-22T19:45:27.842 INFO:teuthology.orchestra.run.trial152.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-22T19:45:27.843 INFO:teuthology.orchestra.run.trial152.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T19:45:27.858 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T19:45:27.864 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/37 2026-02-22T19:45:27.870 INFO:teuthology.orchestra.run.trial152.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-22T19:45:27.872 INFO:teuthology.orchestra.run.trial152.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-22T19:45:27.873 INFO:teuthology.orchestra.run.trial152.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T19:45:27.891 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T19:45:28.007 INFO:teuthology.orchestra.run.trial152.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-22T19:45:28.009 INFO:teuthology.orchestra.run.trial152.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T19:45:28.304 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T19:45:28.304 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T19:45:28.304 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:28.339 INFO:teuthology.orchestra.run.trial152.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-22T19:45:28.341 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 31/37 2026-02-22T19:45:29.314 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T19:45:29.316 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T19:45:29.596 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T19:45:29.600 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T19:45:29.640 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T19:45:29.640 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T19:45:29.640 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T19:45:29.640 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:29.644 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T19:45:34.145 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout:skipping the directory /sys 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout:skipping the directory /proc 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout:skipping the directory /mnt 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout:skipping the directory /var/tmp 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout:skipping the directory /home 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout:skipping the directory /root 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout:skipping the directory /tmp 2026-02-22T19:45:34.146 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:34.597 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T19:45:34.620 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T19:45:34.620 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:45:34.620 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T19:45:34.620 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T19:45:34.620 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T19:45:34.620 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:34.622 INFO:teuthology.orchestra.run.trial152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T19:45:34.635 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T19:45:34.635 INFO:teuthology.orchestra.run.trial152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T19:45:34.689 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T19:45:34.689 INFO:teuthology.orchestra.run.trial152.stdout:Creating group 'qat' with GID 992. 2026-02-22T19:45:34.689 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-22T19:45:34.966 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-22T19:45:34.967 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-22T19:45:34.968 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-22T19:45:34.968 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T19:45:34.968 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-22T19:45:34.968 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 36/37 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout:Upgraded: 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.027 INFO:teuthology.orchestra.run.trial152.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.028 INFO:teuthology.orchestra.run.trial152.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:35.029 INFO:teuthology.orchestra.run.trial152.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T19:45:35.029 INFO:teuthology.orchestra.run.trial152.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T19:45:35.029 INFO:teuthology.orchestra.run.trial152.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T19:45:35.029 INFO:teuthology.orchestra.run.trial152.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T19:45:35.029 INFO:teuthology.orchestra.run.trial152.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T19:45:35.029 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:35.029 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:45:35.066 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-test 2026-02-22T19:45:35.373 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:16 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: Package Arch Version Repository Size 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:Installing dependencies: 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout:Install 5 Packages 2026-02-22T19:45:35.456 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:35.457 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 50 M 2026-02-22T19:45:35.457 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 212 M 2026-02-22T19:45:35.457 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:45:36.008 INFO:teuthology.orchestra.run.trial152.stdout:(1/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 563 kB/s | 163 kB 00:00 2026-02-22T19:45:36.222 INFO:teuthology.orchestra.run.trial152.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 462 kB/s | 233 kB 00:00 2026-02-22T19:45:36.315 INFO:teuthology.orchestra.run.trial152.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 684 kB/s | 64 kB 00:00 2026-02-22T19:45:36.527 INFO:teuthology.orchestra.run.trial152.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 585 kB/s | 303 kB 00:00 2026-02-22T19:45:41.179 INFO:teuthology.orchestra.run.trial152.stdout:(5/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 9.1 MB/s | 50 MB 00:05 2026-02-22T19:45:41.180 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:45:41.181 INFO:teuthology.orchestra.run.trial152.stdout:Total 8.8 MB/s | 50 MB 00:05 2026-02-22T19:45:41.207 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:45:41.215 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:45:41.215 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:45:41.401 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:45:41.401 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:45:41.613 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:45:41.618 INFO:teuthology.orchestra.run.trial152.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-22T19:45:41.622 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-22T19:45:41.630 INFO:teuthology.orchestra.run.trial152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-22T19:45:41.631 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T19:45:43.878 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T19:45:43.895 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T19:45:44.102 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T19:45:44.102 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-22T19:45:44.102 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-22T19:45:44.102 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-22T19:45:44.102 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-22T19:45:44.156 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-22T19:45:44.156 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:44.156 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:45:44.156 INFO:teuthology.orchestra.run.trial152.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:44.156 INFO:teuthology.orchestra.run.trial152.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:44.156 INFO:teuthology.orchestra.run.trial152.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T19:45:44.156 INFO:teuthology.orchestra.run.trial152.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T19:45:44.157 INFO:teuthology.orchestra.run.trial152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T19:45:44.157 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:44.157 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:45:44.190 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph 2026-02-22T19:45:44.494 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:25 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:45:44.580 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout:====================================================================================== 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: Package Arch Version Repository Size 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout:====================================================================================== 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout:Installing dependencies: 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T19:45:44.583 INFO:teuthology.orchestra.run.trial152.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T19:45:44.584 INFO:teuthology.orchestra.run.trial152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout:Installing weak dependencies: 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T19:45:44.585 INFO:teuthology.orchestra.run.trial152.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout:====================================================================================== 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout:Install 99 Packages 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 95 M 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 520 M 2026-02-22T19:45:44.586 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:45:45.471 INFO:teuthology.orchestra.run.trial152.stdout:(1/99): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 126 kB/s | 6.5 kB 00:00 2026-02-22T19:45:45.562 INFO:teuthology.orchestra.run.trial152.stdout:(2/99): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 7.5 MB/s | 1.1 MB 00:00 2026-02-22T19:45:45.590 INFO:teuthology.orchestra.run.trial152.stdout:(3/99): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-22T19:45:45.624 INFO:teuthology.orchestra.run.trial152.stdout:(4/99): ceph-grafana-dashboards-19.2.3-689.gf90 909 kB/s | 31 kB 00:00 2026-02-22T19:45:45.664 INFO:teuthology.orchestra.run.trial152.stdout:(5/99): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 3.8 MB/s | 150 kB 00:00 2026-02-22T19:45:45.698 INFO:teuthology.orchestra.run.trial152.stdout:(6/99): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 21 MB/s | 4.7 MB 00:00 2026-02-22T19:45:45.848 INFO:teuthology.orchestra.run.trial152.stdout:(7/99): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 21 MB/s | 3.8 MB 00:00 2026-02-22T19:45:45.892 INFO:teuthology.orchestra.run.trial152.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 496 kB/s | 22 kB 00:00 2026-02-22T19:45:45.943 INFO:teuthology.orchestra.run.trial152.stdout:(9/99): ceph-mgr-modules-core-19.2.3-689.gf90f4 4.9 MB/s | 253 kB 00:00 2026-02-22T19:45:45.993 INFO:teuthology.orchestra.run.trial152.stdout:(10/99): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 1.0 MB/s | 49 kB 00:00 2026-02-22T19:45:46.026 INFO:teuthology.orchestra.run.trial152.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 23 MB/s | 7.4 MB 00:00 2026-02-22T19:45:46.030 INFO:teuthology.orchestra.run.trial152.stdout:(12/99): ceph-prometheus-alerts-19.2.3-689.gf90 445 kB/s | 17 kB 00:00 2026-02-22T19:45:46.057 INFO:teuthology.orchestra.run.trial152.stdout:(13/99): ceph-volume-19.2.3-689.gf90f4eae.el9.n 9.4 MB/s | 299 kB 00:00 2026-02-22T19:45:46.075 INFO:teuthology.orchestra.run.trial152.stdout:(14/99): cephadm-19.2.3-689.gf90f4eae.el9.noarc 17 MB/s | 769 kB 00:00 2026-02-22T19:45:46.177 INFO:teuthology.orchestra.run.trial152.stdout:(15/99): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-22T19:45:46.651 INFO:teuthology.orchestra.run.trial152.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-22T19:45:46.809 INFO:teuthology.orchestra.run.trial152.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-22T19:45:46.874 INFO:teuthology.orchestra.run.trial152.stdout:(18/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 430 kB/s | 351 kB 00:00 2026-02-22T19:45:47.543 INFO:teuthology.orchestra.run.trial152.stdout:(19/99): libquadmath-11.5.0-14.el9.x86_64.rpm 252 kB/s | 184 kB 00:00 2026-02-22T19:45:47.549 INFO:teuthology.orchestra.run.trial152.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 885 kB/s | 794 kB 00:00 2026-02-22T19:45:47.640 INFO:teuthology.orchestra.run.trial152.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 331 kB/s | 253 kB 00:00 2026-02-22T19:45:48.219 INFO:teuthology.orchestra.run.trial152.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-22T19:45:48.341 INFO:teuthology.orchestra.run.trial152.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 193 kB/s | 135 kB 00:00 2026-02-22T19:45:48.489 INFO:teuthology.orchestra.run.trial152.stdout:(24/99): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-22T19:45:48.927 INFO:teuthology.orchestra.run.trial152.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 213 kB/s | 150 kB 00:00 2026-02-22T19:45:49.039 INFO:teuthology.orchestra.run.trial152.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 181 kB/s | 126 kB 00:00 2026-02-22T19:45:49.249 INFO:teuthology.orchestra.run.trial152.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 287 kB/s | 218 kB 00:00 2026-02-22T19:45:49.314 INFO:teuthology.orchestra.run.trial152.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 454 kB/s | 30 kB 00:00 2026-02-22T19:45:49.378 INFO:teuthology.orchestra.run.trial152.stdout:(29/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 47 MB/s | 3.0 MB 00:00 2026-02-22T19:45:49.405 INFO:teuthology.orchestra.run.trial152.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 557 kB/s | 15 kB 00:00 2026-02-22T19:45:49.445 INFO:teuthology.orchestra.run.trial152.stdout:(31/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 6.1 MB/s | 246 kB 00:00 2026-02-22T19:45:49.470 INFO:teuthology.orchestra.run.trial152.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 7.4 MB/s | 188 kB 00:00 2026-02-22T19:45:49.501 INFO:teuthology.orchestra.run.trial152.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 1.3 MB/s | 42 kB 00:00 2026-02-22T19:45:49.556 INFO:teuthology.orchestra.run.trial152.stdout:(34/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 97 MB/s | 5.3 MB 00:00 2026-02-22T19:45:49.586 INFO:teuthology.orchestra.run.trial152.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 34 MB/s | 1.0 MB 00:00 2026-02-22T19:45:49.656 INFO:teuthology.orchestra.run.trial152.stdout:(36/99): python3-babel-2.9.1-2.el9.noarch.rpm 85 MB/s | 6.0 MB 00:00 2026-02-22T19:45:49.668 INFO:teuthology.orchestra.run.trial152.stdout:(37/99): unzip-6.0-59.el9.x86_64.rpm 245 kB/s | 182 kB 00:00 2026-02-22T19:45:49.698 INFO:teuthology.orchestra.run.trial152.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.1 MB/s | 249 kB 00:00 2026-02-22T19:45:49.699 INFO:teuthology.orchestra.run.trial152.stdout:(39/99): python3-devel-3.9.25-3.el9.x86_64.rpm 5.5 MB/s | 244 kB 00:00 2026-02-22T19:45:49.727 INFO:teuthology.orchestra.run.trial152.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 6.1 MB/s | 177 kB 00:00 2026-02-22T19:45:49.735 INFO:teuthology.orchestra.run.trial152.stdout:(41/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 34 MB/s | 1.2 MB 00:00 2026-02-22T19:45:49.758 INFO:teuthology.orchestra.run.trial152.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 5.5 MB/s | 172 kB 00:00 2026-02-22T19:45:49.761 INFO:teuthology.orchestra.run.trial152.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-22T19:45:49.816 INFO:teuthology.orchestra.run.trial152.stdout:(44/99): zip-3.0-35.el9.x86_64.rpm 342 kB/s | 266 kB 00:00 2026-02-22T19:45:49.820 INFO:teuthology.orchestra.run.trial152.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 7.4 MB/s | 442 kB 00:00 2026-02-22T19:45:49.833 INFO:teuthology.orchestra.run.trial152.stdout:(46/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 82 MB/s | 6.1 MB 00:00 2026-02-22T19:45:49.845 INFO:teuthology.orchestra.run.trial152.stdout:(47/99): python3-packaging-20.9-5.el9.noarch.rp 2.7 MB/s | 77 kB 00:00 2026-02-22T19:45:49.861 INFO:teuthology.orchestra.run.trial152.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.5 MB/s | 159 kB 00:00 2026-02-22T19:45:49.864 INFO:teuthology.orchestra.run.trial152.stdout:(49/99): python3-protobuf-3.14.0-17.el9.noarch. 6.0 MB/s | 267 kB 00:00 2026-02-22T19:45:49.872 INFO:teuthology.orchestra.run.trial152.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 10 MB/s | 279 kB 00:00 2026-02-22T19:45:49.890 INFO:teuthology.orchestra.run.trial152.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 1.8 MB/s | 54 kB 00:00 2026-02-22T19:45:49.901 INFO:teuthology.orchestra.run.trial152.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.4 MB/s | 42 kB 00:00 2026-02-22T19:45:49.927 INFO:teuthology.orchestra.run.trial152.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.4 MB/s | 90 kB 00:00 2026-02-22T19:45:49.929 INFO:teuthology.orchestra.run.trial152.stdout:(54/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 4.7 MB/s | 189 kB 00:00 2026-02-22T19:45:50.011 INFO:teuthology.orchestra.run.trial152.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 132 MB/s | 19 MB 00:00 2026-02-22T19:45:50.011 INFO:teuthology.orchestra.run.trial152.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 265 kB/s | 22 kB 00:00 2026-02-22T19:45:50.097 INFO:teuthology.orchestra.run.trial152.stdout:(57/99): protobuf-compiler-3.14.0-17.el9.x86_64 5.0 MB/s | 862 kB 00:00 2026-02-22T19:45:50.149 INFO:teuthology.orchestra.run.trial152.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 141 kB/s | 19 kB 00:00 2026-02-22T19:45:50.273 INFO:teuthology.orchestra.run.trial152.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.1 MB/s | 551 kB 00:00 2026-02-22T19:45:50.307 INFO:teuthology.orchestra.run.trial152.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 874 kB/s | 29 kB 00:00 2026-02-22T19:45:50.307 INFO:teuthology.orchestra.run.trial152.stdout:(61/99): luarocks-3.9.2-5.el9.noarch.rpm 720 kB/s | 151 kB 00:00 2026-02-22T19:45:50.319 INFO:teuthology.orchestra.run.trial152.stdout:(62/99): python3-asyncssh-2.13.2-5.el9.noarch.r 3.2 MB/s | 548 kB 00:00 2026-02-22T19:45:50.350 INFO:teuthology.orchestra.run.trial152.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 1.4 MB/s | 60 kB 00:00 2026-02-22T19:45:50.358 INFO:teuthology.orchestra.run.trial152.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 867 kB/s | 43 kB 00:00 2026-02-22T19:45:50.362 INFO:teuthology.orchestra.run.trial152.stdout:(65/99): python3-cachetools-4.2.4-1.el9.noarch. 743 kB/s | 32 kB 00:00 2026-02-22T19:45:50.390 INFO:teuthology.orchestra.run.trial152.stdout:(66/99): python3-certifi-2023.05.07-4.el9.noarc 348 kB/s | 14 kB 00:00 2026-02-22T19:45:50.416 INFO:teuthology.orchestra.run.trial152.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 6.6 MB/s | 358 kB 00:00 2026-02-22T19:45:50.422 INFO:teuthology.orchestra.run.trial152.stdout:(68/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.6 MB/s | 173 kB 00:00 2026-02-22T19:45:50.439 INFO:teuthology.orchestra.run.trial152.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 5.1 MB/s | 254 kB 00:00 2026-02-22T19:45:50.484 INFO:teuthology.orchestra.run.trial152.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 3.1 MB/s | 139 kB 00:00 2026-02-22T19:45:50.486 INFO:teuthology.orchestra.run.trial152.stdout:(71/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.2 MB/s | 144 kB 00:00 2026-02-22T19:45:50.520 INFO:teuthology.orchestra.run.trial152.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 20 MB/s | 2.0 MB 00:00 2026-02-22T19:45:50.521 INFO:teuthology.orchestra.run.trial152.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 308 kB/s | 11 kB 00:00 2026-02-22T19:45:50.521 INFO:teuthology.orchestra.run.trial152.stdout:(74/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.5 MB/s | 56 kB 00:00 2026-02-22T19:45:50.551 INFO:teuthology.orchestra.run.trial152.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 586 kB/s | 18 kB 00:00 2026-02-22T19:45:50.552 INFO:teuthology.orchestra.run.trial152.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 643 kB/s | 20 kB 00:00 2026-02-22T19:45:50.552 INFO:teuthology.orchestra.run.trial152.stdout:(77/99): python3-jaraco-collections-3.0.0-8.el9 737 kB/s | 23 kB 00:00 2026-02-22T19:45:50.581 INFO:teuthology.orchestra.run.trial152.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 641 kB/s | 19 kB 00:00 2026-02-22T19:45:50.586 INFO:teuthology.orchestra.run.trial152.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 766 kB/s | 26 kB 00:00 2026-02-22T19:45:50.617 INFO:teuthology.orchestra.run.trial152.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 1.2 MB/s | 46 kB 00:00 2026-02-22T19:45:50.624 INFO:teuthology.orchestra.run.trial152.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 2.1 MB/s | 79 kB 00:00 2026-02-22T19:45:50.648 INFO:teuthology.orchestra.run.trial152.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.8 MB/s | 86 kB 00:00 2026-02-22T19:45:50.657 INFO:teuthology.orchestra.run.trial152.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2026-02-22T19:45:50.670 INFO:teuthology.orchestra.run.trial152.stdout:(84/99): python3-kubernetes-26.1.0-3.el9.noarch 8.7 MB/s | 1.0 MB 00:00 2026-02-22T19:45:50.686 INFO:teuthology.orchestra.run.trial152.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 7.1 MB/s | 272 kB 00:00 2026-02-22T19:45:50.693 INFO:teuthology.orchestra.run.trial152.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 458 kB/s | 16 kB 00:00 2026-02-22T19:45:50.706 INFO:teuthology.orchestra.run.trial152.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.4 MB/s | 90 kB 00:00 2026-02-22T19:45:50.722 INFO:teuthology.orchestra.run.trial152.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 848 kB/s | 31 kB 00:00 2026-02-22T19:45:50.733 INFO:teuthology.orchestra.run.trial152.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 4.6 MB/s | 188 kB 00:00 2026-02-22T19:45:50.744 INFO:teuthology.orchestra.run.trial152.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 1.5 MB/s | 59 kB 00:00 2026-02-22T19:45:50.762 INFO:teuthology.orchestra.run.trial152.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 3.1 MB/s | 125 kB 00:00 2026-02-22T19:45:50.771 INFO:teuthology.orchestra.run.trial152.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 943 kB/s | 36 kB 00:00 2026-02-22T19:45:50.780 INFO:teuthology.orchestra.run.trial152.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 2.3 MB/s | 86 kB 00:00 2026-02-22T19:45:50.797 INFO:teuthology.orchestra.run.trial152.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 6.5 MB/s | 230 kB 00:00 2026-02-22T19:45:50.811 INFO:teuthology.orchestra.run.trial152.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2026-02-22T19:45:50.822 INFO:teuthology.orchestra.run.trial152.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 10 MB/s | 427 kB 00:00 2026-02-22T19:45:50.832 INFO:teuthology.orchestra.run.trial152.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.3 MB/s | 48 kB 00:00 2026-02-22T19:45:50.842 INFO:teuthology.orchestra.run.trial152.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 711 kB/s | 22 kB 00:00 2026-02-22T19:45:50.852 INFO:teuthology.orchestra.run.trial152.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 652 kB/s | 20 kB 00:00 2026-02-22T19:45:50.855 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:45:50.855 INFO:teuthology.orchestra.run.trial152.stdout:Total 15 MB/s | 95 MB 00:06 2026-02-22T19:45:51.301 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:45:51.338 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:45:51.338 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:45:51.755 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:45:51.756 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:45:52.220 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:45:52.222 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-22T19:45:52.253 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-22T19:45:52.258 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-22T19:45:52.279 INFO:teuthology.orchestra.run.trial152.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-22T19:45:52.285 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-22T19:45:52.318 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-22T19:45:52.328 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-22T19:45:52.333 INFO:teuthology.orchestra.run.trial152.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-22T19:45:52.336 INFO:teuthology.orchestra.run.trial152.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-22T19:45:52.340 INFO:teuthology.orchestra.run.trial152.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-22T19:45:52.363 INFO:teuthology.orchestra.run.trial152.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-22T19:45:52.376 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-22T19:45:52.379 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-22T19:45:52.385 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-22T19:45:52.387 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-22T19:45:52.398 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-22T19:45:52.404 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-22T19:45:52.429 INFO:teuthology.orchestra.run.trial152.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-22T19:45:52.432 INFO:teuthology.orchestra.run.trial152.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-22T19:45:52.439 INFO:teuthology.orchestra.run.trial152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-22T19:45:52.463 INFO:teuthology.orchestra.run.trial152.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-22T19:45:52.514 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-22T19:45:52.527 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-22T19:45:52.529 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-22T19:45:52.534 INFO:teuthology.orchestra.run.trial152.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-22T19:45:52.539 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-22T19:45:52.543 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-22T19:45:52.546 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-22T19:45:52.561 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-22T19:45:52.583 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-22T19:45:52.587 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-22T19:45:52.592 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-22T19:45:52.603 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-22T19:45:52.612 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-22T19:45:52.618 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-22T19:45:52.637 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-22T19:45:52.646 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-22T19:45:52.701 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-22T19:45:52.713 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-22T19:45:52.729 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-22T19:45:52.733 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-22T19:45:52.741 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-22T19:45:52.780 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-22T19:45:53.118 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-22T19:45:53.128 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-22T19:45:53.132 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-22T19:45:53.138 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-22T19:45:53.140 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-22T19:45:53.168 INFO:teuthology.orchestra.run.trial152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-22T19:45:53.212 INFO:teuthology.orchestra.run.trial152.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-22T19:45:53.218 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-22T19:45:53.222 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-22T19:45:53.227 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-22T19:45:53.231 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-22T19:45:53.238 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-22T19:45:53.241 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-22T19:45:53.268 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-22T19:45:53.278 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-22T19:45:53.312 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-22T19:45:53.533 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-22T19:45:53.557 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-22T19:45:53.560 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-22T19:45:53.618 INFO:teuthology.orchestra.run.trial152.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-22T19:45:53.620 INFO:teuthology.orchestra.run.trial152.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-22T19:45:53.640 INFO:teuthology.orchestra.run.trial152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-22T19:45:53.961 INFO:teuthology.orchestra.run.trial152.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-22T19:45:54.033 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-22T19:45:54.694 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-22T19:45:54.711 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-22T19:45:54.721 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-22T19:45:54.728 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-22T19:45:54.741 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-22T19:45:54.756 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-22T19:45:54.831 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-22T19:45:54.839 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-22T19:45:54.862 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-22T19:45:54.892 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-22T19:45:54.941 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-22T19:45:54.947 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-22T19:45:54.951 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-22T19:45:54.952 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-22T19:45:54.971 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T19:45:54.971 INFO:teuthology.orchestra.run.trial152.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T19:45:54.971 INFO:teuthology.orchestra.run.trial152.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T19:45:54.971 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:54.978 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T19:45:55.003 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T19:45:55.003 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T19:45:55.003 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:55.037 INFO:teuthology.orchestra.run.trial152.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-22T19:45:55.101 INFO:teuthology.orchestra.run.trial152.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-22T19:45:55.103 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T19:45:55.116 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T19:45:55.116 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:45:55.116 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T19:45:55.117 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:55.815 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T19:45:55.840 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T19:45:55.840 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:45:55.841 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T19:45:55.841 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T19:45:55.841 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T19:45:55.841 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:55.902 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T19:45:55.904 INFO:teuthology.orchestra.run.trial152.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T19:45:55.909 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 88/99 2026-02-22T19:45:55.929 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 89/99 2026-02-22T19:45:55.930 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T19:45:56.422 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T19:45:56.425 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T19:45:56.886 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T19:45:56.887 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T19:45:56.900 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T19:45:56.900 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T19:45:56.954 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T19:45:57.003 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 94/99 2026-02-22T19:45:57.004 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T19:45:57.026 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T19:45:57.026 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:45:57.026 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T19:45:57.026 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T19:45:57.026 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T19:45:57.026 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:57.040 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T19:45:57.260 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T19:45:57.261 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T19:45:57.283 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T19:45:57.283 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:45:57.283 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T19:45:57.283 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T19:45:57.283 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T19:45:57.283 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:57.385 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T19:45:57.405 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T19:45:57.406 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:45:57.406 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T19:45:57.406 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T19:45:57.406 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T19:45:57.406 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:57.424 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-22T19:45:58.116 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-22T19:45:58.117 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-22T19:45:58.118 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T19:45:58.184 INFO:teuthology.orchestra.run.trial152.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T19:45:58.185 INFO:teuthology.orchestra.run.trial152.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: zip-3.0-35.el9.x86_64 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:58.186 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:45:58.238 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-base 2026-02-22T19:45:58.547 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:45:58.612 INFO:teuthology.orchestra.run.trial152.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:45:58.630 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:45:58.631 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:45:58.631 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:45:58.651 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install cephadm 2026-02-22T19:45:58.958 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:45:59.023 INFO:teuthology.orchestra.run.trial152.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:45:59.041 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:45:59.041 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:45:59.041 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:45:59.063 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-immutable-object-cache 2026-02-22T19:45:59.373 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:40 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:45:59.456 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:45:59.456 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout: Package Arch Version Repo Size 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:Install 1 Package 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 145 k 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 431 k 2026-02-22T19:45:59.457 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:45:59.571 INFO:teuthology.orchestra.run.trial152.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.2 MB/s | 145 kB 00:00 2026-02-22T19:45:59.571 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:45:59.572 INFO:teuthology.orchestra.run.trial152.stdout:Total 1.2 MB/s | 145 kB 00:00 2026-02-22T19:45:59.572 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:45:59.576 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:45:59.576 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:45:59.608 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:45:59.609 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:45:59.664 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:45:59.665 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T19:45:59.689 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T19:45:59.690 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:45:59.690 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T19:45:59.690 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:00.007 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T19:46:00.007 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:00.007 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:46:00.007 INFO:teuthology.orchestra.run.trial152.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:00.007 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:00.007 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:00.035 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-mgr 2026-02-22T19:46:00.350 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:41 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:00.415 INFO:teuthology.orchestra.run.trial152.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:00.433 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:00.433 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:00.433 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:00.455 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-mgr-dashboard 2026-02-22T19:46:00.767 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:41 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:00.832 INFO:teuthology.orchestra.run.trial152.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:46:00.850 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:00.850 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:00.850 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:00.871 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-22T19:46:01.180 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:42 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:01.245 INFO:teuthology.orchestra.run.trial152.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:46:01.263 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:01.263 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:01.263 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:01.285 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-mgr-rook 2026-02-22T19:46:01.597 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:42 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:01.662 INFO:teuthology.orchestra.run.trial152.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:46:01.680 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:01.681 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:01.681 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:01.702 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-mgr-cephadm 2026-02-22T19:46:02.017 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:43 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:02.082 INFO:teuthology.orchestra.run.trial152.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:46:02.100 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:02.100 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:02.100 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:02.122 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-fuse 2026-02-22T19:46:02.428 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:43 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:02.511 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:02.511 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:02.511 INFO:teuthology.orchestra.run.trial152.stdout: Package Architecture Version Repository Size 2026-02-22T19:46:02.511 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:02.511 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:46:02.511 INFO:teuthology.orchestra.run.trial152.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout:Install 1 Package 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 1.2 M 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 3.6 M 2026-02-22T19:46:02.512 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:46:02.880 INFO:teuthology.orchestra.run.trial152.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 3.1 MB/s | 1.2 MB 00:00 2026-02-22T19:46:02.882 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:46:02.882 INFO:teuthology.orchestra.run.trial152.stdout:Total 3.1 MB/s | 1.2 MB 00:00 2026-02-22T19:46:02.882 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:46:02.886 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:46:02.886 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:46:02.923 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:46:02.923 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:46:03.025 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:46:03.042 INFO:teuthology.orchestra.run.trial152.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:03.261 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:03.318 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:03.318 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:03.318 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:46:03.318 INFO:teuthology.orchestra.run.trial152.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:03.318 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:03.318 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:03.345 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install ceph-volume 2026-02-22T19:46:03.655 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:44 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:03.720 INFO:teuthology.orchestra.run.trial152.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T19:46:03.738 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:03.739 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:03.739 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:03.759 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install librados-devel 2026-02-22T19:46:04.073 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:45 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:04.157 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout: Package Arch Version Repo Size 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:Install 1 Package 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 126 k 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 456 k 2026-02-22T19:46:04.158 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:46:04.543 INFO:teuthology.orchestra.run.trial152.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 328 kB/s | 126 kB 00:00 2026-02-22T19:46:04.544 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:46:04.544 INFO:teuthology.orchestra.run.trial152.stdout:Total 327 kB/s | 126 kB 00:00 2026-02-22T19:46:04.544 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:46:04.547 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:46:04.547 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:46:04.580 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:46:04.580 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:46:04.635 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:46:04.652 INFO:teuthology.orchestra.run.trial152.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:04.730 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:04.790 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:04.790 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:04.790 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:46:04.790 INFO:teuthology.orchestra.run.trial152.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:04.790 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:04.790 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:04.819 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install libcephfs2 2026-02-22T19:46:05.133 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:46 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:05.198 INFO:teuthology.orchestra.run.trial152.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:05.217 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:05.217 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:05.217 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:05.238 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install libcephfs-devel 2026-02-22T19:46:05.545 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:46 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:05.627 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:05.627 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout: Package Arch Version Repo Size 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:Install 1 Package 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 34 k 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 153 k 2026-02-22T19:46:05.628 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:46:05.899 INFO:teuthology.orchestra.run.trial152.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 124 kB/s | 34 kB 00:00 2026-02-22T19:46:05.899 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:46:05.899 INFO:teuthology.orchestra.run.trial152.stdout:Total 123 kB/s | 34 kB 00:00 2026-02-22T19:46:05.899 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:46:05.902 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:46:05.902 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:46:05.905 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:46:05.905 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:46:05.926 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:46:05.943 INFO:teuthology.orchestra.run.trial152.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:06.001 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:06.057 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:06.058 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:06.058 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:46:06.058 INFO:teuthology.orchestra.run.trial152.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:06.058 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:06.058 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:06.083 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install librados2 2026-02-22T19:46:06.390 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:47 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:06.454 INFO:teuthology.orchestra.run.trial152.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:06.473 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:06.473 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:06.474 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:06.495 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install librbd1 2026-02-22T19:46:06.804 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:47 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:06.868 INFO:teuthology.orchestra.run.trial152.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:06.887 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:06.887 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:06.887 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:06.908 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install python3-rados 2026-02-22T19:46:07.217 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:48 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:07.281 INFO:teuthology.orchestra.run.trial152.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:07.300 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:07.300 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:07.300 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:07.322 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install python3-rgw 2026-02-22T19:46:07.630 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:48 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:07.695 INFO:teuthology.orchestra.run.trial152.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:07.713 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:07.713 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:07.713 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:07.734 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install python3-cephfs 2026-02-22T19:46:08.041 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:49 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:08.108 INFO:teuthology.orchestra.run.trial152.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:08.126 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:08.127 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:08.127 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:08.148 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install python3-rbd 2026-02-22T19:46:08.458 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:49 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:08.522 INFO:teuthology.orchestra.run.trial152.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T19:46:08.541 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:08.542 INFO:teuthology.orchestra.run.trial152.stdout:Nothing to do. 2026-02-22T19:46:08.542 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:08.563 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install rbd-fuse 2026-02-22T19:46:08.870 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:49 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout: Package Architecture Version Repository Size 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:Install 1 Package 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 85 k 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 227 k 2026-02-22T19:46:08.953 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:46:09.234 INFO:teuthology.orchestra.run.trial152.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 304 kB/s | 85 kB 00:00 2026-02-22T19:46:09.235 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:46:09.235 INFO:teuthology.orchestra.run.trial152.stdout:Total 302 kB/s | 85 kB 00:00 2026-02-22T19:46:09.235 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:46:09.239 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:46:09.239 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:46:09.270 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:46:09.270 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:46:09.321 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:46:09.338 INFO:teuthology.orchestra.run.trial152.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:09.417 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:09.474 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:09.474 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:09.474 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:46:09.475 INFO:teuthology.orchestra.run.trial152.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:09.475 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:09.475 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:09.501 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install rbd-mirror 2026-02-22T19:46:09.814 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:50 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:09.900 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:09.900 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:09.900 INFO:teuthology.orchestra.run.trial152.stdout: Package Arch Version Repo Size 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:Install 1 Package 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 3.1 M 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 13 M 2026-02-22T19:46:09.901 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:46:11.346 INFO:teuthology.orchestra.run.trial152.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 2.2 MB/s | 3.1 MB 00:01 2026-02-22T19:46:11.347 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:46:11.347 INFO:teuthology.orchestra.run.trial152.stdout:Total 2.2 MB/s | 3.1 MB 00:01 2026-02-22T19:46:11.347 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:46:11.351 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:46:11.352 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:46:11.392 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:46:11.392 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:46:11.583 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:46:11.584 INFO:teuthology.orchestra.run.trial152.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:11.607 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:11.607 INFO:teuthology.orchestra.run.trial152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T19:46:11.607 INFO:teuthology.orchestra.run.trial152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T19:46:11.607 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T19:46:11.607 INFO:teuthology.orchestra.run.trial152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T19:46:11.607 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:11.903 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:11.903 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:11.903 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:46:11.903 INFO:teuthology.orchestra.run.trial152.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:11.903 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:11.903 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:11.931 DEBUG:teuthology.orchestra.run.trial152:> sudo yum -y install rbd-nbd 2026-02-22T19:46:12.239 INFO:teuthology.orchestra.run.trial152.stdout:Last metadata expiration check: 0:00:53 ago on Sun 22 Feb 2026 07:45:19 PM UTC. 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:Dependencies resolved. 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout: Package Architecture Version Repository Size 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:Installing: 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:Transaction Summary 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:================================================================================ 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:Install 1 Package 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:Total download size: 170 k 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:Installed size: 490 k 2026-02-22T19:46:12.322 INFO:teuthology.orchestra.run.trial152.stdout:Downloading Packages: 2026-02-22T19:46:12.731 INFO:teuthology.orchestra.run.trial152.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 417 kB/s | 170 kB 00:00 2026-02-22T19:46:12.732 INFO:teuthology.orchestra.run.trial152.stdout:-------------------------------------------------------------------------------- 2026-02-22T19:46:12.732 INFO:teuthology.orchestra.run.trial152.stdout:Total 416 kB/s | 170 kB 00:00 2026-02-22T19:46:12.732 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction check 2026-02-22T19:46:12.736 INFO:teuthology.orchestra.run.trial152.stdout:Transaction check succeeded. 2026-02-22T19:46:12.736 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction test 2026-02-22T19:46:12.767 INFO:teuthology.orchestra.run.trial152.stdout:Transaction test succeeded. 2026-02-22T19:46:12.767 INFO:teuthology.orchestra.run.trial152.stdout:Running transaction 2026-02-22T19:46:12.823 INFO:teuthology.orchestra.run.trial152.stdout: Preparing : 1/1 2026-02-22T19:46:12.840 INFO:teuthology.orchestra.run.trial152.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:12.923 INFO:teuthology.orchestra.run.trial152.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:12.981 INFO:teuthology.orchestra.run.trial152.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T19:46:12.981 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:12.981 INFO:teuthology.orchestra.run.trial152.stdout:Installed: 2026-02-22T19:46:12.981 INFO:teuthology.orchestra.run.trial152.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T19:46:12.981 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:12.981 INFO:teuthology.orchestra.run.trial152.stdout:Complete! 2026-02-22T19:46:13.011 DEBUG:teuthology.parallel:result is None 2026-02-22T19:46:13.011 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:46:13.136 DEBUG:teuthology.orchestra.run.trial152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T19:46:13.157 INFO:teuthology.orchestra.run.trial152.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T19:46:13.157 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T19:46:13.157 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T19:46:13.159 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T19:46:13.159 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:13.159 DEBUG:teuthology.orchestra.run.trial152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T19:46:13.221 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T19:46:13.222 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:13.222 DEBUG:teuthology.orchestra.run.trial152:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T19:46:13.285 DEBUG:teuthology.orchestra.run.trial152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T19:46:13.350 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T19:46:13.351 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:13.351 DEBUG:teuthology.orchestra.run.trial152:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T19:46:13.413 DEBUG:teuthology.orchestra.run.trial152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T19:46:13.480 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T19:46:13.481 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:13.481 DEBUG:teuthology.orchestra.run.trial152:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T19:46:13.544 DEBUG:teuthology.orchestra.run.trial152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T19:46:13.607 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T19:46:13.685 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T19:46:13.685 DEBUG:teuthology.orchestra.run.trial152:> sudo chmod 777 /var/log/ceph 2026-02-22T19:46:13.709 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T19:46:13.709 DEBUG:teuthology.orchestra.run.trial152:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T19:46:13.774 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T19:46:13.774 DEBUG:teuthology.orchestra.run.trial152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T19:46:13.840 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T19:46:13.840 INFO:tasks.ceph:config {'conf': {'client': {'rbd validate pool': False}, 'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-22T19:46:13.840 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/63962', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rbd/singleton/{all/rbd-vs-unmanaged-snaps conf/{disable-pool-app} objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '63962', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 2, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0']], 'seed': 9196, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFEzP5yqX21gfdv0EBN7sk9i2UzRKMZ5AMqPIM4dZEETtXGm70M3dt3igAKv8qdr8CfwTdKT2aFLwhpXF0At7cI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'rbd validate pool': False}, 'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['mon/rbd_snaps_ops.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:38', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T19:46:13.841 DEBUG:teuthology.orchestra.run.trial152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T19:46:13.894 DEBUG:teuthology.orchestra.run.trial152:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T19:46:13.957 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:13.957 DEBUG:teuthology.orchestra.run.trial152:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T19:46:14.013 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T19:46:14.013 DEBUG:teuthology.orchestra.run.trial152:> stat /dev/vg_nvme/lv_1 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout:Access: 2026-02-22 19:46:11.747543267 +0000 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout:Modify: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout:Change: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.069 INFO:teuthology.orchestra.run.trial152.stdout: Birth: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.069 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T19:46:14.131 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records in 2026-02-22T19:46:14.131 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records out 2026-02-22T19:46:14.131 INFO:teuthology.orchestra.run.trial152.stderr:512 bytes copied, 0.00015992 s, 3.2 MB/s 2026-02-22T19:46:14.132 DEBUG:teuthology.orchestra.run.trial152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T19:46:14.190 DEBUG:teuthology.orchestra.run.trial152:> stat /dev/vg_nvme/lv_2 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout:Access: 2026-02-22 19:46:11.748543441 +0000 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout:Modify: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout:Change: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.246 INFO:teuthology.orchestra.run.trial152.stdout: Birth: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.246 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T19:46:14.309 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records in 2026-02-22T19:46:14.309 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records out 2026-02-22T19:46:14.309 INFO:teuthology.orchestra.run.trial152.stderr:512 bytes copied, 0.000142585 s, 3.6 MB/s 2026-02-22T19:46:14.310 DEBUG:teuthology.orchestra.run.trial152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T19:46:14.367 DEBUG:teuthology.orchestra.run.trial152:> stat /dev/vg_nvme/lv_3 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout:Access: 2026-02-22 19:46:11.748543441 +0000 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout:Modify: 2026-02-22 19:45:28.328206895 +0000 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout:Change: 2026-02-22 19:45:28.328206895 +0000 2026-02-22T19:46:14.425 INFO:teuthology.orchestra.run.trial152.stdout: Birth: 2026-02-22 19:45:28.328206895 +0000 2026-02-22T19:46:14.425 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T19:46:14.488 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records in 2026-02-22T19:46:14.488 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records out 2026-02-22T19:46:14.488 INFO:teuthology.orchestra.run.trial152.stderr:512 bytes copied, 0.000156563 s, 3.3 MB/s 2026-02-22T19:46:14.489 DEBUG:teuthology.orchestra.run.trial152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T19:46:14.546 DEBUG:teuthology.orchestra.run.trial152:> stat /dev/vg_nvme/lv_4 2026-02-22T19:46:14.602 INFO:teuthology.orchestra.run.trial152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout:Access: 2026-02-22 19:46:11.748543441 +0000 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout:Modify: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout:Change: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.603 INFO:teuthology.orchestra.run.trial152.stdout: Birth: 2026-02-22 19:45:28.329206856 +0000 2026-02-22T19:46:14.603 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T19:46:14.666 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records in 2026-02-22T19:46:14.666 INFO:teuthology.orchestra.run.trial152.stderr:1+0 records out 2026-02-22T19:46:14.666 INFO:teuthology.orchestra.run.trial152.stderr:512 bytes copied, 0.000144007 s, 3.6 MB/s 2026-02-22T19:46:14.667 DEBUG:teuthology.orchestra.run.trial152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T19:46:14.726 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-22T19:46:14.726 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}} 2026-02-22T19:46:14.726 INFO:tasks.ceph:Generating config... 2026-02-22T19:46:14.728 INFO:tasks.ceph:[client] rbd validate pool = False 2026-02-22T19:46:14.728 INFO:tasks.ceph:[global] mon warn on pool no app = False 2026-02-22T19:46:14.728 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T19:46:14.728 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T19:46:14.728 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T19:46:14.728 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T19:46:14.728 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-22T19:46:14.728 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-22T19:46:14.728 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T19:46:14.729 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T19:46:14.801 INFO:teuthology.orchestra.run.trial152.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T19:46:14.804 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T19:46:14.881 DEBUG:teuthology.orchestra.run.trial152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T19:46:14.945 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.152')] 2026-02-22T19:46:14.946 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.152', 'mon warn on pool no app': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd validate pool': False}, 'mon.a': {}} 2026-02-22T19:46:14.946 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:14.946 DEBUG:teuthology.orchestra.run.trial152:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T19:46:15.003 DEBUG:teuthology.orchestra.run.trial152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.152 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:46:15.074 INFO:teuthology.orchestra.run.trial152.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:46:15.074 INFO:teuthology.orchestra.run.trial152.stdout:monmaptool: generated fsid e1b06997-d835-4966-9333-0c5096f1f21b 2026-02-22T19:46:15.074 INFO:teuthology.orchestra.run.trial152.stdout:setting min_mon_release = quincy 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:epoch 0 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:fsid e1b06997-d835-4966-9333-0c5096f1f21b 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:last_changed 2026-02-22T19:46:15.072652+0000 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:created 2026-02-22T19:46:15.072652+0000 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:min_mon_release 17 (quincy) 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:election_strategy: 1 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:0: [v2:10.20.193.152:3300/0,v1:10.20.193.152:6789/0] mon.a 2026-02-22T19:46:15.075 INFO:teuthology.orchestra.run.trial152.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-22T19:46:15.076 DEBUG:teuthology.orchestra.run.trial152:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T19:46:15.131 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e1b06997-d835-4966-9333-0c5096f1f21b... 2026-02-22T19:46:15.132 DEBUG:teuthology.orchestra.run.trial152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T19:46:15.211 INFO:teuthology.orchestra.run.trial152.stdout:[global] 2026-02-22T19:46:15.211 INFO:teuthology.orchestra.run.trial152.stdout: chdir = "" 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: auth supported = cephx 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: filestore xattr use omap = true 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: mon clock drift allowed = 1.000 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: osd crush chooseleaf type = 0 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: auth debug = true 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: ms die on old message = true 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: ms die on bug = true 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: mon pg warn max object skew = 0 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: osd pool default size = 2 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: mon osd allow primary affinity = true 2026-02-22T19:46:15.212 INFO:teuthology.orchestra.run.trial152.stdout: mon osd allow pg remap = true 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon warn on legacy crush tunables = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon warn on crush straw calc version zero = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon warn on no sortbitwise = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon warn on osd down out interval zero = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon warn on too few osds = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon_allow_pool_size_one = true 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: osd default data pool replay window = 5 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon allow pool delete = true 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon cluster log file level = debug 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: debug asserts on shutdown = true 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon health detail to clog = false 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon host = 10.20.193.152 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: mon warn on pool no app = False 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: fsid = e1b06997-d835-4966-9333-0c5096f1f21b 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.213 INFO:teuthology.orchestra.run.trial152.stdout:[osd] 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd journal size = 100 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd scrub load threshold = 5.0 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd scrub max interval = 600 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd mclock profile = high_recovery_ops 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd mclock skip benchmark = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd recover clone overlap = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd recovery max chunk = 1048576 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd debug shutdown = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd debug op order = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd debug verify stray on activate = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd debug trim objects = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd open classes on start = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd debug pg log writeout = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd deep scrub update digest min age = 30 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: osd map max advance = 10 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: journal zero on create = true 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.214 INFO:teuthology.orchestra.run.trial152.stdout: filestore ondisk finisher threads = 3 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: filestore apply finisher threads = 3 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: bdev debug aio = true 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: osd debug misdirected ops = true 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: bluestore block size = 96636764160 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: bluestore compression algorithm = zstd 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: bluestore compression mode = aggressive 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: bluestore fsck on mount = True 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug bluefs = 1/20 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug bluestore = 1/20 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug ms = 1 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug osd = 20 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug rocksdb = 4/10 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: mon osd full ratio = 0.9 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: mon osd nearfull ratio = 0.8 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: osd failsafe full ratio = 0.95 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: osd objectstore = bluestore 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout:[mgr] 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug ms = 1 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug mgr = 20 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug mon = 20 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: debug auth = 20 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: mon reweight min pgs per osd = 4 2026-02-22T19:46:15.215 INFO:teuthology.orchestra.run.trial152.stdout: mon reweight min bytes per osd = 10 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mgr/telemetry/nag = false 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout:[mon] 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: debug ms = 1 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: debug mon = 20 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: debug paxos = 20 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: debug auth = 20 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon data avail warn = 5 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon mgr mkfs grace = 240 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon reweight min pgs per osd = 4 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon osd reporter subtree level = osd 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon osd prime pg temp = true 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon reweight min bytes per osd = 10 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: # 1m isn't quite enough 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon_down_mkfs_grace = 2m 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.216 INFO:teuthology.orchestra.run.trial152.stdout: mon_warn_on_filestore_osds = false 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout:[client] 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout: rgw cache enabled = true 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout: rgw enable ops log = true 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout: rgw enable usage log = true 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout: rbd validate pool = False 2026-02-22T19:46:15.217 INFO:teuthology.orchestra.run.trial152.stdout:[mon.a] 2026-02-22T19:46:15.221 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T19:46:15.221 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T19:46:15.302 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T19:46:15.302 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:15.302 DEBUG:teuthology.orchestra.run.trial152:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T19:46:15.359 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:15.359 DEBUG:teuthology.orchestra.run.trial152:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T19:46:15.415 INFO:tasks.ceph:Sending monmap to node ubuntu@trial152.front.sepia.ceph.com 2026-02-22T19:46:15.415 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:15.415 DEBUG:teuthology.orchestra.run.trial152:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T19:46:15.415 DEBUG:teuthology.orchestra.run.trial152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T19:46:15.487 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:15.487 DEBUG:teuthology.orchestra.run.trial152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:46:15.544 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T19:46:15.544 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T19:46:15.544 DEBUG:teuthology.orchestra.run.trial152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T19:46:15.629 INFO:teuthology.orchestra.run.trial152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T19:46:15.631 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T19:46:15.631 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T19:46:15.631 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T19:46:15.664 INFO:teuthology.orchestra.run.trial152.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T19:46:15.675 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T19:46:15.675 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}} 2026-02-22T19:46:15.676 DEBUG:teuthology.orchestra.run.trial152:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T19:46:15.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-22T19:46:15.739 INFO:tasks.ceph:role: osd.0 2026-02-22T19:46:15.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial152.front.sepia.ceph.com 2026-02-22T19:46:15.739 DEBUG:teuthology.orchestra.run.trial152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout: = sunit=0 swidth=0 blks 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T19:46:15.804 INFO:teuthology.orchestra.run.trial152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T19:46:16.376 INFO:teuthology.orchestra.run.trial152.stdout:Discarding blocks...Done. 2026-02-22T19:46:16.378 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial152.front.sepia.ceph.com -o noatime 2026-02-22T19:46:16.378 DEBUG:teuthology.orchestra.run.trial152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T19:46:16.446 DEBUG:teuthology.orchestra.run.trial152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T19:46:16.512 DEBUG:teuthology.orchestra.run.trial152:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T19:46:16.578 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-22T19:46:16.578 INFO:tasks.ceph:role: osd.1 2026-02-22T19:46:16.578 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial152.front.sepia.ceph.com 2026-02-22T19:46:16.578 DEBUG:teuthology.orchestra.run.trial152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T19:46:16.643 INFO:teuthology.orchestra.run.trial152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout: = sunit=0 swidth=0 blks 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T19:46:16.644 INFO:teuthology.orchestra.run.trial152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T19:46:17.215 INFO:teuthology.orchestra.run.trial152.stdout:Discarding blocks...Done. 2026-02-22T19:46:17.217 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial152.front.sepia.ceph.com -o noatime 2026-02-22T19:46:17.217 DEBUG:teuthology.orchestra.run.trial152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T19:46:17.284 DEBUG:teuthology.orchestra.run.trial152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T19:46:17.352 DEBUG:teuthology.orchestra.run.trial152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:46:17.431 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:17.428+0000 7f23ba362780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T19:46:17.431 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:17.429+0000 7f23ba362780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T19:46:17.431 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:17.429+0000 7f23ba362780 -1 bdev(0x55c852123800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T19:46:17.432 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:17.429+0000 7f23ba362780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T19:46:20.578 DEBUG:teuthology.orchestra.run.trial152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T19:46:20.644 DEBUG:teuthology.orchestra.run.trial152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:46:20.721 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:20.718+0000 7fded1611780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T19:46:20.721 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:20.719+0000 7fded1611780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T19:46:20.721 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:20.719+0000 7fded1611780 -1 bdev(0x556c858e5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T19:46:20.722 INFO:teuthology.orchestra.run.trial152.stderr:2026-02-22T19:46:20.719+0000 7fded1611780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T19:46:23.625 DEBUG:teuthology.orchestra.run.trial152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T19:46:23.690 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T19:46:23.690 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:23.690 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T19:46:23.756 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:23.756 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T19:46:23.821 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:23.822 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T19:46:23.884 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:23.885 DEBUG:teuthology.orchestra.run.trial152:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T19:46:23.941 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T19:46:23.941 DEBUG:teuthology.orchestra.run.trial152:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T19:46:24.003 INFO:teuthology.orchestra.run.trial152.stdout:[mgr.x] 2026-02-22T19:46:24.004 INFO:teuthology.orchestra.run.trial152.stdout: key = AQAHXZtpCvFfJRAAoqFc6TGxuxbHq/gJbDY/fw== 2026-02-22T19:46:24.004 INFO:teuthology.orchestra.run.trial152.stdout:[osd.0] 2026-02-22T19:46:24.004 INFO:teuthology.orchestra.run.trial152.stdout: key = AQAJXZtptUmiGRAAPI/10oauF6fyNM3kf/B4VQ== 2026-02-22T19:46:24.004 INFO:teuthology.orchestra.run.trial152.stdout:[osd.1] 2026-02-22T19:46:24.004 INFO:teuthology.orchestra.run.trial152.stdout: key = AQAMXZtpmI/rKhAAYq4KeJ4oVSeyb+0Tm6fc7w== 2026-02-22T19:46:24.004 INFO:teuthology.orchestra.run.trial152.stdout:[client.0] 2026-02-22T19:46:24.004 INFO:teuthology.orchestra.run.trial152.stdout: key = AQAHXZtp/Dl/JxAAVBXU2RMYbH5NdEzeWrvd1Q== 2026-02-22T19:46:24.005 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T19:46:24.085 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T19:46:24.163 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T19:46:24.241 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T19:46:24.323 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T19:46:24.324 DEBUG:teuthology.orchestra.run.trial152:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T19:46:24.387 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T19:46:24.469 DEBUG:teuthology.orchestra.run.trial152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T19:46:24.534 DEBUG:teuthology.orchestra.run.trial152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T19:46:24.589 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T19:46:24.589 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T19:46:24.590 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T19:46:24.631 INFO:tasks.ceph.mon.a:Started 2026-02-22T19:46:24.631 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T19:46:24.631 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T19:46:24.631 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T19:46:24.633 INFO:tasks.ceph.mgr.x:Started 2026-02-22T19:46:24.634 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T19:46:24.634 DEBUG:teuthology.orchestra.run.trial152:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T19:46:24.731 INFO:teuthology.orchestra.run.trial152.stderr:adjusted tunables profile to default 2026-02-22T19:46:24.739 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T19:46:24.739 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T19:46:24.739 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:24.739 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T19:46:24.762 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:46:24.762 DEBUG:teuthology.orchestra.run.trial152:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T19:46:24.826 DEBUG:teuthology.orchestra.run.trial152:> sudo ceph --cluster ceph osd new 55b13ce7-3562-42d7-ac00-55da2087cde8 0 2026-02-22T19:46:24.975 INFO:teuthology.orchestra.run.trial152.stdout:0 2026-02-22T19:46:24.984 DEBUG:teuthology.orchestra.run.trial152:> sudo ceph --cluster ceph osd new 55e8606a-e930-4da4-97d6-a311296d2e0f 1 2026-02-22T19:46:25.086 INFO:teuthology.orchestra.run.trial152.stdout:1 2026-02-22T19:46:25.092 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T19:46:25.092 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T19:46:25.094 INFO:tasks.ceph.osd.0:Started 2026-02-22T19:46:25.094 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T19:46:25.094 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T19:46:25.095 INFO:tasks.ceph.osd.1:Started 2026-02-22T19:46:25.096 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:46:25.197 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:25.198 INFO:teuthology.orchestra.run.trial152.stdout:{"epoch":4,"fsid":"e1b06997-d835-4966-9333-0c5096f1f21b","created":"2026-02-22T19:46:24.691210+0000","modified":"2026-02-22T19:46:25.084322+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T19:46:25.084322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"55b13ce7-3562-42d7-ac00-55da2087cde8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"55e8606a-e930-4da4-97d6-a311296d2e0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:46:25.203 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T19:46:25.203 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T19:46:25.246 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.243+0000 7fa3f87ce140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T19:46:25.367 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.364+0000 7fa3f87ce140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T19:46:25.394 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.391+0000 7fa3f87ce140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T19:46:25.405 DEBUG:teuthology.orchestra.run.trial152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T19:46:25.428 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.425+0000 7fa3f87ce140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T19:46:25.451 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.448+0000 7fa3f87ce140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T19:46:25.478 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.475+0000 7fa3f87ce140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T19:46:25.496 INFO:teuthology.misc.health.trial152.stdout: 2026-02-22T19:46:25.496 INFO:teuthology.misc.health.trial152.stdout:{"epoch":4,"fsid":"e1b06997-d835-4966-9333-0c5096f1f21b","created":"2026-02-22T19:46:24.691210+0000","modified":"2026-02-22T19:46:25.084322+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T19:46:25.084322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"55b13ce7-3562-42d7-ac00-55da2087cde8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"55e8606a-e930-4da4-97d6-a311296d2e0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:46:25.501 DEBUG:teuthology.misc:0 of 2 OSDs are up 2026-02-22T19:46:25.535 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.532+0000 7fa3f87ce140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T19:46:25.596 INFO:tasks.ceph.mgr.x.trial152.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T19:46:25.596 INFO:tasks.ceph.mgr.x.trial152.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T19:46:25.596 INFO:tasks.ceph.mgr.x.trial152.stderr: from numpy import show_config as show_numpy_config 2026-02-22T19:46:25.599 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.596+0000 7fa3f87ce140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T19:46:25.625 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.622+0000 7fa3f87ce140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T19:46:25.680 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.677+0000 7fa3f87ce140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T19:46:25.723 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.720+0000 7fa3f87ce140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T19:46:25.749 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.746+0000 7fa3f87ce140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T19:46:25.773 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.770+0000 7fa3f87ce140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T19:46:25.799 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.796+0000 7fa3f87ce140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T19:46:25.821 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:25.818+0000 7fa3f87ce140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T19:46:26.014 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.011+0000 7fa3f87ce140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T19:46:26.069 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.066+0000 7fa3f87ce140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T19:46:26.091 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.088+0000 7fa3f87ce140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T19:46:26.114 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.111+0000 7fa3f87ce140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T19:46:26.167 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.164+0000 7fa3f87ce140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T19:46:26.188 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.185+0000 7fa3f87ce140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T19:46:26.240 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.237+0000 7fa3f87ce140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T19:46:26.556 INFO:tasks.ceph.osd.0.trial152.stderr:2026-02-22T19:46:26.553+0000 7fab32211780 -1 Falling back to public interface 2026-02-22T19:46:26.649 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.646+0000 7fa3f87ce140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T19:46:26.671 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:26.668+0000 7fa3f87ce140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T19:46:26.794 INFO:tasks.ceph.osd.1.trial152.stderr:2026-02-22T19:46:26.791+0000 7f61f8297780 -1 Falling back to public interface 2026-02-22T19:46:27.015 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:27.012+0000 7fa3f87ce140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T19:46:28.020 INFO:tasks.ceph.mgr.x.trial152.stderr:2026-02-22T19:46:28.018+0000 7fa315435640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-22T19:46:30.535 INFO:tasks.ceph.osd.1.trial152.stderr:2026-02-22T19:46:30.533+0000 7f61f8297780 -1 osd.1 0 log_to_monitors true 2026-02-22T19:46:30.575 INFO:tasks.ceph.osd.0.trial152.stderr:2026-02-22T19:46:30.573+0000 7fab32211780 -1 osd.0 0 log_to_monitors true 2026-02-22T19:46:31.703 DEBUG:teuthology.orchestra.run.trial152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T19:46:31.860 INFO:teuthology.misc.health.trial152.stdout: 2026-02-22T19:46:31.860 INFO:teuthology.misc.health.trial152.stdout:{"epoch":5,"fsid":"e1b06997-d835-4966-9333-0c5096f1f21b","created":"2026-02-22T19:46:24.691210+0000","modified":"2026-02-22T19:46:31.019078+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T19:46:25.084322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"55b13ce7-3562-42d7-ac00-55da2087cde8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"55e8606a-e930-4da4-97d6-a311296d2e0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:46:31.867 DEBUG:teuthology.misc:0 of 2 OSDs are up 2026-02-22T19:46:32.036 INFO:tasks.ceph.osd.1.trial152.stderr:2026-02-22T19:46:32.034+0000 7f61f4224640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T19:46:32.036 INFO:tasks.ceph.osd.0.trial152.stderr:2026-02-22T19:46:32.034+0000 7fab2e19e640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T19:46:32.038 INFO:tasks.ceph.osd.0.trial152.stderr:2026-02-22T19:46:32.036+0000 7fab25fc0640 -1 osd.0 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T19:46:32.038 INFO:tasks.ceph.osd.1.trial152.stderr:2026-02-22T19:46:32.036+0000 7f61ec046640 -1 osd.1 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T19:46:38.069 DEBUG:teuthology.orchestra.run.trial152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T19:46:38.222 INFO:teuthology.misc.health.trial152.stdout: 2026-02-22T19:46:38.222 INFO:teuthology.misc.health.trial152.stdout:{"epoch":10,"fsid":"e1b06997-d835-4966-9333-0c5096f1f21b","created":"2026-02-22T19:46:24.691210+0000","modified":"2026-02-22T19:46:36.030423+0000","last_up_change":"2026-02-22T19:46:33.024691+0000","last_in_change":"2026-02-22T19:46:25.084322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T19:46:33.030808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55b13ce7-3562-42d7-ac00-55da2087cde8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6800","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6801","nonce":483603205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6802","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6803","nonce":483603205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6806","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6807","nonce":483603205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6804","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6805","nonce":483603205}]},"public_addr":"10.20.193.152:6801/483603205","cluster_addr":"10.20.193.152:6803/483603205","heartbeat_back_addr":"10.20.193.152:6807/483603205","heartbeat_front_addr":"10.20.193.152:6805/483603205","state":["exists","up"]},{"osd":1,"uuid":"55e8606a-e930-4da4-97d6-a311296d2e0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6808","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6809","nonce":3473158730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6810","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6811","nonce":3473158730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6814","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6815","nonce":3473158730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6812","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6813","nonce":3473158730}]},"public_addr":"10.20.193.152:6809/3473158730","cluster_addr":"10.20.193.152:6811/3473158730","heartbeat_back_addr":"10.20.193.152:6815/3473158730","heartbeat_front_addr":"10.20.193.152:6813/3473158730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:46:38.229 DEBUG:teuthology.misc:2 of 2 OSDs are up 2026-02-22T19:46:38.229 INFO:tasks.ceph:Creating RBD pool 2026-02-22T19:46:38.229 DEBUG:teuthology.orchestra.run.trial152:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T19:46:39.039 INFO:teuthology.orchestra.run.trial152.stderr:pool 'rbd' created 2026-02-22T19:46:39.049 DEBUG:teuthology.orchestra.run.trial152:> rbd --cluster ceph pool init rbd 2026-02-22T19:46:40.053 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T19:46:40.053 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T19:46:40.053 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T19:46:40.053 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T19:46:40.054 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T19:46:40.234 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:40.242 INFO:teuthology.orchestra.run.trial152.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6816","nonce":2264197048},{"type":"v1","addr":"10.20.193.152:6817","nonce":2264197048}]},"active_addr":"10.20.193.152:6817/2264197048","active_change":"2026-02-22T19:46:27.014768+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.152:0","nonce":3728491522}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.152:0","nonce":2686750129}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.152:0","nonce":2249066436}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.152:0","nonce":2977399567}]}]} 2026-02-22T19:46:40.244 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T19:46:40.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T19:46:40.245 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:46:40.401 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:40.401 INFO:teuthology.orchestra.run.trial152.stdout:{"epoch":12,"fsid":"e1b06997-d835-4966-9333-0c5096f1f21b","created":"2026-02-22T19:46:24.691210+0000","modified":"2026-02-22T19:46:40.037757+0000","last_up_change":"2026-02-22T19:46:33.024691+0000","last_in_change":"2026-02-22T19:46:25.084322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T19:46:33.030808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T19:46:38.384838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55b13ce7-3562-42d7-ac00-55da2087cde8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6800","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6801","nonce":483603205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6802","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6803","nonce":483603205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6806","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6807","nonce":483603205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6804","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6805","nonce":483603205}]},"public_addr":"10.20.193.152:6801/483603205","cluster_addr":"10.20.193.152:6803/483603205","heartbeat_back_addr":"10.20.193.152:6807/483603205","heartbeat_front_addr":"10.20.193.152:6805/483603205","state":["exists","up"]},{"osd":1,"uuid":"55e8606a-e930-4da4-97d6-a311296d2e0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6808","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6809","nonce":3473158730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6810","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6811","nonce":3473158730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6814","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6815","nonce":3473158730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6812","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6813","nonce":3473158730}]},"public_addr":"10.20.193.152:6809/3473158730","cluster_addr":"10.20.193.152:6811/3473158730","heartbeat_back_addr":"10.20.193.152:6815/3473158730","heartbeat_front_addr":"10.20.193.152:6813/3473158730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:46:40.409 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T19:46:40.410 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:46:40.567 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:40.567 INFO:teuthology.orchestra.run.trial152.stdout:{"epoch":12,"fsid":"e1b06997-d835-4966-9333-0c5096f1f21b","created":"2026-02-22T19:46:24.691210+0000","modified":"2026-02-22T19:46:40.037757+0000","last_up_change":"2026-02-22T19:46:33.024691+0000","last_in_change":"2026-02-22T19:46:25.084322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T19:46:33.030808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T19:46:38.384838+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55b13ce7-3562-42d7-ac00-55da2087cde8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6800","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6801","nonce":483603205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6802","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6803","nonce":483603205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6806","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6807","nonce":483603205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6804","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6805","nonce":483603205}]},"public_addr":"10.20.193.152:6801/483603205","cluster_addr":"10.20.193.152:6803/483603205","heartbeat_back_addr":"10.20.193.152:6807/483603205","heartbeat_front_addr":"10.20.193.152:6805/483603205","state":["exists","up"]},{"osd":1,"uuid":"55e8606a-e930-4da4-97d6-a311296d2e0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6808","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6809","nonce":3473158730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6810","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6811","nonce":3473158730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6814","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6815","nonce":3473158730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6812","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6813","nonce":3473158730}]},"public_addr":"10.20.193.152:6809/3473158730","cluster_addr":"10.20.193.152:6811/3473158730","heartbeat_back_addr":"10.20.193.152:6815/3473158730","heartbeat_front_addr":"10.20.193.152:6813/3473158730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:46:40.576 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T19:46:40.576 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T19:46:40.660 INFO:teuthology.orchestra.run.trial152.stdout:30064771077 2026-02-22T19:46:40.661 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T19:46:40.661 INFO:teuthology.orchestra.run.trial152.stdout:30064771075 2026-02-22T19:46:40.661 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T19:46:40.858 INFO:teuthology.orchestra.run.trial152.stdout:30064771074 2026-02-22T19:46:40.859 INFO:teuthology.orchestra.run.trial152.stdout:30064771075 2026-02-22T19:46:40.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771075 got 30064771074 for osd.0 2026-02-22T19:46:40.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771075 for osd.1 2026-02-22T19:46:41.867 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T19:46:41.868 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T19:46:42.029 INFO:teuthology.orchestra.run.trial152.stdout:30064771075 2026-02-22T19:46:42.029 INFO:teuthology.orchestra.run.trial152.stdout:30064771077 2026-02-22T19:46:42.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771077 got 30064771077 for osd.1 2026-02-22T19:46:42.039 DEBUG:teuthology.parallel:result is None 2026-02-22T19:46:42.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771075 got 30064771075 for osd.0 2026-02-22T19:46:42.039 DEBUG:teuthology.parallel:result is None 2026-02-22T19:46:42.039 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T19:46:42.039 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:46:42.194 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:42.195 INFO:teuthology.orchestra.run.trial152.stderr:dumped all 2026-02-22T19:46:42.203 INFO:teuthology.orchestra.run.trial152.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-22T19:46:41.042232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54248,"kb_used_data":320,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689432,"statfs":{"total":193273528320,"available":193217978368,"internally_reserved":0,"allocated":327680,"data_stored":1233862,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3187,"internal_metadata":55178125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004534"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046307+0000","last_change":"2026-02-22T19:46:40.045575+0000","last_active":"2026-02-22T19:46:40.046307+0000","last_peered":"2026-02-22T19:46:40.046307+0000","last_clean":"2026-02-22T19:46:40.046307+0000","last_became_active":"2026-02-22T19:46:40.045208+0000","last_became_peered":"2026-02-22T19:46:40.045208+0000","last_unstale":"2026-02-22T19:46:40.046307+0000","last_undegraded":"2026-02-22T19:46:40.046307+0000","last_fullsized":"2026-02-22T19:46:40.046307+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:32:02.777478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046310+0000","last_change":"2026-02-22T19:46:40.045627+0000","last_active":"2026-02-22T19:46:40.046310+0000","last_peered":"2026-02-22T19:46:40.046310+0000","last_clean":"2026-02-22T19:46:40.046310+0000","last_became_active":"2026-02-22T19:46:40.045142+0000","last_became_peered":"2026-02-22T19:46:40.045142+0000","last_unstale":"2026-02-22T19:46:40.046310+0000","last_undegraded":"2026-02-22T19:46:40.046310+0000","last_fullsized":"2026-02-22T19:46:40.046310+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:44:45.204324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046293+0000","last_change":"2026-02-22T19:46:40.045537+0000","last_active":"2026-02-22T19:46:40.046293+0000","last_peered":"2026-02-22T19:46:40.046293+0000","last_clean":"2026-02-22T19:46:40.046293+0000","last_became_active":"2026-02-22T19:46:40.045084+0000","last_became_peered":"2026-02-22T19:46:40.045084+0000","last_unstale":"2026-02-22T19:46:40.046293+0000","last_undegraded":"2026-02-22T19:46:40.046293+0000","last_fullsized":"2026-02-22T19:46:40.046293+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:26:40.106684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046050+0000","last_change":"2026-02-22T19:46:40.045353+0000","last_active":"2026-02-22T19:46:40.046050+0000","last_peered":"2026-02-22T19:46:40.046050+0000","last_clean":"2026-02-22T19:46:40.046050+0000","last_became_active":"2026-02-22T19:46:40.044979+0000","last_became_peered":"2026-02-22T19:46:40.044979+0000","last_unstale":"2026-02-22T19:46:40.046050+0000","last_undegraded":"2026-02-22T19:46:40.046050+0000","last_fullsized":"2026-02-22T19:46:40.046050+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:38:28.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.045294+0000","last_change":"2026-02-22T19:46:40.044685+0000","last_active":"2026-02-22T19:46:40.045294+0000","last_peered":"2026-02-22T19:46:40.045294+0000","last_clean":"2026-02-22T19:46:40.045294+0000","last_became_active":"2026-02-22T19:46:40.044359+0000","last_became_peered":"2026-02-22T19:46:40.044359+0000","last_unstale":"2026-02-22T19:46:40.045294+0000","last_undegraded":"2026-02-22T19:46:40.045294+0000","last_fullsized":"2026-02-22T19:46:40.045294+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:58:52.543320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046322+0000","last_change":"2026-02-22T19:46:40.045600+0000","last_active":"2026-02-22T19:46:40.046322+0000","last_peered":"2026-02-22T19:46:40.046322+0000","last_clean":"2026-02-22T19:46:40.046322+0000","last_became_active":"2026-02-22T19:46:40.045092+0000","last_became_peered":"2026-02-22T19:46:40.045092+0000","last_unstale":"2026-02-22T19:46:40.046322+0000","last_undegraded":"2026-02-22T19:46:40.046322+0000","last_fullsized":"2026-02-22T19:46:40.046322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:10:21.703985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.045299+0000","last_change":"2026-02-22T19:46:40.044614+0000","last_active":"2026-02-22T19:46:40.045299+0000","last_peered":"2026-02-22T19:46:40.045299+0000","last_clean":"2026-02-22T19:46:40.045299+0000","last_became_active":"2026-02-22T19:46:40.044243+0000","last_became_peered":"2026-02-22T19:46:40.044243+0000","last_unstale":"2026-02-22T19:46:40.045299+0000","last_undegraded":"2026-02-22T19:46:40.045299+0000","last_fullsized":"2026-02-22T19:46:40.045299+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:26:45.589084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046800+0000","last_change":"2026-02-22T19:46:40.045847+0000","last_active":"2026-02-22T19:46:40.046800+0000","last_peered":"2026-02-22T19:46:40.046800+0000","last_clean":"2026-02-22T19:46:40.046800+0000","last_became_active":"2026-02-22T19:46:40.045068+0000","last_became_peered":"2026-02-22T19:46:40.045068+0000","last_unstale":"2026-02-22T19:46:40.046800+0000","last_undegraded":"2026-02-22T19:46:40.046800+0000","last_fullsized":"2026-02-22T19:46:40.046800+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:05:53.395624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"9'52","reported_seq":83,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.042036+0000","last_change":"2026-02-22T19:46:35.595934+0000","last_active":"2026-02-22T19:46:40.042036+0000","last_peered":"2026-02-22T19:46:40.042036+0000","last_clean":"2026-02-22T19:46:40.042036+0000","last_became_active":"2026-02-22T19:46:35.594773+0000","last_became_peered":"2026-02-22T19:46:35.594773+0000","last_unstale":"2026-02-22T19:46:40.042036+0000","last_undegraded":"2026-02-22T19:46:40.042036+0000","last_fullsized":"2026-02-22T19:46:40.042036+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_clean_scrub_stamp":"2026-02-22T19:46:34.026698+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:39:36.141834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771077,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":616931,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771075,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":616931,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:46:42.204 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:46:42.359 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:42.359 INFO:teuthology.orchestra.run.trial152.stderr:dumped all 2026-02-22T19:46:42.367 INFO:teuthology.orchestra.run.trial152.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-22T19:46:41.042232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54248,"kb_used_data":320,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689432,"statfs":{"total":193273528320,"available":193217978368,"internally_reserved":0,"allocated":327680,"data_stored":1233862,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3187,"internal_metadata":55178125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004534"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046307+0000","last_change":"2026-02-22T19:46:40.045575+0000","last_active":"2026-02-22T19:46:40.046307+0000","last_peered":"2026-02-22T19:46:40.046307+0000","last_clean":"2026-02-22T19:46:40.046307+0000","last_became_active":"2026-02-22T19:46:40.045208+0000","last_became_peered":"2026-02-22T19:46:40.045208+0000","last_unstale":"2026-02-22T19:46:40.046307+0000","last_undegraded":"2026-02-22T19:46:40.046307+0000","last_fullsized":"2026-02-22T19:46:40.046307+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:32:02.777478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046310+0000","last_change":"2026-02-22T19:46:40.045627+0000","last_active":"2026-02-22T19:46:40.046310+0000","last_peered":"2026-02-22T19:46:40.046310+0000","last_clean":"2026-02-22T19:46:40.046310+0000","last_became_active":"2026-02-22T19:46:40.045142+0000","last_became_peered":"2026-02-22T19:46:40.045142+0000","last_unstale":"2026-02-22T19:46:40.046310+0000","last_undegraded":"2026-02-22T19:46:40.046310+0000","last_fullsized":"2026-02-22T19:46:40.046310+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:44:45.204324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046293+0000","last_change":"2026-02-22T19:46:40.045537+0000","last_active":"2026-02-22T19:46:40.046293+0000","last_peered":"2026-02-22T19:46:40.046293+0000","last_clean":"2026-02-22T19:46:40.046293+0000","last_became_active":"2026-02-22T19:46:40.045084+0000","last_became_peered":"2026-02-22T19:46:40.045084+0000","last_unstale":"2026-02-22T19:46:40.046293+0000","last_undegraded":"2026-02-22T19:46:40.046293+0000","last_fullsized":"2026-02-22T19:46:40.046293+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:26:40.106684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046050+0000","last_change":"2026-02-22T19:46:40.045353+0000","last_active":"2026-02-22T19:46:40.046050+0000","last_peered":"2026-02-22T19:46:40.046050+0000","last_clean":"2026-02-22T19:46:40.046050+0000","last_became_active":"2026-02-22T19:46:40.044979+0000","last_became_peered":"2026-02-22T19:46:40.044979+0000","last_unstale":"2026-02-22T19:46:40.046050+0000","last_undegraded":"2026-02-22T19:46:40.046050+0000","last_fullsized":"2026-02-22T19:46:40.046050+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:38:28.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.045294+0000","last_change":"2026-02-22T19:46:40.044685+0000","last_active":"2026-02-22T19:46:40.045294+0000","last_peered":"2026-02-22T19:46:40.045294+0000","last_clean":"2026-02-22T19:46:40.045294+0000","last_became_active":"2026-02-22T19:46:40.044359+0000","last_became_peered":"2026-02-22T19:46:40.044359+0000","last_unstale":"2026-02-22T19:46:40.045294+0000","last_undegraded":"2026-02-22T19:46:40.045294+0000","last_fullsized":"2026-02-22T19:46:40.045294+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:58:52.543320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046322+0000","last_change":"2026-02-22T19:46:40.045600+0000","last_active":"2026-02-22T19:46:40.046322+0000","last_peered":"2026-02-22T19:46:40.046322+0000","last_clean":"2026-02-22T19:46:40.046322+0000","last_became_active":"2026-02-22T19:46:40.045092+0000","last_became_peered":"2026-02-22T19:46:40.045092+0000","last_unstale":"2026-02-22T19:46:40.046322+0000","last_undegraded":"2026-02-22T19:46:40.046322+0000","last_fullsized":"2026-02-22T19:46:40.046322+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:10:21.703985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.045299+0000","last_change":"2026-02-22T19:46:40.044614+0000","last_active":"2026-02-22T19:46:40.045299+0000","last_peered":"2026-02-22T19:46:40.045299+0000","last_clean":"2026-02-22T19:46:40.045299+0000","last_became_active":"2026-02-22T19:46:40.044243+0000","last_became_peered":"2026-02-22T19:46:40.044243+0000","last_unstale":"2026-02-22T19:46:40.045299+0000","last_undegraded":"2026-02-22T19:46:40.045299+0000","last_fullsized":"2026-02-22T19:46:40.045299+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:26:45.589084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.046800+0000","last_change":"2026-02-22T19:46:40.045847+0000","last_active":"2026-02-22T19:46:40.046800+0000","last_peered":"2026-02-22T19:46:40.046800+0000","last_clean":"2026-02-22T19:46:40.046800+0000","last_became_active":"2026-02-22T19:46:40.045068+0000","last_became_peered":"2026-02-22T19:46:40.045068+0000","last_unstale":"2026-02-22T19:46:40.046800+0000","last_undegraded":"2026-02-22T19:46:40.046800+0000","last_fullsized":"2026-02-22T19:46:40.046800+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:05:53.395624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"9'52","reported_seq":83,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-22T19:46:40.042036+0000","last_change":"2026-02-22T19:46:35.595934+0000","last_active":"2026-02-22T19:46:40.042036+0000","last_peered":"2026-02-22T19:46:40.042036+0000","last_clean":"2026-02-22T19:46:40.042036+0000","last_became_active":"2026-02-22T19:46:35.594773+0000","last_became_peered":"2026-02-22T19:46:35.594773+0000","last_unstale":"2026-02-22T19:46:40.042036+0000","last_undegraded":"2026-02-22T19:46:40.042036+0000","last_fullsized":"2026-02-22T19:46:40.042036+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_clean_scrub_stamp":"2026-02-22T19:46:34.026698+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:39:36.141834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771077,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":616931,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771075,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":163840,"data_stored":616931,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:46:42.367 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T19:46:42.367 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T19:46:42.367 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T19:46:42.367 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T19:46:42.540 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:46:42.540 INFO:teuthology.orchestra.run.trial152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T19:46:42.549 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T19:46:42.549 INFO:teuthology.run_tasks:Running task workunit... 2026-02-22T19:46:42.564 INFO:tasks.workunit:Pulling workunits from ref f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:46:42.565 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-22T19:46:42.565 INFO:tasks.workunit:timeout=3h 2026-02-22T19:46:42.565 INFO:tasks.workunit:cleanup=True 2026-02-22T19:46:42.565 DEBUG:teuthology.orchestra.run.trial152:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-22T19:46:42.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:46:42.581 INFO:teuthology.orchestra.run.trial152.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-22T19:46:42.581 DEBUG:teuthology.orchestra.run.trial152:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T19:46:42.637 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-22T19:46:42.637 DEBUG:teuthology.orchestra.run.trial152:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-22T19:46:42.693 DEBUG:teuthology.orchestra.run.trial152:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T19:46:42.756 INFO:tasks.workunit.client.0.trial152.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-22T19:47:03.242 INFO:tasks.workunit.client.0.trial152.stderr:Note: switching to 'f90f4eaebb28b619cf76e80cbbe997656da69579'. 2026-02-22T19:47:03.242 INFO:tasks.workunit.client.0.trial152.stderr: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:state without impacting any branches by switching back to a branch. 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: git switch -c 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:Or undo this operation with: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: git switch - 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr: 2026-02-22T19:47:03.243 INFO:tasks.workunit.client.0.trial152.stderr:HEAD is now at f90f4eaebb2 Merge branch 'wip-74712-squid' of https://github.com/idryomov/ceph into wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T19:47:03.249 DEBUG:teuthology.orchestra.run.trial152:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-22T19:47:03.306 INFO:tasks.workunit.client.0.trial152.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-22T19:47:03.308 INFO:tasks.workunit.client.0.trial152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T19:47:03.308 INFO:tasks.workunit.client.0.trial152.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-22T19:47:03.396 INFO:tasks.workunit.client.0.trial152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-22T19:47:03.426 INFO:tasks.workunit.client.0.trial152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-22T19:47:03.450 INFO:tasks.workunit.client.0.trial152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T19:47:03.451 INFO:tasks.workunit.client.0.trial152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T19:47:03.452 INFO:tasks.workunit.client.0.trial152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-22T19:47:03.475 INFO:tasks.workunit.client.0.trial152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T19:47:03.478 DEBUG:teuthology.orchestra.run.trial152:> set -ex 2026-02-22T19:47:03.479 DEBUG:teuthology.orchestra.run.trial152:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-22T19:47:03.536 INFO:tasks.workunit:Running workunits matching mon/rbd_snaps_ops.sh on client.0... 2026-02-22T19:47:03.538 INFO:tasks.workunit:Running workunit mon/rbd_snaps_ops.sh... 2026-02-22T19:47:03.538 DEBUG:teuthology.orchestra.run.trial152:workunit test mon/rbd_snaps_ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f90f4eaebb28b619cf76e80cbbe997656da69579 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/rbd_snaps_ops.sh 2026-02-22T19:47:03.779 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test' does not exist 2026-02-22T19:47:03.785 INFO:tasks.workunit.client.0.trial152.stdout:[1] ceph osd pool create test 8 8 2026-02-22T19:47:04.108 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test' already exists 2026-02-22T19:47:04.115 INFO:tasks.workunit.client.0.trial152.stdout:[2] ceph osd pool application enable test rbd 2026-02-22T19:47:06.061 INFO:tasks.workunit.client.0.trial152.stderr:enabled application 'rbd' on pool 'test' 2026-02-22T19:47:06.072 INFO:tasks.workunit.client.0.trial152.stdout:[3] ceph osd pool mksnap test snapshot 2026-02-22T19:47:07.113 INFO:tasks.workunit.client.0.trial152.stderr:pool test snap snapshot already exists 2026-02-22T19:47:07.120 INFO:tasks.workunit.client.0.trial152.stdout:[4] ceph osd pool rmsnap test snapshot 2026-02-22T19:47:08.116 INFO:tasks.workunit.client.0.trial152.stderr:pool test snap snapshot does not exist 2026-02-22T19:47:08.124 INFO:tasks.workunit.client.0.trial152.stdout:[5] rbd --pool=test --rbd_validate_pool=false create --size=102400 image 2026-02-22T19:47:08.153 INFO:tasks.workunit.client.0.trial152.stdout:[6] rbd --pool=test snap create image@snapshot 2026-02-22T19:47:08.180 INFO:tasks.workunit.client.0.trial152.stderr: Creating snap: 10% complete...2026-02-22T19:47:08.177+0000 7fa9ad972640 -1 librbd::SnapshotCreateRequest: failed to allocate snapshot id: (22) Invalid argument 2026-02-22T19:47:08.180 INFO:tasks.workunit.client.0.trial152.stderr: Creating snap: 10% complete...failed. 2026-02-22T19:47:08.180 INFO:tasks.workunit.client.0.trial152.stderr:rbd: failed to create snapshot: (22) Invalid argument 2026-02-22T19:47:08.184 INFO:tasks.workunit.client.0.trial152.stdout:[7] ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-22T19:47:09.123 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test' does not exist 2026-02-22T19:47:09.131 INFO:tasks.workunit.client.0.trial152.stdout:[8] ceph osd pool create test 8 8 2026-02-22T19:47:10.123 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test' already exists 2026-02-22T19:47:10.131 INFO:tasks.workunit.client.0.trial152.stdout:[9] rbd --pool=test pool init 2026-02-22T19:47:11.087 INFO:tasks.workunit.client.0.trial152.stdout:[10] rbd --pool=test create --size=102400 image 2026-02-22T19:47:11.114 INFO:tasks.workunit.client.0.trial152.stdout:[11] rbd --pool=test snap create image@snapshot 2026-02-22T19:47:12.084 INFO:tasks.workunit.client.0.trial152.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2026-02-22T19:47:12.089 INFO:tasks.workunit.client.0.trial152.stdout:[12] rbd --pool=test snap ls image 2026-02-22T19:47:12.112 INFO:tasks.workunit.client.0.trial152.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP 2026-02-22T19:47:12.113 INFO:tasks.workunit.client.0.trial152.stdout: 2 snapshot 100 GiB Sun Feb 22 19:47:12 2026 2026-02-22T19:47:12.114 INFO:tasks.workunit.client.0.trial152.stdout:[13] rbd --pool=test snap rm image@snapshot 2026-02-22T19:47:13.084 INFO:tasks.workunit.client.0.trial152.stderr: Removing snap: 100% complete...done. 2026-02-22T19:47:13.089 INFO:tasks.workunit.client.0.trial152.stdout:[14] ceph osd pool mksnap test snapshot 2026-02-22T19:47:13.224 INFO:tasks.workunit.client.0.trial152.stderr:Error EINVAL: pool test is in unmanaged snaps mode 2026-02-22T19:47:13.227 INFO:tasks.workunit.client.0.trial152.stdout:[15] rados -p test mksnap snapshot 2026-02-22T19:47:13.246 INFO:tasks.workunit.client.0.trial152.stderr:can't create snapshot: pool test is in selfmanaged snaps mode 2026-02-22T19:47:13.247 INFO:tasks.workunit.client.0.trial152.stdout:[16] ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-22T19:47:14.131 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test' does not exist 2026-02-22T19:47:14.318 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test-foo' does not exist 2026-02-22T19:47:14.325 INFO:tasks.workunit.client.0.trial152.stdout:[17] ceph osd pool create test-foo 8 2026-02-22T19:47:15.135 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test-foo' already exists 2026-02-22T19:47:15.142 INFO:tasks.workunit.client.0.trial152.stdout:[18] ceph osd pool application enable test-foo rbd 2026-02-22T19:47:17.090 INFO:tasks.workunit.client.0.trial152.stderr:enabled application 'rbd' on pool 'test-foo' 2026-02-22T19:47:17.099 INFO:tasks.workunit.client.0.trial152.stdout:[19] rbd --pool test-foo create --size 1024 image 2026-02-22T19:47:17.128 INFO:tasks.workunit.client.0.trial152.stdout:[20] rbd --pool test-foo snap create image@snapshot 2026-02-22T19:47:18.099 INFO:tasks.workunit.client.0.trial152.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2026-02-22T19:47:18.286 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test-bar' does not exist 2026-02-22T19:47:18.292 INFO:tasks.workunit.client.0.trial152.stdout:[21] ceph osd pool create test-bar 8 2026-02-22T19:47:19.144 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test-bar' already exists 2026-02-22T19:47:19.151 INFO:tasks.workunit.client.0.trial152.stdout:[22] ceph osd pool application enable test-bar rbd 2026-02-22T19:47:21.099 INFO:tasks.workunit.client.0.trial152.stderr:enabled application 'rbd' on pool 'test-bar' 2026-02-22T19:47:21.111 INFO:tasks.workunit.client.0.trial152.stdout:[23] rados cppool test-foo test-bar 2026-02-22T19:47:21.129 INFO:tasks.workunit.client.0.trial152.stderr:WARNING: pool copy does not preserve user_version, which some apps may rely on. 2026-02-22T19:47:21.130 INFO:tasks.workunit.client.0.trial152.stderr:WARNING: pool test-foo has selfmanaged snaps, which are not preserved 2026-02-22T19:47:21.130 INFO:tasks.workunit.client.0.trial152.stderr: by the cppool operation. This will break any snapshot user. 2026-02-22T19:47:21.130 INFO:tasks.workunit.client.0.trial152.stderr: If you insist on making a broken copy, you can pass 2026-02-22T19:47:21.130 INFO:tasks.workunit.client.0.trial152.stderr: --yes-i-really-mean-it to proceed anyway. 2026-02-22T19:47:21.131 INFO:tasks.workunit.client.0.trial152.stdout:[24] rados cppool test-foo test-bar --yes-i-really-mean-it 2026-02-22T19:47:21.147 INFO:tasks.workunit.client.0.trial152.stderr:WARNING: pool copy does not preserve user_version, which some apps may rely on. 2026-02-22T19:47:21.148 INFO:tasks.workunit.client.0.trial152.stderr:WARNING: pool test-foo has selfmanaged snaps, which are not preserved 2026-02-22T19:47:21.148 INFO:tasks.workunit.client.0.trial152.stderr: by the cppool operation. This will break any snapshot user. 2026-02-22T19:47:21.151 INFO:tasks.workunit.client.0.trial152.stdout:test-foo:rbd_id.image => test-bar:rbd_id.image 2026-02-22T19:47:21.152 INFO:tasks.workunit.client.0.trial152.stdout:test-foo:rbd_directory => test-bar:rbd_directory 2026-02-22T19:47:21.153 INFO:tasks.workunit.client.0.trial152.stdout:test-foo:rbd_object_map.10915730779d.0000000000000002 => test-bar:rbd_object_map.10915730779d.0000000000000002 2026-02-22T19:47:21.154 INFO:tasks.workunit.client.0.trial152.stdout:test-foo:rbd_object_map.10915730779d => test-bar:rbd_object_map.10915730779d 2026-02-22T19:47:21.155 INFO:tasks.workunit.client.0.trial152.stdout:test-foo:rbd_header.10915730779d => test-bar:rbd_header.10915730779d 2026-02-22T19:47:21.156 INFO:tasks.workunit.client.0.trial152.stdout:successfully copied pool test-foo 2026-02-22T19:47:21.157 INFO:tasks.workunit.client.0.trial152.stdout:[25] rbd --pool test-bar snap rm image@snapshot 2026-02-22T19:47:21.187 INFO:tasks.workunit.client.0.trial152.stderr:2026-02-22T19:47:21.185+0000 7fc86de1b640 -1 librbd::SnapshotRemoveRequest: 0x7fc84c0098e0 handle_release_snap_id: failed to release snap id: (95) Operation not supported 2026-02-22T19:47:21.187 INFO:tasks.workunit.client.0.trial152.stderr: Removing snap: 0% complete...failed. 2026-02-22T19:47:21.187 INFO:tasks.workunit.client.0.trial152.stderr:rbd: failed to remove snapshot: 2026-02-22T19:47:21.185+0000 7fc86de1b640 -1 librbd::SnapshotRemoveRequest: 0x7fc84c0098e0 should_complete: encountered error: (95) Operation not supported 2026-02-22T19:47:21.187 INFO:tasks.workunit.client.0.trial152.stderr:(95) Operation not supported 2026-02-22T19:47:21.190 INFO:tasks.workunit.client.0.trial152.stdout:[26] ceph osd pool delete test-foo test-foo --yes-i-really-really-mean-it 2026-02-22T19:47:22.153 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test-foo' does not exist 2026-02-22T19:47:22.160 INFO:tasks.workunit.client.0.trial152.stdout:[27] ceph osd pool delete test-bar test-bar --yes-i-really-really-mean-it 2026-02-22T19:47:23.154 INFO:tasks.workunit.client.0.trial152.stderr:pool 'test-bar' does not exist 2026-02-22T19:47:23.163 INFO:tasks.workunit.client.0.trial152.stdout:OK 2026-02-22T19:47:23.163 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-22T19:47:23.163 DEBUG:teuthology.orchestra.run.trial152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-22T19:47:23.188 INFO:tasks.workunit:Stopping ['mon/rbd_snaps_ops.sh'] on client.0... 2026-02-22T19:47:23.188 DEBUG:teuthology.orchestra.run.trial152:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-22T19:47:23.495 DEBUG:teuthology.parallel:result is None 2026-02-22T19:47:23.495 DEBUG:teuthology.orchestra.run.trial152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T19:47:23.519 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T19:47:23.519 DEBUG:teuthology.orchestra.run.trial152:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T19:47:23.574 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T19:47:23.574 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T19:47:23.585 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T19:47:23.585 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:47:23.770 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:47:23.770 INFO:teuthology.orchestra.run.trial152.stderr:dumped all 2026-02-22T19:47:23.778 INFO:teuthology.orchestra.run.trial152.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2026-02-22T19:47:23.104281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54600,"kb_used_data":664,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689080,"statfs":{"total":193273528320,"available":193217617920,"internally_reserved":0,"allocated":679936,"data_stored":1363040,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3187,"internal_metadata":55178125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-38,"num_read_kb":-26,"num_write":-7,"num_write_kb":-5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010364"},"pg_stats":[{"pgid":"1.0","version":"9'52","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.092963+0000","last_change":"2026-02-22T19:46:35.595934+0000","last_active":"2026-02-22T19:47:18.092963+0000","last_peered":"2026-02-22T19:47:18.092963+0000","last_clean":"2026-02-22T19:47:18.092963+0000","last_became_active":"2026-02-22T19:46:35.594773+0000","last_became_peered":"2026-02-22T19:46:35.594773+0000","last_unstale":"2026-02-22T19:47:18.092963+0000","last_undegraded":"2026-02-22T19:47:18.092963+0000","last_fullsized":"2026-02-22T19:47:18.092963+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_clean_scrub_stamp":"2026-02-22T19:46:34.026698+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:39:36.141834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093132+0000","last_change":"2026-02-22T19:46:40.045847+0000","last_active":"2026-02-22T19:47:18.093132+0000","last_peered":"2026-02-22T19:47:18.093132+0000","last_clean":"2026-02-22T19:47:18.093132+0000","last_became_active":"2026-02-22T19:46:40.045068+0000","last_became_peered":"2026-02-22T19:46:40.045068+0000","last_unstale":"2026-02-22T19:47:18.093132+0000","last_undegraded":"2026-02-22T19:47:18.093132+0000","last_fullsized":"2026-02-22T19:47:18.093132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:22:36.343182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102959+0000","last_change":"2026-02-22T19:46:40.044614+0000","last_active":"2026-02-22T19:47:22.102959+0000","last_peered":"2026-02-22T19:47:22.102959+0000","last_clean":"2026-02-22T19:47:22.102959+0000","last_became_active":"2026-02-22T19:46:40.044243+0000","last_became_peered":"2026-02-22T19:46:40.044243+0000","last_unstale":"2026-02-22T19:47:22.102959+0000","last_undegraded":"2026-02-22T19:47:22.102959+0000","last_fullsized":"2026-02-22T19:47:22.102959+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T20:05:42.762172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.092941+0000","last_change":"2026-02-22T19:46:40.045600+0000","last_active":"2026-02-22T19:47:18.092941+0000","last_peered":"2026-02-22T19:47:18.092941+0000","last_clean":"2026-02-22T19:47:18.092941+0000","last_became_active":"2026-02-22T19:46:40.045092+0000","last_became_peered":"2026-02-22T19:46:40.045092+0000","last_unstale":"2026-02-22T19:47:18.092941+0000","last_undegraded":"2026-02-22T19:47:18.092941+0000","last_fullsized":"2026-02-22T19:47:18.092941+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:02:24.028686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102855+0000","last_change":"2026-02-22T19:46:40.044685+0000","last_active":"2026-02-22T19:47:22.102855+0000","last_peered":"2026-02-22T19:47:22.102855+0000","last_clean":"2026-02-22T19:47:22.102855+0000","last_became_active":"2026-02-22T19:46:40.044359+0000","last_became_peered":"2026-02-22T19:46:40.044359+0000","last_unstale":"2026-02-22T19:47:22.102855+0000","last_undegraded":"2026-02-22T19:47:22.102855+0000","last_fullsized":"2026-02-22T19:47:22.102855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:59:05.107461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093129+0000","last_change":"2026-02-22T19:46:40.045353+0000","last_active":"2026-02-22T19:47:18.093129+0000","last_peered":"2026-02-22T19:47:18.093129+0000","last_clean":"2026-02-22T19:47:18.093129+0000","last_became_active":"2026-02-22T19:46:40.044979+0000","last_became_peered":"2026-02-22T19:46:40.044979+0000","last_unstale":"2026-02-22T19:47:18.093129+0000","last_undegraded":"2026-02-22T19:47:18.093129+0000","last_fullsized":"2026-02-22T19:47:18.093129+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:14:59.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093209+0000","last_change":"2026-02-22T19:46:40.045537+0000","last_active":"2026-02-22T19:47:18.093209+0000","last_peered":"2026-02-22T19:47:18.093209+0000","last_clean":"2026-02-22T19:47:18.093209+0000","last_became_active":"2026-02-22T19:46:40.045084+0000","last_became_peered":"2026-02-22T19:46:40.045084+0000","last_unstale":"2026-02-22T19:47:18.093209+0000","last_undegraded":"2026-02-22T19:47:18.093209+0000","last_fullsized":"2026-02-22T19:47:18.093209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:16.512102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093311+0000","last_change":"2026-02-22T19:46:40.045627+0000","last_active":"2026-02-22T19:47:18.093311+0000","last_peered":"2026-02-22T19:47:18.093311+0000","last_clean":"2026-02-22T19:47:18.093311+0000","last_became_active":"2026-02-22T19:46:40.045142+0000","last_became_peered":"2026-02-22T19:46:40.045142+0000","last_unstale":"2026-02-22T19:47:18.093311+0000","last_undegraded":"2026-02-22T19:47:18.093311+0000","last_fullsized":"2026-02-22T19:47:18.093311+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:39:15.014168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093376+0000","last_change":"2026-02-22T19:46:40.045575+0000","last_active":"2026-02-22T19:47:18.093376+0000","last_peered":"2026-02-22T19:47:18.093376+0000","last_clean":"2026-02-22T19:47:18.093376+0000","last_became_active":"2026-02-22T19:46:40.045208+0000","last_became_peered":"2026-02-22T19:46:40.045208+0000","last_unstale":"2026-02-22T19:47:18.093376+0000","last_undegraded":"2026-02-22T19:47:18.093376+0000","last_fullsized":"2026-02-22T19:47:18.093376+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:15:16.546777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771085,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":323584,"data_stored":674085,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771084,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":688955,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:47:23.779 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:47:23.937 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:47:23.937 INFO:teuthology.orchestra.run.trial152.stderr:dumped all 2026-02-22T19:47:23.945 INFO:teuthology.orchestra.run.trial152.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2026-02-22T19:47:23.104281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54600,"kb_used_data":664,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689080,"statfs":{"total":193273528320,"available":193217617920,"internally_reserved":0,"allocated":679936,"data_stored":1363040,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3187,"internal_metadata":55178125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-38,"num_read_kb":-26,"num_write":-7,"num_write_kb":-5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010364"},"pg_stats":[{"pgid":"1.0","version":"9'52","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.092963+0000","last_change":"2026-02-22T19:46:35.595934+0000","last_active":"2026-02-22T19:47:18.092963+0000","last_peered":"2026-02-22T19:47:18.092963+0000","last_clean":"2026-02-22T19:47:18.092963+0000","last_became_active":"2026-02-22T19:46:35.594773+0000","last_became_peered":"2026-02-22T19:46:35.594773+0000","last_unstale":"2026-02-22T19:47:18.092963+0000","last_undegraded":"2026-02-22T19:47:18.092963+0000","last_fullsized":"2026-02-22T19:47:18.092963+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_clean_scrub_stamp":"2026-02-22T19:46:34.026698+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:39:36.141834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093132+0000","last_change":"2026-02-22T19:46:40.045847+0000","last_active":"2026-02-22T19:47:18.093132+0000","last_peered":"2026-02-22T19:47:18.093132+0000","last_clean":"2026-02-22T19:47:18.093132+0000","last_became_active":"2026-02-22T19:46:40.045068+0000","last_became_peered":"2026-02-22T19:46:40.045068+0000","last_unstale":"2026-02-22T19:47:18.093132+0000","last_undegraded":"2026-02-22T19:47:18.093132+0000","last_fullsized":"2026-02-22T19:47:18.093132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:22:36.343182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102959+0000","last_change":"2026-02-22T19:46:40.044614+0000","last_active":"2026-02-22T19:47:22.102959+0000","last_peered":"2026-02-22T19:47:22.102959+0000","last_clean":"2026-02-22T19:47:22.102959+0000","last_became_active":"2026-02-22T19:46:40.044243+0000","last_became_peered":"2026-02-22T19:46:40.044243+0000","last_unstale":"2026-02-22T19:47:22.102959+0000","last_undegraded":"2026-02-22T19:47:22.102959+0000","last_fullsized":"2026-02-22T19:47:22.102959+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T20:05:42.762172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.092941+0000","last_change":"2026-02-22T19:46:40.045600+0000","last_active":"2026-02-22T19:47:18.092941+0000","last_peered":"2026-02-22T19:47:18.092941+0000","last_clean":"2026-02-22T19:47:18.092941+0000","last_became_active":"2026-02-22T19:46:40.045092+0000","last_became_peered":"2026-02-22T19:46:40.045092+0000","last_unstale":"2026-02-22T19:47:18.092941+0000","last_undegraded":"2026-02-22T19:47:18.092941+0000","last_fullsized":"2026-02-22T19:47:18.092941+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:02:24.028686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102855+0000","last_change":"2026-02-22T19:46:40.044685+0000","last_active":"2026-02-22T19:47:22.102855+0000","last_peered":"2026-02-22T19:47:22.102855+0000","last_clean":"2026-02-22T19:47:22.102855+0000","last_became_active":"2026-02-22T19:46:40.044359+0000","last_became_peered":"2026-02-22T19:46:40.044359+0000","last_unstale":"2026-02-22T19:47:22.102855+0000","last_undegraded":"2026-02-22T19:47:22.102855+0000","last_fullsized":"2026-02-22T19:47:22.102855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:59:05.107461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093129+0000","last_change":"2026-02-22T19:46:40.045353+0000","last_active":"2026-02-22T19:47:18.093129+0000","last_peered":"2026-02-22T19:47:18.093129+0000","last_clean":"2026-02-22T19:47:18.093129+0000","last_became_active":"2026-02-22T19:46:40.044979+0000","last_became_peered":"2026-02-22T19:46:40.044979+0000","last_unstale":"2026-02-22T19:47:18.093129+0000","last_undegraded":"2026-02-22T19:47:18.093129+0000","last_fullsized":"2026-02-22T19:47:18.093129+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:14:59.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093209+0000","last_change":"2026-02-22T19:46:40.045537+0000","last_active":"2026-02-22T19:47:18.093209+0000","last_peered":"2026-02-22T19:47:18.093209+0000","last_clean":"2026-02-22T19:47:18.093209+0000","last_became_active":"2026-02-22T19:46:40.045084+0000","last_became_peered":"2026-02-22T19:46:40.045084+0000","last_unstale":"2026-02-22T19:47:18.093209+0000","last_undegraded":"2026-02-22T19:47:18.093209+0000","last_fullsized":"2026-02-22T19:47:18.093209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:16.512102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093311+0000","last_change":"2026-02-22T19:46:40.045627+0000","last_active":"2026-02-22T19:47:18.093311+0000","last_peered":"2026-02-22T19:47:18.093311+0000","last_clean":"2026-02-22T19:47:18.093311+0000","last_became_active":"2026-02-22T19:46:40.045142+0000","last_became_peered":"2026-02-22T19:46:40.045142+0000","last_unstale":"2026-02-22T19:47:18.093311+0000","last_undegraded":"2026-02-22T19:47:18.093311+0000","last_fullsized":"2026-02-22T19:47:18.093311+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:39:15.014168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093376+0000","last_change":"2026-02-22T19:46:40.045575+0000","last_active":"2026-02-22T19:47:18.093376+0000","last_peered":"2026-02-22T19:47:18.093376+0000","last_clean":"2026-02-22T19:47:18.093376+0000","last_became_active":"2026-02-22T19:46:40.045208+0000","last_became_peered":"2026-02-22T19:46:40.045208+0000","last_unstale":"2026-02-22T19:47:18.093376+0000","last_undegraded":"2026-02-22T19:47:18.093376+0000","last_fullsized":"2026-02-22T19:47:18.093376+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:15:16.546777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771085,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":323584,"data_stored":674085,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771084,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":688955,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:47:23.946 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T19:47:23.947 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:47:24.103 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:47:24.103 INFO:teuthology.orchestra.run.trial152.stderr:dumped all 2026-02-22T19:47:24.112 INFO:teuthology.orchestra.run.trial152.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2026-02-22T19:47:23.104281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54600,"kb_used_data":664,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689080,"statfs":{"total":193273528320,"available":193217617920,"internally_reserved":0,"allocated":679936,"data_stored":1363040,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3187,"internal_metadata":55178125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-38,"num_read_kb":-26,"num_write":-7,"num_write_kb":-5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010364"},"pg_stats":[{"pgid":"1.0","version":"9'52","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.092963+0000","last_change":"2026-02-22T19:46:35.595934+0000","last_active":"2026-02-22T19:47:18.092963+0000","last_peered":"2026-02-22T19:47:18.092963+0000","last_clean":"2026-02-22T19:47:18.092963+0000","last_became_active":"2026-02-22T19:46:35.594773+0000","last_became_peered":"2026-02-22T19:46:35.594773+0000","last_unstale":"2026-02-22T19:47:18.092963+0000","last_undegraded":"2026-02-22T19:47:18.092963+0000","last_fullsized":"2026-02-22T19:47:18.092963+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_clean_scrub_stamp":"2026-02-22T19:46:34.026698+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:39:36.141834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093132+0000","last_change":"2026-02-22T19:46:40.045847+0000","last_active":"2026-02-22T19:47:18.093132+0000","last_peered":"2026-02-22T19:47:18.093132+0000","last_clean":"2026-02-22T19:47:18.093132+0000","last_became_active":"2026-02-22T19:46:40.045068+0000","last_became_peered":"2026-02-22T19:46:40.045068+0000","last_unstale":"2026-02-22T19:47:18.093132+0000","last_undegraded":"2026-02-22T19:47:18.093132+0000","last_fullsized":"2026-02-22T19:47:18.093132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:22:36.343182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102959+0000","last_change":"2026-02-22T19:46:40.044614+0000","last_active":"2026-02-22T19:47:22.102959+0000","last_peered":"2026-02-22T19:47:22.102959+0000","last_clean":"2026-02-22T19:47:22.102959+0000","last_became_active":"2026-02-22T19:46:40.044243+0000","last_became_peered":"2026-02-22T19:46:40.044243+0000","last_unstale":"2026-02-22T19:47:22.102959+0000","last_undegraded":"2026-02-22T19:47:22.102959+0000","last_fullsized":"2026-02-22T19:47:22.102959+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T20:05:42.762172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.092941+0000","last_change":"2026-02-22T19:46:40.045600+0000","last_active":"2026-02-22T19:47:18.092941+0000","last_peered":"2026-02-22T19:47:18.092941+0000","last_clean":"2026-02-22T19:47:18.092941+0000","last_became_active":"2026-02-22T19:46:40.045092+0000","last_became_peered":"2026-02-22T19:46:40.045092+0000","last_unstale":"2026-02-22T19:47:18.092941+0000","last_undegraded":"2026-02-22T19:47:18.092941+0000","last_fullsized":"2026-02-22T19:47:18.092941+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:02:24.028686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102855+0000","last_change":"2026-02-22T19:46:40.044685+0000","last_active":"2026-02-22T19:47:22.102855+0000","last_peered":"2026-02-22T19:47:22.102855+0000","last_clean":"2026-02-22T19:47:22.102855+0000","last_became_active":"2026-02-22T19:46:40.044359+0000","last_became_peered":"2026-02-22T19:46:40.044359+0000","last_unstale":"2026-02-22T19:47:22.102855+0000","last_undegraded":"2026-02-22T19:47:22.102855+0000","last_fullsized":"2026-02-22T19:47:22.102855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:59:05.107461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093129+0000","last_change":"2026-02-22T19:46:40.045353+0000","last_active":"2026-02-22T19:47:18.093129+0000","last_peered":"2026-02-22T19:47:18.093129+0000","last_clean":"2026-02-22T19:47:18.093129+0000","last_became_active":"2026-02-22T19:46:40.044979+0000","last_became_peered":"2026-02-22T19:46:40.044979+0000","last_unstale":"2026-02-22T19:47:18.093129+0000","last_undegraded":"2026-02-22T19:47:18.093129+0000","last_fullsized":"2026-02-22T19:47:18.093129+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:14:59.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093209+0000","last_change":"2026-02-22T19:46:40.045537+0000","last_active":"2026-02-22T19:47:18.093209+0000","last_peered":"2026-02-22T19:47:18.093209+0000","last_clean":"2026-02-22T19:47:18.093209+0000","last_became_active":"2026-02-22T19:46:40.045084+0000","last_became_peered":"2026-02-22T19:46:40.045084+0000","last_unstale":"2026-02-22T19:47:18.093209+0000","last_undegraded":"2026-02-22T19:47:18.093209+0000","last_fullsized":"2026-02-22T19:47:18.093209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:16.512102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093311+0000","last_change":"2026-02-22T19:46:40.045627+0000","last_active":"2026-02-22T19:47:18.093311+0000","last_peered":"2026-02-22T19:47:18.093311+0000","last_clean":"2026-02-22T19:47:18.093311+0000","last_became_active":"2026-02-22T19:46:40.045142+0000","last_became_peered":"2026-02-22T19:46:40.045142+0000","last_unstale":"2026-02-22T19:47:18.093311+0000","last_undegraded":"2026-02-22T19:47:18.093311+0000","last_fullsized":"2026-02-22T19:47:18.093311+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:39:15.014168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T19:47:18.093376+0000","last_change":"2026-02-22T19:46:40.045575+0000","last_active":"2026-02-22T19:47:18.093376+0000","last_peered":"2026-02-22T19:47:18.093376+0000","last_clean":"2026-02-22T19:47:18.093376+0000","last_became_active":"2026-02-22T19:46:40.045208+0000","last_became_peered":"2026-02-22T19:46:40.045208+0000","last_unstale":"2026-02-22T19:47:18.093376+0000","last_undegraded":"2026-02-22T19:47:18.093376+0000","last_fullsized":"2026-02-22T19:47:18.093376+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:15:16.546777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771085,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":323584,"data_stored":674085,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771084,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":688955,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:47:24.113 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T19:47:24.272 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:47:24.273 INFO:teuthology.orchestra.run.trial152.stdout:{"epoch":34,"fsid":"e1b06997-d835-4966-9333-0c5096f1f21b","created":"2026-02-22T19:46:24.691210+0000","modified":"2026-02-22T19:47:23.101527+0000","last_up_change":"2026-02-22T19:46:33.024691+0000","last_in_change":"2026-02-22T19:46:25.084322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T19:46:33.030808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T19:46:38.384838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55b13ce7-3562-42d7-ac00-55da2087cde8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6800","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6801","nonce":483603205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6802","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6803","nonce":483603205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6806","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6807","nonce":483603205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6804","nonce":483603205},{"type":"v1","addr":"10.20.193.152:6805","nonce":483603205}]},"public_addr":"10.20.193.152:6801/483603205","cluster_addr":"10.20.193.152:6803/483603205","heartbeat_back_addr":"10.20.193.152:6807/483603205","heartbeat_front_addr":"10.20.193.152:6805/483603205","state":["exists","up"]},{"osd":1,"uuid":"55e8606a-e930-4da4-97d6-a311296d2e0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6808","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6809","nonce":3473158730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6810","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6811","nonce":3473158730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6814","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6815","nonce":3473158730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.152:6812","nonce":3473158730},{"type":"v1","addr":"10.20.193.152:6813","nonce":3473158730}]},"public_addr":"10.20.193.152:6809/3473158730","cluster_addr":"10.20.193.152:6811/3473158730","heartbeat_back_addr":"10.20.193.152:6815/3473158730","heartbeat_front_addr":"10.20.193.152:6813/3473158730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:46:31.588126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T19:46:31.552830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":1,"length":1}]},{"pool":4,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T19:47:25.282 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T19:47:25.282 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T19:47:25.363 INFO:teuthology.orchestra.run.trial152.stdout:{ 2026-02-22T19:47:25.363 INFO:teuthology.orchestra.run.trial152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T19:47:25.363 INFO:teuthology.orchestra.run.trial152.stdout:} 2026-02-22T19:47:25.369 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T19:47:25.524 INFO:teuthology.orchestra.run.trial152.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T19:47:25.532 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T19:47:25.532 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T19:47:25.612 INFO:teuthology.orchestra.run.trial152.stdout:{ 2026-02-22T19:47:25.613 INFO:teuthology.orchestra.run.trial152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T19:47:25.613 INFO:teuthology.orchestra.run.trial152.stdout:} 2026-02-22T19:47:25.618 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T19:47:25.774 INFO:teuthology.orchestra.run.trial152.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T19:47:25.782 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:47:25.939 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:47:25.940 INFO:teuthology.orchestra.run.trial152.stderr:dumped all 2026-02-22T19:47:25.948 INFO:teuthology.orchestra.run.trial152.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2026-02-22T19:47:25.024109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54632,"kb_used_data":700,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689048,"statfs":{"total":193273528320,"available":193217585152,"internally_reserved":0,"allocated":716800,"data_stored":1380924,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3187,"internal_metadata":55178125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-212,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-38,"num_read_kb":-26,"num_write":-7,"num_write_kb":-5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929310"},"pg_stats":[{"pgid":"1.0","version":"9'52","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:23.105639+0000","last_change":"2026-02-22T19:46:35.595934+0000","last_active":"2026-02-22T19:47:23.105639+0000","last_peered":"2026-02-22T19:47:23.105639+0000","last_clean":"2026-02-22T19:47:23.105639+0000","last_became_active":"2026-02-22T19:46:35.594773+0000","last_became_peered":"2026-02-22T19:46:35.594773+0000","last_unstale":"2026-02-22T19:47:23.105639+0000","last_undegraded":"2026-02-22T19:47:23.105639+0000","last_fullsized":"2026-02-22T19:47:23.105639+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:34.026698+0000","last_clean_scrub_stamp":"2026-02-22T19:46:34.026698+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:39:36.141834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:23.105720+0000","last_change":"2026-02-22T19:46:40.045847+0000","last_active":"2026-02-22T19:47:23.105720+0000","last_peered":"2026-02-22T19:47:23.105720+0000","last_clean":"2026-02-22T19:47:23.105720+0000","last_became_active":"2026-02-22T19:46:40.045068+0000","last_became_peered":"2026-02-22T19:46:40.045068+0000","last_unstale":"2026-02-22T19:47:23.105720+0000","last_undegraded":"2026-02-22T19:47:23.105720+0000","last_fullsized":"2026-02-22T19:47:23.105720+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:22:36.343182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102959+0000","last_change":"2026-02-22T19:46:40.044614+0000","last_active":"2026-02-22T19:47:22.102959+0000","last_peered":"2026-02-22T19:47:22.102959+0000","last_clean":"2026-02-22T19:47:22.102959+0000","last_became_active":"2026-02-22T19:46:40.044243+0000","last_became_peered":"2026-02-22T19:46:40.044243+0000","last_unstale":"2026-02-22T19:47:22.102959+0000","last_undegraded":"2026-02-22T19:47:22.102959+0000","last_fullsized":"2026-02-22T19:47:22.102959+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T20:05:42.762172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:23.105676+0000","last_change":"2026-02-22T19:46:40.045600+0000","last_active":"2026-02-22T19:47:23.105676+0000","last_peered":"2026-02-22T19:47:23.105676+0000","last_clean":"2026-02-22T19:47:23.105676+0000","last_became_active":"2026-02-22T19:46:40.045092+0000","last_became_peered":"2026-02-22T19:46:40.045092+0000","last_unstale":"2026-02-22T19:47:23.105676+0000","last_undegraded":"2026-02-22T19:47:23.105676+0000","last_fullsized":"2026-02-22T19:47:23.105676+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:02:24.028686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T19:47:22.102855+0000","last_change":"2026-02-22T19:46:40.044685+0000","last_active":"2026-02-22T19:47:22.102855+0000","last_peered":"2026-02-22T19:47:22.102855+0000","last_clean":"2026-02-22T19:47:22.102855+0000","last_became_active":"2026-02-22T19:46:40.044359+0000","last_became_peered":"2026-02-22T19:46:40.044359+0000","last_unstale":"2026-02-22T19:47:22.102855+0000","last_undegraded":"2026-02-22T19:47:22.102855+0000","last_fullsized":"2026-02-22T19:47:22.102855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:59:05.107461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:23.105808+0000","last_change":"2026-02-22T19:46:40.045353+0000","last_active":"2026-02-22T19:47:23.105808+0000","last_peered":"2026-02-22T19:47:23.105808+0000","last_clean":"2026-02-22T19:47:23.105808+0000","last_became_active":"2026-02-22T19:46:40.044979+0000","last_became_peered":"2026-02-22T19:46:40.044979+0000","last_unstale":"2026-02-22T19:47:23.105808+0000","last_undegraded":"2026-02-22T19:47:23.105808+0000","last_fullsized":"2026-02-22T19:47:23.105808+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:14:59.768232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:23.105944+0000","last_change":"2026-02-22T19:46:40.045537+0000","last_active":"2026-02-22T19:47:23.105944+0000","last_peered":"2026-02-22T19:47:23.105944+0000","last_clean":"2026-02-22T19:47:23.105944+0000","last_became_active":"2026-02-22T19:46:40.045084+0000","last_became_peered":"2026-02-22T19:46:40.045084+0000","last_unstale":"2026-02-22T19:47:23.105944+0000","last_undegraded":"2026-02-22T19:47:23.105944+0000","last_fullsized":"2026-02-22T19:47:23.105944+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:29:16.512102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:23.106078+0000","last_change":"2026-02-22T19:46:40.045627+0000","last_active":"2026-02-22T19:47:23.106078+0000","last_peered":"2026-02-22T19:47:23.106078+0000","last_clean":"2026-02-22T19:47:23.106078+0000","last_became_active":"2026-02-22T19:46:40.045142+0000","last_became_peered":"2026-02-22T19:46:40.045142+0000","last_unstale":"2026-02-22T19:47:23.106078+0000","last_undegraded":"2026-02-22T19:47:23.106078+0000","last_fullsized":"2026-02-22T19:47:23.106078+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:39:15.014168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:23.106118+0000","last_change":"2026-02-22T19:46:40.045575+0000","last_active":"2026-02-22T19:47:23.106118+0000","last_peered":"2026-02-22T19:47:23.106118+0000","last_clean":"2026-02-22T19:47:23.106118+0000","last_became_active":"2026-02-22T19:46:40.045208+0000","last_became_peered":"2026-02-22T19:46:40.045208+0000","last_unstale":"2026-02-22T19:47:23.106118+0000","last_undegraded":"2026-02-22T19:47:23.106118+0000","last_fullsized":"2026-02-22T19:47:23.106118+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:46:39.035545+0000","last_clean_scrub_stamp":"2026-02-22T19:46:39.035545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T21:15:16.546777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771086,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":691969,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771084,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":688955,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T19:46:34.026698+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=34, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-22T19:46:39.035545+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=46, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=19, tm_min=47, tm_sec=24, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T19:47:25.951 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T19:47:45.952 DEBUG:teuthology.orchestra.run.trial152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T19:47:46.113 INFO:teuthology.orchestra.run.trial152.stdout: 2026-02-22T19:47:46.114 INFO:teuthology.orchestra.run.trial152.stderr:dumped all 2026-02-22T19:47:46.123 INFO:teuthology.orchestra.run.trial152.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2026-02-22T19:47:45.025798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":54624,"kb_used_data":704,"kb_used_omap":3,"kb_used_meta":53884,"kb_avail":188689056,"statfs":{"total":193273528320,"available":193217593344,"internally_reserved":0,"allocated":720896,"data_stored":1383938,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3187,"internal_metadata":55178125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000834"},"pg_stats":[{"pgid":"1.0","version":"34'54","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:26.602862+0000","last_change":"2026-02-22T19:47:26.602879+0000","last_active":"2026-02-22T19:47:26.602862+0000","last_peered":"2026-02-22T19:47:26.602862+0000","last_clean":"2026-02-22T19:47:26.602862+0000","last_became_active":"2026-02-22T19:46:35.594773+0000","last_became_peered":"2026-02-22T19:46:35.594773+0000","last_unstale":"2026-02-22T19:47:26.602862+0000","last_undegraded":"2026-02-22T19:47:26.602862+0000","last_fullsized":"2026-02-22T19:47:26.602862+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":8,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2026-02-22T19:47:26.602823+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2026-02-22T19:47:26.602823+0000","last_clean_scrub_stamp":"2026-02-22T19:47:26.602823+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:57:09.966896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:32.494836+0000","last_change":"2026-02-22T19:47:32.494849+0000","last_active":"2026-02-22T19:47:32.494836+0000","last_peered":"2026-02-22T19:47:32.494836+0000","last_clean":"2026-02-22T19:47:32.494836+0000","last_became_active":"2026-02-22T19:46:40.045068+0000","last_became_peered":"2026-02-22T19:46:40.045068+0000","last_unstale":"2026-02-22T19:47:32.494836+0000","last_undegraded":"2026-02-22T19:47:32.494836+0000","last_fullsized":"2026-02-22T19:47:32.494836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2026-02-22T19:47:32.494795+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2026-02-22T19:47:32.494795+0000","last_clean_scrub_stamp":"2026-02-22T19:47:32.494795+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:52:23.581583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:25.972839+0000","last_change":"2026-02-22T19:47:25.972849+0000","last_active":"2026-02-22T19:47:25.972839+0000","last_peered":"2026-02-22T19:47:25.972839+0000","last_clean":"2026-02-22T19:47:25.972839+0000","last_became_active":"2026-02-22T19:46:40.044243+0000","last_became_peered":"2026-02-22T19:46:40.044243+0000","last_unstale":"2026-02-22T19:47:25.972839+0000","last_undegraded":"2026-02-22T19:47:25.972839+0000","last_fullsized":"2026-02-22T19:47:25.972839+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:47:25.972798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:47:25.972798+0000","last_clean_scrub_stamp":"2026-02-22T19:47:25.972798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:28:41.941451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:30.511289+0000","last_change":"2026-02-22T19:47:30.511297+0000","last_active":"2026-02-22T19:47:30.511289+0000","last_peered":"2026-02-22T19:47:30.511289+0000","last_clean":"2026-02-22T19:47:30.511289+0000","last_became_active":"2026-02-22T19:46:40.045092+0000","last_became_peered":"2026-02-22T19:46:40.045092+0000","last_unstale":"2026-02-22T19:47:30.511289+0000","last_undegraded":"2026-02-22T19:47:30.511289+0000","last_fullsized":"2026-02-22T19:47:30.511289+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:47:30.511247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:47:30.511247+0000","last_clean_scrub_stamp":"2026-02-22T19:47:30.511247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:42:30.286641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:26.932755+0000","last_change":"2026-02-22T19:47:26.932769+0000","last_active":"2026-02-22T19:47:26.932755+0000","last_peered":"2026-02-22T19:47:26.932755+0000","last_clean":"2026-02-22T19:47:26.932755+0000","last_became_active":"2026-02-22T19:46:40.044359+0000","last_became_peered":"2026-02-22T19:46:40.044359+0000","last_unstale":"2026-02-22T19:47:26.932755+0000","last_undegraded":"2026-02-22T19:47:26.932755+0000","last_fullsized":"2026-02-22T19:47:26.932755+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:47:26.932704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:47:26.932704+0000","last_clean_scrub_stamp":"2026-02-22T19:47:26.932704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:08:38.234673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:27.570680+0000","last_change":"2026-02-22T19:47:27.570688+0000","last_active":"2026-02-22T19:47:27.570680+0000","last_peered":"2026-02-22T19:47:27.570680+0000","last_clean":"2026-02-22T19:47:27.570680+0000","last_became_active":"2026-02-22T19:46:40.044979+0000","last_became_peered":"2026-02-22T19:46:40.044979+0000","last_unstale":"2026-02-22T19:47:27.570680+0000","last_undegraded":"2026-02-22T19:47:27.570680+0000","last_fullsized":"2026-02-22T19:47:27.570680+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:47:27.570640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:47:27.570640+0000","last_clean_scrub_stamp":"2026-02-22T19:47:27.570640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:21:04.454006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:28.524681+0000","last_change":"2026-02-22T19:47:28.524692+0000","last_active":"2026-02-22T19:47:28.524681+0000","last_peered":"2026-02-22T19:47:28.524681+0000","last_clean":"2026-02-22T19:47:28.524681+0000","last_became_active":"2026-02-22T19:46:40.045084+0000","last_became_peered":"2026-02-22T19:46:40.045084+0000","last_unstale":"2026-02-22T19:47:28.524681+0000","last_undegraded":"2026-02-22T19:47:28.524681+0000","last_fullsized":"2026-02-22T19:47:28.524681+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:47:28.524631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:47:28.524631+0000","last_clean_scrub_stamp":"2026-02-22T19:47:28.524631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:42:59.133688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:31.523953+0000","last_change":"2026-02-22T19:47:31.523973+0000","last_active":"2026-02-22T19:47:31.523953+0000","last_peered":"2026-02-22T19:47:31.523953+0000","last_clean":"2026-02-22T19:47:31.523953+0000","last_became_active":"2026-02-22T19:46:40.045142+0000","last_became_peered":"2026-02-22T19:46:40.045142+0000","last_unstale":"2026-02-22T19:47:31.523953+0000","last_undegraded":"2026-02-22T19:47:31.523953+0000","last_fullsized":"2026-02-22T19:47:31.523953+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:47:31.523878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:47:31.523878+0000","last_clean_scrub_stamp":"2026-02-22T19:47:31.523878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:11:59.401537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-22T19:47:29.552792+0000","last_change":"2026-02-22T19:47:29.552806+0000","last_active":"2026-02-22T19:47:29.552792+0000","last_peered":"2026-02-22T19:47:29.552792+0000","last_clean":"2026-02-22T19:47:29.552792+0000","last_became_active":"2026-02-22T19:46:40.045208+0000","last_became_peered":"2026-02-22T19:46:40.045208+0000","last_unstale":"2026-02-22T19:47:29.552792+0000","last_undegraded":"2026-02-22T19:47:29.552792+0000","last_fullsized":"2026-02-22T19:47:29.552792+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T19:47:29.552744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T19:47:29.552744+0000","last_clean_scrub_stamp":"2026-02-22T19:47:29.552744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:58:36.589764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":6800,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":7,"seq":30064771090,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":360448,"data_stored":691969,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771088,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":360448,"data_stored":691969,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3400,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T19:47:46.124 DEBUG:teuthology.orchestra.run.trial152:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T19:47:46.289 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T19:47:46.290 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T19:47:46.290 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T19:47:46.290 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:47:46.329 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T19:47:46.329 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T19:47:46.329 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:47:46.402 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T19:47:46.403 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T19:47:46.403 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T19:47:46.403 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:47:46.474 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T19:47:46.474 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T19:47:46.474 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T19:47:46.474 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T19:47:46.524 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T19:47:46.524 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T19:47:46.524 DEBUG:teuthology.orchestra.run.trial152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-22T19:47:46.590 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial152.front.sepia.ceph.com 2026-02-22T19:47:46.590 DEBUG:teuthology.orchestra.run.trial152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T19:47:46.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial152.front.sepia.ceph.com 2026-02-22T19:47:46.664 DEBUG:teuthology.orchestra.run.trial152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T19:47:46.730 INFO:tasks.ceph:Archiving mon data... 2026-02-22T19:47:46.731 DEBUG:teuthology.misc:Transferring archived files from trial152:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/63962/data/mon.a.tgz 2026-02-22T19:47:46.732 DEBUG:teuthology.orchestra.run.trial152:> mktemp 2026-02-22T19:47:46.786 INFO:teuthology.orchestra.run.trial152.stdout:/tmp/tmp.yeU2avyfcD 2026-02-22T19:47:46.786 DEBUG:teuthology.orchestra.run.trial152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yeU2avyfcD 2026-02-22T19:47:46.869 DEBUG:teuthology.orchestra.run.trial152:> sudo chmod 0666 /tmp/tmp.yeU2avyfcD 2026-02-22T19:47:46.992 DEBUG:teuthology.orchestra.remote:trial152:/tmp/tmp.yeU2avyfcD is 163KB 2026-02-22T19:47:47.012 DEBUG:teuthology.orchestra.run.trial152:> rm -fr /tmp/tmp.yeU2avyfcD 2026-02-22T19:47:47.027 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T19:47:47.027 DEBUG:teuthology.orchestra.run.trial152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T19:47:47.148 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T19:47:47.148 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T19:47:47.150 DEBUG:teuthology.misc:Transferring archived files from trial152:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/63962/remote/trial152/crash 2026-02-22T19:47:47.151 DEBUG:teuthology.orchestra.run.trial152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T19:47:47.211 INFO:tasks.ceph:Compressing logs... 2026-02-22T19:47:47.218 DEBUG:teuthology.orchestra.run.trial152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T19:47:47.282 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2026-02-22T19:47:47.282 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T19:47:47.282 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45135.log 2026-02-22T19:47:47.282 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2026-02-22T19:47:47.283 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T19:47:47.283 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2026-02-22T19:47:47.283 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45135.log.gz 2026-02-22T19:47:47.283 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43965.log 2026-02-22T19:47:47.284 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44573.log 2026-02-22T19:47:47.284 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2026-02-22T19:47:47.284 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43965.log.gz 2026-02-22T19:47:47.284 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44889.log 2026-02-22T19:47:47.284 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44573.log.gz 2026-02-22T19:47:47.284 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37820.log 2026-02-22T19:47:47.284 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41315.log 2026-02-22T19:47:47.285 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44889.log.gz 2026-02-22T19:47:47.285 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph.tmp-client.admin.37820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2026-02-22T19:47:47.285 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37820.log.gz 2026-02-22T19:47:47.285 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.41315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44618.log 2026-02-22T19:47:47.285 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41315.log.gz 2026-02-22T19:47:47.285 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44779.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz --verbose 2026-02-22T19:47:47.285 INFO:teuthology.orchestra.run.trial152.stderr: -- /var/log/ceph/ceph-client.admin.44298.log 2026-02-22T19:47:47.286 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2026-02-22T19:47:47.286 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44618.log.gz 2026-02-22T19:47:47.286 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44298.log.gz 2026-02-22T19:47:47.286 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2026-02-22T19:47:47.286 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41463.log 2026-02-22T19:47:47.287 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2026-02-22T19:47:47.287 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2026-02-22T19:47:47.287 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45429.log 2026-02-22T19:47:47.287 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.41463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41463.log.gz 2026-02-22T19:47:47.287 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45037.log 2026-02-22T19:47:47.287 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45429.log.gz 2026-02-22T19:47:47.287 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44491.log 2026-02-22T19:47:47.288 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43746.log 2026-02-22T19:47:47.288 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45037.log.gz 2026-02-22T19:47:47.288 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44491.log.gz 2026-02-22T19:47:47.288 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2026-02-22T19:47:47.288 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44824.log 2026-02-22T19:47:47.288 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43746.log.gz 2026-02-22T19:47:47.289 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2026-02-22T19:47:47.289 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2026-02-22T19:47:47.289 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45086.log 2026-02-22T19:47:47.289 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44824.log.gz 2026-02-22T19:47:47.289 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.41108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2026-02-22T19:47:47.289 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2026-02-22T19:47:47.289 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45086.log.gz 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43410.log 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43648.log 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43410.log.gz 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2026-02-22T19:47:47.290 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43648.log.gz 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45526.log 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44803.log 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45526.log.gz 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41416.log 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43475.log 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44803.log.gz 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.41416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2026-02-22T19:47:47.291 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41416.log.gz 2026-02-22T19:47:47.292 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43475.log.gz 2026-02-22T19:47:47.292 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44594.log 2026-02-22T19:47:47.292 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44474.log 2026-02-22T19:47:47.292 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 2026-02-22T19:47:47.292 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44594.log.gz 2026-02-22T19:47:47.292 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43747.log 2026-02-22T19:47:47.293 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44474.log.gz 2026-02-22T19:47:47.293 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2026-02-22T19:47:47.293 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz 2026-02-22T19:47:47.293 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T19:47:47.293 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2026-02-22T19:47:47.293 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43232.log: 88.5%gzip -- replaced with /var/log/ceph/ceph.audit.log.gz -5 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43385.log 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44457.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2026-02-22T19:47:47.294 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43385.log.gz 2026-02-22T19:47:47.295 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2026-02-22T19:47:47.295 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45233.log 2026-02-22T19:47:47.295 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2026-02-22T19:47:47.295 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43916.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2026-02-22T19:47:47.295 INFO:teuthology.orchestra.run.trial152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2026-02-22T19:47:47.295 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45233.log.gz 2026-02-22T19:47:47.296 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43573.log 2026-02-22T19:47:47.296 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2026-02-22T19:47:47.296 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43649.log 2026-02-22T19:47:47.296 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43573.log.gz 2026-02-22T19:47:47.296 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44407.log 2026-02-22T19:47:47.296 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43649.log.gz 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45282.log 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44407.log.gz 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44272.log 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45282.log.gz 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44272.log.gz 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2026-02-22T19:47:47.297 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2026-02-22T19:47:47.298 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45380.log 2026-02-22T19:47:47.298 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2026-02-22T19:47:47.298 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43315.log 2026-02-22T19:47:47.298 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.45380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44692.log 2026-02-22T19:47:47.298 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45380.log.gz 2026-02-22T19:47:47.298 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43315.log.gz 2026-02-22T19:47:47.298 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43524.log 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44692.log.gz 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.43524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43524.log.gz 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44753.log 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44753.log.gz 2026-02-22T19:47:47.299 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2026-02-22T19:47:47.300 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41253.log 2026-02-22T19:47:47.300 INFO:teuthology.orchestra.run.trial152.stderr: 84.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T19:47:47.300 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2026-02-22T19:47:47.300 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44322.log 2026-02-22T19:47:47.300 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.41253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41253.log.gz 2026-02-22T19:47:47.300 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44845.log 2026-02-22T19:47:47.301 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44322.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.44322.log.gz 2026-02-22T19:47:47.301 INFO:teuthology.orchestra.run.trial152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2026-02-22T19:47:47.301 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44346.log 2026-02-22T19:47:47.301 INFO:teuthology.orchestra.run.trial152.stderr: 48.3% -- replaced with /var/log/ceph/ceph-client.admin.44845.log.gz 2026-02-22T19:47:47.301 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44387.log: 11.5% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2026-02-22T19:47:47.301 INFO:teuthology.orchestra.run.trial152.stderr:/var/log/ceph/ceph-client.admin.44346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44346.log.gz 2026-02-22T19:47:47.305 INFO:teuthology.orchestra.run.trial152.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T19:47:47.312 INFO:teuthology.orchestra.run.trial152.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T19:47:47.333 INFO:teuthology.orchestra.run.trial152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T19:47:47.352 INFO:teuthology.orchestra.run.trial152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T19:47:47.355 INFO:teuthology.orchestra.run.trial152.stderr: 2026-02-22T19:47:47.355 INFO:teuthology.orchestra.run.trial152.stderr:real 0m0.080s 2026-02-22T19:47:47.355 INFO:teuthology.orchestra.run.trial152.stderr:user 0m0.162s 2026-02-22T19:47:47.355 INFO:teuthology.orchestra.run.trial152.stderr:sys 0m0.046s 2026-02-22T19:47:47.355 INFO:tasks.ceph:Archiving logs... 2026-02-22T19:47:47.356 DEBUG:teuthology.misc:Transferring archived files from trial152:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/63962/remote/trial152/log 2026-02-22T19:47:47.360 DEBUG:teuthology.orchestra.run.trial152:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T19:47:47.522 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T19:47:47.539 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T19:47:47.539 DEBUG:teuthology.orchestra.run.trial152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T19:47:47.662 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T19:47:47.673 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T19:47:47.673 DEBUG:teuthology.orchestra.run.trial152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T19:47:47.690 INFO:teuthology.orchestra.run.trial152.stderr:bash: line 1: ntpq: command not found 2026-02-22T19:47:47.711 INFO:teuthology.orchestra.run.trial152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T19:47:47.711 INFO:teuthology.orchestra.run.trial152.stdout:=============================================================================== 2026-02-22T19:47:47.711 INFO:teuthology.orchestra.run.trial152.stdout:^- ntp2.zeus.frumentum.media 2 6 77 30 -108ms[ -109ms] +/- 130ms 2026-02-22T19:47:47.711 INFO:teuthology.orchestra.run.trial152.stdout:^- ip216-250-115-174.pbiaas> 2 6 77 31 +1427us[+1223us] +/- 111ms 2026-02-22T19:47:47.711 INFO:teuthology.orchestra.run.trial152.stdout:^* 216-144-228-179-host.col> 2 6 77 28 -132us[ -356us] +/- 11ms 2026-02-22T19:47:47.711 INFO:teuthology.orchestra.run.trial152.stdout:^+ 149.28.61.105.vultruserc> 3 6 77 32 +352us[-1097us] +/- 32ms 2026-02-22T19:47:47.711 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T19:47:47.722 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T19:47:47.722 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T19:47:47.736 DEBUG:teuthology.orchestra.run.trial152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T19:47:47.805 DEBUG:teuthology.orchestra.run.trial152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T19:47:47.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:47:47.832 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T19:47:47.847 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T19:47:47.861 INFO:teuthology.task.internal:Duration was 314.975648 seconds 2026-02-22T19:47:47.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T19:47:47.875 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T19:47:47.875 DEBUG:teuthology.orchestra.run.trial152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T19:47:47.912 INFO:teuthology.orchestra.run.trial152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T19:47:48.328 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T19:47:48.328 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial152.front.sepia.ceph.com 2026-02-22T19:47:48.329 DEBUG:teuthology.orchestra.run.trial152:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T19:47:48.387 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T19:47:48.387 DEBUG:teuthology.orchestra.run.trial152:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T19:47:48.487 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T19:47:48.487 DEBUG:teuthology.orchestra.run.trial152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T19:47:48.510 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T19:47:48.511 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T19:47:48.511 INFO:teuthology.orchestra.run.trial152.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T19:47:48.511 INFO:teuthology.orchestra.run.trial152.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T19:47:48.511 INFO:teuthology.orchestra.run.trial152.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T19:47:48.521 INFO:teuthology.orchestra.run.trial152.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T19:47:48.522 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T19:47:48.534 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T19:47:48.534 DEBUG:teuthology.orchestra.run.trial152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T19:47:48.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T19:47:48.609 DEBUG:teuthology.orchestra.run.trial152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T19:47:48.654 INFO:teuthology.orchestra.run.trial152.stdout:kernel.core_pattern = core 2026-02-22T19:47:48.668 DEBUG:teuthology.orchestra.run.trial152:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T19:47:48.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T19:47:48.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T19:47:48.742 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T19:47:48.743 DEBUG:teuthology.misc:Transferring archived files from trial152:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/63962/remote/trial152 2026-02-22T19:47:48.743 DEBUG:teuthology.orchestra.run.trial152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T19:47:48.799 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T19:47:48.799 DEBUG:teuthology.orchestra.run.trial152:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T19:47:48.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T19:47:48.866 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T19:47:48.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T19:47:48.883 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T19:47:48.883 DEBUG:teuthology.orchestra.run.trial152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T19:47:48.905 INFO:teuthology.orchestra.run.trial152.stdout: 917526 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 19:47 /home/ubuntu/cephtest 2026-02-22T19:47:48.907 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T19:47:48.924 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T19:47:48.955 INFO:teuthology.run:Summary data: description: rbd/singleton/{all/rbd-vs-unmanaged-snaps conf/{disable-pool-app} objectstore/bluestore-comp-zstd openstack supported-random-distro$/{centos_latest}} duration: 314.97564816474915 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T19:47:48.955 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T19:47:49.042 INFO:teuthology.run:pass