2026-02-22T21:38:59.968 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T21:38:59.981 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:39:00.057 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64097 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64097' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 - osd.8 - osd.9 - client.0 seed: 5907 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHr1F9TEWccXVN01kPAWpzI7ZBuwbH49p/Uy8ItjRxnioqasPpyhyO5iP8D3wCFiZew6obj/M3dJJxSOk/EFhM= tasks: - install: null - ceph: conf: osd: osd max object name len: 400 osd max object namespace len: 64 log-ignorelist: - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - workunit: clients: all: - rados/test_health_warnings.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:40 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T21:39:00.057 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T21:39:00.058 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T21:39:00.058 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T21:39:00.059 INFO:teuthology.task.internal:Checking packages... 2026-02-22T21:39:00.059 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T21:39:00.059 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T21:39:00.060 INFO:teuthology.packaging:ref: None 2026-02-22T21:39:00.060 INFO:teuthology.packaging:tag: None 2026-02-22T21:39:00.060 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T21:39:00.060 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:39:00.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T21:39:00.179 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.gf90f4eae 2026-02-22T21:39:00.180 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T21:39:00.191 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T21:39:00.191 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T21:39:00.208 INFO:teuthology.task.internal:Saving configuration 2026-02-22T21:39:00.218 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T21:39:00.230 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T21:39:00.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial155.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64097', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 21:35:29.399412', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHr1F9TEWccXVN01kPAWpzI7ZBuwbH49p/Uy8ItjRxnioqasPpyhyO5iP8D3wCFiZew6obj/M3dJJxSOk/EFhM='} 2026-02-22T21:39:00.288 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T21:39:00.300 INFO:teuthology.task.internal:roles: ubuntu@trial155.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0'] 2026-02-22T21:39:00.301 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T21:39:00.379 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x758d7f9f7ec0>, signals=[15]) 2026-02-22T21:39:00.379 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T21:39:00.390 INFO:teuthology.task.internal:Opening connections... 2026-02-22T21:39:00.390 DEBUG:teuthology.task.internal:connecting to ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:39:00.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:39:00.452 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T21:39:00.464 DEBUG:teuthology.orchestra.run.trial155:> uname -m 2026-02-22T21:39:00.522 INFO:teuthology.orchestra.run.trial155.stdout:x86_64 2026-02-22T21:39:00.522 DEBUG:teuthology.orchestra.run.trial155:> cat /etc/os-release 2026-02-22T21:39:00.578 INFO:teuthology.orchestra.run.trial155.stdout:NAME="CentOS Stream" 2026-02-22T21:39:00.578 INFO:teuthology.orchestra.run.trial155.stdout:VERSION="9" 2026-02-22T21:39:00.578 INFO:teuthology.orchestra.run.trial155.stdout:ID="centos" 2026-02-22T21:39:00.578 INFO:teuthology.orchestra.run.trial155.stdout:ID_LIKE="rhel fedora" 2026-02-22T21:39:00.578 INFO:teuthology.orchestra.run.trial155.stdout:VERSION_ID="9" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:PLATFORM_ID="platform:el9" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:ANSI_COLOR="0;31" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:LOGO="fedora-logo-icon" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:HOME_URL="https://centos.org/" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-22T21:39:00.579 INFO:teuthology.orchestra.run.trial155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-22T21:39:00.579 INFO:teuthology.lock.ops:Updating trial155.front.sepia.ceph.com on lock server 2026-02-22T21:39:00.656 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T21:39:00.669 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T21:39:00.681 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T21:39:00.682 DEBUG:teuthology.orchestra.run.trial155:> test '!' -e /home/ubuntu/cephtest 2026-02-22T21:39:00.697 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T21:39:00.708 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T21:39:00.708 DEBUG:teuthology.orchestra.run.trial155:> test -z $(ls -A /var/lib/ceph) 2026-02-22T21:39:00.754 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T21:39:00.853 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T21:39:00.873 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T21:39:00.873 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T21:39:00.873 DEBUG:teuthology.orchestra.run.trial155:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T21:39:00.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:39:00.888 DEBUG:teuthology.orchestra.run.trial155:> uname -r 2026-02-22T21:39:00.943 INFO:teuthology.orchestra.run.trial155.stdout:5.14.0-681.el9.x86_64 2026-02-22T21:39:00.943 INFO:teuthology.task.kernel:Running kernel on trial155: 5.14.0-681.el9.x86_64 2026-02-22T21:39:00.943 DEBUG:teuthology.orchestra.run.trial155:> sudo yum install -y kernel 2026-02-22T21:39:06.046 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.9 MB 00:04 2026-02-22T21:39:08.575 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-22T21:39:11.792 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 7.8 MB 00:00 2026-02-22T21:39:13.599 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-22T21:39:14.266 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-22T21:39:17.471 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-22T21:39:18.480 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-22T21:39:18.480 INFO:teuthology.orchestra.run.trial155.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-22T21:39:18.499 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:39:18.499 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:39:18.500 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:39:18.523 DEBUG:teuthology.orchestra.run.trial155:> echo no | sudo yum reinstall kernel || true 2026-02-22T21:39:18.820 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:01 ago on Sun 22 Feb 2026 09:39:17 PM UTC. 2026-02-22T21:39:18.900 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalling: 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 803 k 2026-02-22T21:39:18.901 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-22T21:39:18.902 INFO:teuthology.orchestra.run.trial155.stderr:Operation aborted. 2026-02-22T21:39:18.921 INFO:teuthology.orchestra.run.trial155.stdout:Is this ok [y/N]: 2026-02-22T21:39:18.921 DEBUG:teuthology.orchestra.run.trial155:> sudo yum reinstall -y kernel || true 2026-02-22T21:39:19.220 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:02 ago on Sun 22 Feb 2026 09:39:17 PM UTC. 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalling: 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 803 k 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 0 2026-02-22T21:39:19.299 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:39:19.448 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2026-02-22T21:39:19.448 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:39:19.448 INFO:teuthology.orchestra.run.trial155.stdout:Total 5.3 MB/s | 803 kB 00:00 2026-02-22T21:39:19.458 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:39:19.491 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:39:19.492 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:39:19.497 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:39:19.497 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:39:19.520 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:39:19.524 INFO:teuthology.orchestra.run.trial155.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T21:39:19.524 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T21:39:19.634 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T21:39:19.634 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-22T21:39:19.685 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-22T21:39:19.685 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:39:19.685 INFO:teuthology.orchestra.run.trial155.stdout:Reinstalled: 2026-02-22T21:39:19.685 INFO:teuthology.orchestra.run.trial155.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-22T21:39:19.685 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:39:19.685 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:39:19.712 DEBUG:teuthology.orchestra.run.trial155:> rpm -q kernel | sort -rV | head -n 1 2026-02-22T21:39:19.734 INFO:teuthology.orchestra.run.trial155.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-22T21:39:19.735 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-22T21:39:19.735 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T21:39:19.735 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T21:39:19.735 DEBUG:teuthology.orchestra.run.trial155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T21:39:19.799 INFO:teuthology.orchestra.run.trial155.stdout:ttyS1 2026-02-22T21:39:19.818 DEBUG:teuthology.parallel:result is None 2026-02-22T21:39:19.818 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T21:39:19.831 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T21:39:19.831 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T21:39:19.874 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T21:39:19.887 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T21:39:19.900 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T21:39:19.901 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T21:39:19.935 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T21:39:19.946 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T21:39:19.947 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T21:39:19.995 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T21:39:20.004 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T21:39:20.006 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T21:39:20.018 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T21:39:20.018 DEBUG:teuthology.orchestra.run.trial155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T21:39:20.070 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T21:39:20.094 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T21:39:20.094 DEBUG:teuthology.orchestra.run.trial155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T21:39:20.127 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T21:39:20.267 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T21:39:20.291 DEBUG:teuthology.orchestra.run.trial155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T21:39:20.428 DEBUG:teuthology.orchestra.run.trial155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T21:39:20.451 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:39:20.451 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T21:39:20.516 DEBUG:teuthology.orchestra.run.trial155:> sudo service rsyslog restart 2026-02-22T21:39:20.583 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T21:39:20.938 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T21:39:20.950 INFO:teuthology.task.internal:Starting timer... 2026-02-22T21:39:20.950 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T21:39:20.972 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T21:39:20.986 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-22T21:39:20.986 DEBUG:teuthology.orchestra.run.trial155:> sudo service auditd rotate 2026-02-22T21:39:21.014 INFO:teuthology.orchestra.run.trial155.stdout:Rotating logs: 2026-02-22T21:39:21.015 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T21:39:21.015 DEBUG:teuthology.orchestra.run.trial155:> /usr/sbin/getenforce 2026-02-22T21:39:21.071 INFO:teuthology.orchestra.run.trial155.stdout:Permissive 2026-02-22T21:39:21.072 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial155.front.sepia.ceph.com': 'permissive'} 2026-02-22T21:39:21.072 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T21:39:21.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:39:21.137 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T21:39:21.137 DEBUG:teuthology.orchestra.run.trial155:> sudo /usr/sbin/setenforce permissive 2026-02-22T21:39:21.199 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T21:39:21.213 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T21:39:21.222 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T21:39:21.222 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T21:42:00.314 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial155.front.sepia.ceph.com')] 2026-02-22T21:42:00.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-22T21:42:00.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T21:42:00.422 DEBUG:teuthology.orchestra.run.trial155:> true 2026-02-22T21:42:00.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial155.front.sepia.ceph.com' 2026-02-22T21:42:00.498 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T21:42:00.511 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T21:42:00.512 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T21:42:00.512 DEBUG:teuthology.orchestra.run.trial155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T21:42:00.567 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-22T21:42:00.579 INFO:teuthology.orchestra.run.trial155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-22T21:42:00.601 INFO:teuthology.orchestra.run.trial155.stderr:sudo: ntpd: command not found 2026-02-22T21:42:00.610 INFO:teuthology.orchestra.run.trial155.stdout:506 Cannot talk to daemon 2026-02-22T21:42:00.622 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-22T21:42:00.634 INFO:teuthology.orchestra.run.trial155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-22T21:42:00.678 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-22T21:42:00.680 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T21:42:00.680 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-22T21:42:00.681 INFO:teuthology.run_tasks:Running task install... 2026-02-22T21:42:00.695 DEBUG:teuthology.task.install:project ceph 2026-02-22T21:42:00.695 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T21:42:00.695 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T21:42:00.696 INFO:teuthology.task.install:Using flavor: default 2026-02-22T21:42:00.704 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T21:42:00.704 INFO:teuthology.task.install:extra packages: [] 2026-02-22T21:42:00.705 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'tag': None, 'wait_for_package': False} 2026-02-22T21:42:00.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:42:00.871 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/ 2026-02-22T21:42:00.871 INFO:teuthology.task.install.rpm:Package version is 19.2.3-689.gf90f4eae 2026-02-22T21:42:01.003 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-22T21:42:01.003 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:01.003 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-22T21:42:01.029 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-22T21:42:01.029 DEBUG:teuthology.orchestra.run.trial155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f90f4eaebb28b619cf76e80cbbe997656da69579/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-22T21:42:01.094 DEBUG:teuthology.orchestra.run.trial155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-22T21:42:01.167 DEBUG:teuthology.orchestra.run.trial155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-22T21:42:01.231 INFO:teuthology.orchestra.run.trial155.stdout:check_obsoletes = 1 2026-02-22T21:42:01.232 DEBUG:teuthology.orchestra.run.trial155:> sudo yum clean all 2026-02-22T21:42:01.392 INFO:teuthology.orchestra.run.trial155.stdout:41 files removed 2026-02-22T21:42:01.407 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-radosgw 2026-02-22T21:42:01.681 INFO:teuthology.orchestra.run.trial155.stdout:ceph packages for x86_64 663 kB/s | 86 kB 00:00 2026-02-22T21:42:01.817 INFO:teuthology.orchestra.run.trial155.stdout:ceph noarch packages 110 kB/s | 12 kB 00:00 2026-02-22T21:42:01.944 INFO:teuthology.orchestra.run.trial155.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-22T21:42:02.612 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.9 MB 00:00 2026-02-22T21:42:05.976 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-22T21:42:09.919 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-22T21:42:10.837 INFO:teuthology.orchestra.run.trial155.stdout:CentOS Stream 9 - Extras packages 111 kB/s | 20 kB 00:00 2026-02-22T21:42:11.373 INFO:teuthology.orchestra.run.trial155.stdout:Extra Packages for Enterprise Linux 44 MB/s | 20 MB 00:00 2026-02-22T21:42:14.541 INFO:teuthology.orchestra.run.trial155.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-22T21:42:15.736 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:15.737 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:15.737 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-22T21:42:15.737 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 11 M 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout:Upgrading: 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: librados2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.4 M 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: librbd1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.2 M 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.5 M 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 22 M 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 25 k 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-22T21:42:15.738 INFO:teuthology.orchestra.run.trial155.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 999 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 503 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: librgw2 x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 5.4 M 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-22T21:42:15.739 INFO:teuthology.orchestra.run.trial155.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 45 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 142 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 165 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 322 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 303 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 100 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-22T21:42:15.740 INFO:teuthology.orchestra.run.trial155.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout:Install 33 Packages 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout:Upgrade 2 Packages 2026-02-22T21:42:15.741 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:15.742 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 63 M 2026-02-22T21:42:15.742 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:16.317 INFO:teuthology.orchestra.run.trial155.stdout:(1/35): ceph-base-19.2.3-689.gf90f4eae.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-22T21:42:16.355 INFO:teuthology.orchestra.run.trial155.stdout:(2/35): ceph-selinux-19.2.3-689.gf90f4eae.el9.x 661 kB/s | 25 kB 00:00 2026-02-22T21:42:16.417 INFO:teuthology.orchestra.run.trial155.stdout:(3/35): libcephfs2-19.2.3-689.gf90f4eae.el9.x86 16 MB/s | 999 kB 00:00 2026-02-22T21:42:16.473 INFO:teuthology.orchestra.run.trial155.stdout:(4/35): libradosstriper1-19.2.3-689.gf90f4eae.e 8.9 MB/s | 503 kB 00:00 2026-02-22T21:42:16.575 INFO:teuthology.orchestra.run.trial155.stdout:(5/35): ceph-radosgw-19.2.3-689.gf90f4eae.el9.x 18 MB/s | 11 MB 00:00 2026-02-22T21:42:16.620 INFO:teuthology.orchestra.run.trial155.stdout:(6/35): python3-ceph-argparse-19.2.3-689.gf90f4 1.0 MB/s | 45 kB 00:00 2026-02-22T21:42:16.674 INFO:teuthology.orchestra.run.trial155.stdout:(7/35): python3-ceph-common-19.2.3-689.gf90f4ea 2.6 MB/s | 142 kB 00:00 2026-02-22T21:42:16.705 INFO:teuthology.orchestra.run.trial155.stdout:(8/35): librgw2-19.2.3-689.gf90f4eae.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-22T21:42:16.723 INFO:teuthology.orchestra.run.trial155.stdout:(9/35): python3-cephfs-19.2.3-689.gf90f4eae.el9 3.3 MB/s | 165 kB 00:00 2026-02-22T21:42:16.743 INFO:teuthology.orchestra.run.trial155.stdout:(10/35): python3-rados-19.2.3-689.gf90f4eae.el9 8.3 MB/s | 322 kB 00:00 2026-02-22T21:42:16.763 INFO:teuthology.orchestra.run.trial155.stdout:(11/35): python3-rbd-19.2.3-689.gf90f4eae.el9.x 7.4 MB/s | 303 kB 00:00 2026-02-22T21:42:16.780 INFO:teuthology.orchestra.run.trial155.stdout:(12/35): python3-rgw-19.2.3-689.gf90f4eae.el9.x 2.7 MB/s | 100 kB 00:00 2026-02-22T21:42:16.807 INFO:teuthology.orchestra.run.trial155.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 762 kB/s | 33 kB 00:00 2026-02-22T21:42:16.832 INFO:teuthology.orchestra.run.trial155.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 3.6 MB/s | 93 kB 00:00 2026-02-22T21:42:16.871 INFO:teuthology.orchestra.run.trial155.stdout:(15/35): ceph-common-19.2.3-689.gf90f4eae.el9.x 24 MB/s | 22 MB 00:00 2026-02-22T21:42:16.884 INFO:teuthology.orchestra.run.trial155.stdout:(16/35): nvme-cli-2.16-1.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2026-02-22T21:42:16.912 INFO:teuthology.orchestra.run.trial155.stdout:(17/35): libnbd-1.20.3-4.el9.x86_64.rpm 4.1 MB/s | 164 kB 00:00 2026-02-22T21:42:16.913 INFO:teuthology.orchestra.run.trial155.stdout:(18/35): boost-program-options-1.75.0-13.el9.x8 1.3 MB/s | 104 kB 00:00 2026-02-22T21:42:16.933 INFO:teuthology.orchestra.run.trial155.stdout:(19/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2026-02-22T21:42:16.945 INFO:teuthology.orchestra.run.trial155.stdout:(20/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2026-02-22T21:42:16.949 INFO:teuthology.orchestra.run.trial155.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 18 MB/s | 662 kB 00:00 2026-02-22T21:42:16.967 INFO:teuthology.orchestra.run.trial155.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.5 MB/s | 292 kB 00:00 2026-02-22T21:42:16.975 INFO:teuthology.orchestra.run.trial155.stdout:(23/35): qatlib-25.08.0-2.el9.x86_64.rpm 7.8 MB/s | 240 kB 00:00 2026-02-22T21:42:16.978 INFO:teuthology.orchestra.run.trial155.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.2 MB/s | 37 kB 00:00 2026-02-22T21:42:16.997 INFO:teuthology.orchestra.run.trial155.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.2 MB/s | 66 kB 00:00 2026-02-22T21:42:17.103 INFO:teuthology.orchestra.run.trial155.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 233 kB/s | 25 kB 00:00 2026-02-22T21:42:17.164 INFO:teuthology.orchestra.run.trial155.stdout:(27/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-22T21:42:17.168 INFO:teuthology.orchestra.run.trial155.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 759 kB/s | 49 kB 00:00 2026-02-22T21:42:17.190 INFO:teuthology.orchestra.run.trial155.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2026-02-22T21:42:17.234 INFO:teuthology.orchestra.run.trial155.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-22T21:42:17.238 INFO:teuthology.orchestra.run.trial155.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 3.9 MB/s | 191 kB 00:00 2026-02-22T21:42:17.263 INFO:teuthology.orchestra.run.trial155.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-22T21:42:17.287 INFO:teuthology.orchestra.run.trial155.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 30 MB/s | 1.6 MB 00:00 2026-02-22T21:42:17.334 INFO:teuthology.orchestra.run.trial155.stdout:(34/35): librados2-19.2.3-689.gf90f4eae.el9.x86 36 MB/s | 3.4 MB 00:00 2026-02-22T21:42:17.361 INFO:teuthology.orchestra.run.trial155.stdout:(35/35): librbd1-19.2.3-689.gf90f4eae.el9.x86_6 32 MB/s | 3.2 MB 00:00 2026-02-22T21:42:17.365 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:17.365 INFO:teuthology.orchestra.run.trial155.stdout:Total 39 MB/s | 63 MB 00:01 2026-02-22T21:42:17.464 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:17.485 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:17.485 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:17.739 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:17.740 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:18.030 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:18.039 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-22T21:42:18.042 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-22T21:42:18.054 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-22T21:42:18.203 INFO:teuthology.orchestra.run.trial155.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-22T21:42:18.208 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T21:42:18.237 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T21:42:18.279 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T21:42:18.280 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T21:42:18.292 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T21:42:18.296 INFO:teuthology.orchestra.run.trial155.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-22T21:42:18.305 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 9/37 2026-02-22T21:42:18.327 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T21:42:18.328 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T21:42:18.341 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T21:42:18.371 INFO:teuthology.orchestra.run.trial155.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-22T21:42:18.377 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-22T21:42:18.384 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-22T21:42:18.386 INFO:teuthology.orchestra.run.trial155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-22T21:42:18.389 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-22T21:42:18.395 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-22T21:42:18.535 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T21:42:18.536 INFO:teuthology.orchestra.run.trial155.stdout: Upgrading : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T21:42:18.562 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 19/37 2026-02-22T21:42:18.565 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 20/37 2026-02-22T21:42:18.571 INFO:teuthology.orchestra.run.trial155.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-22T21:42:18.796 INFO:teuthology.orchestra.run.trial155.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-22T21:42:18.797 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T21:42:18.814 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 23/37 2026-02-22T21:42:18.821 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 24/37 2026-02-22T21:42:18.828 INFO:teuthology.orchestra.run.trial155.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-22T21:42:18.831 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-22T21:42:18.832 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T21:42:18.851 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-22T21:42:18.969 INFO:teuthology.orchestra.run.trial155.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-22T21:42:18.971 INFO:teuthology.orchestra.run.trial155.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T21:42:19.258 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 29/37 2026-02-22T21:42:19.258 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T21:42:19.258 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:19.292 INFO:teuthology.orchestra.run.trial155.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-22T21:42:19.294 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 31/37 2026-02-22T21:42:20.273 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T21:42:20.275 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T21:42:20.557 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 32/37 2026-02-22T21:42:20.561 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T21:42:20.601 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 33/37 2026-02-22T21:42:20.601 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-22T21:42:20.601 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-22T21:42:20.602 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:20.605 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T21:42:25.146 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T21:42:25.146 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /sys 2026-02-22T21:42:25.146 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /proc 2026-02-22T21:42:25.147 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /mnt 2026-02-22T21:42:25.147 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /var/tmp 2026-02-22T21:42:25.147 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /home 2026-02-22T21:42:25.147 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /root 2026-02-22T21:42:25.147 INFO:teuthology.orchestra.run.trial155.stdout:skipping the directory /tmp 2026-02-22T21:42:25.147 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:25.603 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T21:42:25.628 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 35/37 2026-02-22T21:42:25.628 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:25.628 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-22T21:42:25.628 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T21:42:25.629 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-22T21:42:25.629 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:25.630 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T21:42:25.642 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-22T21:42:25.643 INFO:teuthology.orchestra.run.trial155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T21:42:25.699 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T21:42:25.699 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'qat' with GID 992. 2026-02-22T21:42:25.699 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 1/37 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2/37 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 3/37 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 4/37 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 5/37 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 6/37 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 7/37 2026-02-22T21:42:25.988 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x 8/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86 9/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 10/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 11/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 12/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 13/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 15/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-22T21:42:25.989 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-22T21:42:25.990 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-22T21:42:25.991 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-22T21:42:25.991 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-22T21:42:25.991 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-22T21:42:25.991 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 34/37 2026-02-22T21:42:25.991 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-22T21:42:25.991 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 36/37 2026-02-22T21:42:26.044 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-22T21:42:26.044 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:26.044 INFO:teuthology.orchestra.run.trial155.stdout:Upgraded: 2026-02-22T21:42:26.044 INFO:teuthology.orchestra.run.trial155.stdout: librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.044 INFO:teuthology.orchestra.run.trial155.stdout: librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.044 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-radosgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: ceph-selinux-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: libradosstriper1-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: librgw2-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-argparse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.045 INFO:teuthology.orchestra.run.trial155.stdout: python3-ceph-common-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: re2-1:20211101-20.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:26.046 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:26.087 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-test 2026-02-22T21:42:26.396 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:12 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:26.478 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:26.479 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 50 M 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 163 k 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:26.480 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:26.481 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:26.481 INFO:teuthology.orchestra.run.trial155.stdout:Install 5 Packages 2026-02-22T21:42:26.481 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:26.481 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 50 M 2026-02-22T21:42:26.481 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 212 M 2026-02-22T21:42:26.481 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:26.628 INFO:teuthology.orchestra.run.trial155.stdout:(1/5): libcephsqlite-19.2.3-689.gf90f4eae.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-22T21:42:27.315 INFO:teuthology.orchestra.run.trial155.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 300 kB/s | 233 kB 00:00 2026-02-22T21:42:27.421 INFO:teuthology.orchestra.run.trial155.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 383 kB/s | 303 kB 00:00 2026-02-22T21:42:27.548 INFO:teuthology.orchestra.run.trial155.stdout:(4/5): ceph-test-19.2.3-689.gf90f4eae.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-22T21:42:27.938 INFO:teuthology.orchestra.run.trial155.stdout:(5/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2026-02-22T21:42:27.941 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:27.941 INFO:teuthology.orchestra.run.trial155.stdout:Total 34 MB/s | 50 MB 00:01 2026-02-22T21:42:27.971 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:27.982 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:27.982 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:28.169 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:28.169 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:28.380 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:28.385 INFO:teuthology.orchestra.run.trial155.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-22T21:42:28.389 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-22T21:42:28.398 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-22T21:42:28.398 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T21:42:30.691 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 4/5 2026-02-22T21:42:30.710 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T21:42:30.927 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 5/5 2026-02-22T21:42:30.927 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 1/5 2026-02-22T21:42:30.927 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2/5 2026-02-22T21:42:30.927 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-22T21:42:30.928 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-22T21:42:30.981 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout: ceph-test-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout: libcephsqlite-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-22T21:42:30.982 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:30.983 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:31.014 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph 2026-02-22T21:42:31.320 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:17 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:31.407 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:31.410 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T21:42:31.410 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repository Size 2026-02-22T21:42:31.410 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T21:42:31.410 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 6.5 k 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout:Installing dependencies: 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 31 k 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 2.4 M 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.1 M 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 253 k 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 4.7 M 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 17 M 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 17 k 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 769 k 2026-02-22T21:42:31.411 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-22T21:42:31.412 INFO:teuthology.orchestra.run.trial155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-22T21:42:31.413 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-22T21:42:31.414 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-22T21:42:31.415 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-22T21:42:31.416 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-22T21:42:31.417 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout:Installing weak dependencies: 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 150 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 3.8 M 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 7.4 M 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 22 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 49 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume noarch 2:19.2.3-689.gf90f4eae.el9 ceph-noarch 299 k 2026-02-22T21:42:31.418 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-22T21:42:31.419 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-22T21:42:31.419 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:31.419 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:31.419 INFO:teuthology.orchestra.run.trial155.stdout:====================================================================================== 2026-02-22T21:42:31.419 INFO:teuthology.orchestra.run.trial155.stdout:Install 99 Packages 2026-02-22T21:42:31.419 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:31.420 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 95 M 2026-02-22T21:42:31.420 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 520 M 2026-02-22T21:42:31.420 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:32.043 INFO:teuthology.orchestra.run.trial155.stdout:(1/99): ceph-19.2.3-689.gf90f4eae.el9.x86_64.rp 118 kB/s | 6.5 kB 00:00 2026-02-22T21:42:32.110 INFO:teuthology.orchestra.run.trial155.stdout:(2/99): ceph-mgr-19.2.3-689.gf90f4eae.el9.x86_6 8.9 MB/s | 1.1 MB 00:00 2026-02-22T21:42:32.176 INFO:teuthology.orchestra.run.trial155.stdout:(3/99): ceph-mds-19.2.3-689.gf90f4eae.el9.x86_6 13 MB/s | 2.4 MB 00:00 2026-02-22T21:42:32.216 INFO:teuthology.orchestra.run.trial155.stdout:(4/99): ceph-grafana-dashboards-19.2.3-689.gf90 795 kB/s | 31 kB 00:00 2026-02-22T21:42:32.260 INFO:teuthology.orchestra.run.trial155.stdout:(5/99): ceph-mgr-cephadm-19.2.3-689.gf90f4eae.e 3.3 MB/s | 150 kB 00:00 2026-02-22T21:42:32.332 INFO:teuthology.orchestra.run.trial155.stdout:(6/99): ceph-mon-19.2.3-689.gf90f4eae.el9.x86_6 16 MB/s | 4.7 MB 00:00 2026-02-22T21:42:32.495 INFO:teuthology.orchestra.run.trial155.stdout:(7/99): ceph-mgr-dashboard-19.2.3-689.gf90f4eae 16 MB/s | 3.8 MB 00:00 2026-02-22T21:42:32.540 INFO:teuthology.orchestra.run.trial155.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-689.gf90f4eae 497 kB/s | 22 kB 00:00 2026-02-22T21:42:32.580 INFO:teuthology.orchestra.run.trial155.stdout:(9/99): ceph-mgr-modules-core-19.2.3-689.gf90f4 6.1 MB/s | 253 kB 00:00 2026-02-22T21:42:32.617 INFO:teuthology.orchestra.run.trial155.stdout:(10/99): ceph-mgr-rook-19.2.3-689.gf90f4eae.el9 1.3 MB/s | 49 kB 00:00 2026-02-22T21:42:32.655 INFO:teuthology.orchestra.run.trial155.stdout:(11/99): ceph-prometheus-alerts-19.2.3-689.gf90 446 kB/s | 17 kB 00:00 2026-02-22T21:42:32.697 INFO:teuthology.orchestra.run.trial155.stdout:(12/99): ceph-volume-19.2.3-689.gf90f4eae.el9.n 7.0 MB/s | 299 kB 00:00 2026-02-22T21:42:32.717 INFO:teuthology.orchestra.run.trial155.stdout:(13/99): ceph-mgr-diskprediction-local-19.2.3-6 19 MB/s | 7.4 MB 00:00 2026-02-22T21:42:32.740 INFO:teuthology.orchestra.run.trial155.stdout:(14/99): ceph-osd-19.2.3-689.gf90f4eae.el9.x86_ 27 MB/s | 17 MB 00:00 2026-02-22T21:42:32.741 INFO:teuthology.orchestra.run.trial155.stdout:(15/99): cephadm-19.2.3-689.gf90f4eae.el9.noarc 17 MB/s | 769 kB 00:00 2026-02-22T21:42:33.348 INFO:teuthology.orchestra.run.trial155.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 66 kB/s | 40 kB 00:00 2026-02-22T21:42:33.390 INFO:teuthology.orchestra.run.trial155.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 111 kB/s | 72 kB 00:00 2026-02-22T21:42:33.627 INFO:teuthology.orchestra.run.trial155.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 778 kB/s | 184 kB 00:00 2026-02-22T21:42:33.691 INFO:teuthology.orchestra.run.trial155.stdout:(19/99): cryptsetup-2.8.1-3.el9.x86_64.rpm 360 kB/s | 351 kB 00:00 2026-02-22T21:42:33.942 INFO:teuthology.orchestra.run.trial155.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 804 kB/s | 253 kB 00:00 2026-02-22T21:42:34.101 INFO:teuthology.orchestra.run.trial155.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 670 kB/s | 106 kB 00:00 2026-02-22T21:42:34.260 INFO:teuthology.orchestra.run.trial155.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 852 kB/s | 135 kB 00:00 2026-02-22T21:42:34.369 INFO:teuthology.orchestra.run.trial155.stdout:(23/99): libgfortran-11.5.0-14.el9.x86_64.rpm 778 kB/s | 794 kB 00:01 2026-02-22T21:42:34.418 INFO:teuthology.orchestra.run.trial155.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 949 kB/s | 150 kB 00:00 2026-02-22T21:42:34.478 INFO:teuthology.orchestra.run.trial155.stdout:(25/99): python3-cryptography-36.0.1-5.el9.x86_ 1.6 MB/s | 1.2 MB 00:00 2026-02-22T21:42:34.529 INFO:teuthology.orchestra.run.trial155.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 792 kB/s | 126 kB 00:00 2026-02-22T21:42:34.577 INFO:teuthology.orchestra.run.trial155.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 1.3 MB/s | 218 kB 00:00 2026-02-22T21:42:34.621 INFO:teuthology.orchestra.run.trial155.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 685 kB/s | 30 kB 00:00 2026-02-22T21:42:34.637 INFO:teuthology.orchestra.run.trial155.stdout:(29/99): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-22T21:42:34.662 INFO:teuthology.orchestra.run.trial155.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 603 kB/s | 15 kB 00:00 2026-02-22T21:42:34.687 INFO:teuthology.orchestra.run.trial155.stdout:(31/99): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-22T21:42:34.695 INFO:teuthology.orchestra.run.trial155.stdout:(32/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 40 MB/s | 3.0 MB 00:00 2026-02-22T21:42:34.700 INFO:teuthology.orchestra.run.trial155.stdout:(33/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 6.3 MB/s | 246 kB 00:00 2026-02-22T21:42:34.706 INFO:teuthology.orchestra.run.trial155.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 4.0 MB/s | 42 kB 00:00 2026-02-22T21:42:34.719 INFO:teuthology.orchestra.run.trial155.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 73 MB/s | 1.0 MB 00:00 2026-02-22T21:42:34.737 INFO:teuthology.orchestra.run.trial155.stdout:(36/99): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2026-02-22T21:42:34.755 INFO:teuthology.orchestra.run.trial155.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 167 MB/s | 6.0 MB 00:00 2026-02-22T21:42:34.756 INFO:teuthology.orchestra.run.trial155.stdout:(38/99): python3-devel-3.9.25-3.el9.x86_64.rpm 12 MB/s | 244 kB 00:00 2026-02-22T21:42:34.768 INFO:teuthology.orchestra.run.trial155.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 15 MB/s | 177 kB 00:00 2026-02-22T21:42:34.769 INFO:teuthology.orchestra.run.trial155.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 18 MB/s | 249 kB 00:00 2026-02-22T21:42:34.783 INFO:teuthology.orchestra.run.trial155.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 12 MB/s | 172 kB 00:00 2026-02-22T21:42:34.795 INFO:teuthology.orchestra.run.trial155.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 2.9 MB/s | 35 kB 00:00 2026-02-22T21:42:34.803 INFO:teuthology.orchestra.run.trial155.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 36 MB/s | 1.2 MB 00:00 2026-02-22T21:42:34.816 INFO:teuthology.orchestra.run.trial155.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 34 MB/s | 442 kB 00:00 2026-02-22T21:42:34.824 INFO:teuthology.orchestra.run.trial155.stdout:(45/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 43 MB/s | 5.3 MB 00:00 2026-02-22T21:42:34.826 INFO:teuthology.orchestra.run.trial155.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 7.2 MB/s | 77 kB 00:00 2026-02-22T21:42:34.836 INFO:teuthology.orchestra.run.trial155.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 151 MB/s | 6.1 MB 00:00 2026-02-22T21:42:34.836 INFO:teuthology.orchestra.run.trial155.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 15 MB/s | 159 kB 00:00 2026-02-22T21:42:34.837 INFO:teuthology.orchestra.run.trial155.stdout:(49/99): python3-protobuf-3.14.0-17.el9.noarch. 21 MB/s | 267 kB 00:00 2026-02-22T21:42:34.846 INFO:teuthology.orchestra.run.trial155.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 5.3 MB/s | 54 kB 00:00 2026-02-22T21:42:34.849 INFO:teuthology.orchestra.run.trial155.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 21 MB/s | 279 kB 00:00 2026-02-22T21:42:34.856 INFO:teuthology.orchestra.run.trial155.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 4.2 MB/s | 42 kB 00:00 2026-02-22T21:42:34.863 INFO:teuthology.orchestra.run.trial155.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 13 MB/s | 189 kB 00:00 2026-02-22T21:42:34.866 INFO:teuthology.orchestra.run.trial155.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 8.9 MB/s | 90 kB 00:00 2026-02-22T21:42:35.240 INFO:teuthology.orchestra.run.trial155.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 48 MB/s | 19 MB 00:00 2026-02-22T21:42:35.404 INFO:teuthology.orchestra.run.trial155.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 41 kB/s | 22 kB 00:00 2026-02-22T21:42:35.431 INFO:teuthology.orchestra.run.trial155.stdout:(57/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.8 MB/s | 551 kB 00:00 2026-02-22T21:42:35.455 INFO:teuthology.orchestra.run.trial155.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2026-02-22T21:42:35.486 INFO:teuthology.orchestra.run.trial155.stdout:(59/99): grpc-data-1.46.7-10.el9.noarch.rpm 237 kB/s | 19 kB 00:00 2026-02-22T21:42:35.489 INFO:teuthology.orchestra.run.trial155.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 16 MB/s | 548 kB 00:00 2026-02-22T21:42:35.510 INFO:teuthology.orchestra.run.trial155.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 2.8 MB/s | 60 kB 00:00 2026-02-22T21:42:35.517 INFO:teuthology.orchestra.run.trial155.stdout:(62/99): python3-autocommand-2.2.2-8.el9.noarch 953 kB/s | 29 kB 00:00 2026-02-22T21:42:35.531 INFO:teuthology.orchestra.run.trial155.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.1 MB/s | 43 kB 00:00 2026-02-22T21:42:35.546 INFO:teuthology.orchestra.run.trial155.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 1.1 MB/s | 32 kB 00:00 2026-02-22T21:42:35.551 INFO:teuthology.orchestra.run.trial155.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 694 kB/s | 14 kB 00:00 2026-02-22T21:42:35.579 INFO:teuthology.orchestra.run.trial155.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2026-02-22T21:42:35.605 INFO:teuthology.orchestra.run.trial155.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 9.7 MB/s | 254 kB 00:00 2026-02-22T21:42:35.609 INFO:teuthology.orchestra.run.trial155.stdout:(68/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.7 MB/s | 173 kB 00:00 2026-02-22T21:42:35.638 INFO:teuthology.orchestra.run.trial155.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 4.8 MB/s | 144 kB 00:00 2026-02-22T21:42:35.667 INFO:teuthology.orchestra.run.trial155.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 4.8 MB/s | 139 kB 00:00 2026-02-22T21:42:35.670 INFO:teuthology.orchestra.run.trial155.stdout:(71/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 31 MB/s | 2.0 MB 00:00 2026-02-22T21:42:35.690 INFO:teuthology.orchestra.run.trial155.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 2.4 MB/s | 56 kB 00:00 2026-02-22T21:42:35.690 INFO:teuthology.orchestra.run.trial155.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 526 kB/s | 11 kB 00:00 2026-02-22T21:42:35.710 INFO:teuthology.orchestra.run.trial155.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 889 kB/s | 18 kB 00:00 2026-02-22T21:42:35.711 INFO:teuthology.orchestra.run.trial155.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-22T21:42:35.730 INFO:teuthology.orchestra.run.trial155.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 987 kB/s | 20 kB 00:00 2026-02-22T21:42:35.731 INFO:teuthology.orchestra.run.trial155.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 943 kB/s | 19 kB 00:00 2026-02-22T21:42:35.751 INFO:teuthology.orchestra.run.trial155.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 1.2 MB/s | 26 kB 00:00 2026-02-22T21:42:35.763 INFO:teuthology.orchestra.run.trial155.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 32 MB/s | 1.0 MB 00:00 2026-02-22T21:42:35.770 INFO:teuthology.orchestra.run.trial155.stdout:(80/99): protobuf-compiler-3.14.0-17.el9.x86_64 954 kB/s | 862 kB 00:00 2026-02-22T21:42:35.772 INFO:teuthology.orchestra.run.trial155.stdout:(81/99): python3-logutils-0.3.5-21.el9.noarch.r 2.1 MB/s | 46 kB 00:00 2026-02-22T21:42:35.785 INFO:teuthology.orchestra.run.trial155.stdout:(82/99): python3-more-itertools-8.12.0-2.el9.no 3.6 MB/s | 79 kB 00:00 2026-02-22T21:42:35.795 INFO:teuthology.orchestra.run.trial155.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 2.5 MB/s | 58 kB 00:00 2026-02-22T21:42:35.809 INFO:teuthology.orchestra.run.trial155.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2026-02-22T21:42:35.815 INFO:teuthology.orchestra.run.trial155.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 798 kB/s | 16 kB 00:00 2026-02-22T21:42:35.830 INFO:teuthology.orchestra.run.trial155.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.1 MB/s | 90 kB 00:00 2026-02-22T21:42:35.836 INFO:teuthology.orchestra.run.trial155.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-22T21:42:35.853 INFO:teuthology.orchestra.run.trial155.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 8.2 MB/s | 188 kB 00:00 2026-02-22T21:42:35.859 INFO:teuthology.orchestra.run.trial155.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 2.6 MB/s | 59 kB 00:00 2026-02-22T21:42:35.874 INFO:teuthology.orchestra.run.trial155.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 5.7 MB/s | 125 kB 00:00 2026-02-22T21:42:35.880 INFO:teuthology.orchestra.run.trial155.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.7 MB/s | 36 kB 00:00 2026-02-22T21:42:35.890 INFO:teuthology.orchestra.run.trial155.stdout:(92/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 720 kB/s | 86 kB 00:00 2026-02-22T21:42:35.896 INFO:teuthology.orchestra.run.trial155.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 3.9 MB/s | 86 kB 00:00 2026-02-22T21:42:35.915 INFO:teuthology.orchestra.run.trial155.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 6.4 MB/s | 230 kB 00:00 2026-02-22T21:42:35.921 INFO:teuthology.orchestra.run.trial155.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 17 MB/s | 427 kB 00:00 2026-02-22T21:42:35.927 INFO:teuthology.orchestra.run.trial155.stdout:(96/99): python3-websocket-client-1.2.3-2.el9.n 2.4 MB/s | 90 kB 00:00 2026-02-22T21:42:35.936 INFO:teuthology.orchestra.run.trial155.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.3 MB/s | 48 kB 00:00 2026-02-22T21:42:35.942 INFO:teuthology.orchestra.run.trial155.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-22T21:42:35.950 INFO:teuthology.orchestra.run.trial155.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 885 kB/s | 20 kB 00:00 2026-02-22T21:42:35.952 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:35.953 INFO:teuthology.orchestra.run.trial155.stdout:Total 21 MB/s | 95 MB 00:04 2026-02-22T21:42:36.383 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:36.421 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:36.422 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:36.840 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:36.840 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:37.306 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:37.308 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-22T21:42:37.339 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-22T21:42:37.344 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-22T21:42:37.365 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-22T21:42:37.372 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-22T21:42:37.405 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-22T21:42:37.415 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-22T21:42:37.420 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-22T21:42:37.422 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-22T21:42:37.427 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-22T21:42:37.450 INFO:teuthology.orchestra.run.trial155.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-22T21:42:37.463 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-22T21:42:37.466 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-22T21:42:37.474 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-22T21:42:37.476 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-22T21:42:37.487 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-22T21:42:37.493 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-22T21:42:37.517 INFO:teuthology.orchestra.run.trial155.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-22T21:42:37.520 INFO:teuthology.orchestra.run.trial155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-22T21:42:37.527 INFO:teuthology.orchestra.run.trial155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-22T21:42:37.552 INFO:teuthology.orchestra.run.trial155.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-22T21:42:37.603 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-22T21:42:37.615 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-22T21:42:37.618 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-22T21:42:37.623 INFO:teuthology.orchestra.run.trial155.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-22T21:42:37.628 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-22T21:42:37.632 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-22T21:42:37.636 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-22T21:42:37.650 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-22T21:42:37.671 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-22T21:42:37.675 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-22T21:42:37.680 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-22T21:42:37.692 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-22T21:42:37.701 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-22T21:42:37.707 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-22T21:42:37.726 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-22T21:42:37.735 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-22T21:42:37.790 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-22T21:42:37.802 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-22T21:42:37.817 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-22T21:42:37.822 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-22T21:42:37.830 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-22T21:42:37.870 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-22T21:42:38.195 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-22T21:42:38.205 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-22T21:42:38.209 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-22T21:42:38.215 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-22T21:42:38.216 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-22T21:42:38.244 INFO:teuthology.orchestra.run.trial155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-22T21:42:38.289 INFO:teuthology.orchestra.run.trial155.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-22T21:42:38.295 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-22T21:42:38.299 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-22T21:42:38.304 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-22T21:42:38.308 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-22T21:42:38.315 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-22T21:42:38.318 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-22T21:42:38.346 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-22T21:42:38.356 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-22T21:42:38.391 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-22T21:42:38.614 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 60/99 2026-02-22T21:42:38.638 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-22T21:42:38.642 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-22T21:42:38.701 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-22T21:42:38.703 INFO:teuthology.orchestra.run.trial155.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-22T21:42:38.724 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-22T21:42:39.050 INFO:teuthology.orchestra.run.trial155.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-22T21:42:39.123 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-22T21:42:39.794 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-22T21:42:39.811 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-22T21:42:39.821 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-22T21:42:39.828 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-22T21:42:39.842 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-22T21:42:39.857 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-22T21:42:39.933 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-22T21:42:39.941 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-22T21:42:39.965 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-22T21:42:39.994 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-22T21:42:40.045 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-22T21:42:40.051 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-22T21:42:40.054 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-22T21:42:40.056 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-22T21:42:40.073 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T21:42:40.074 INFO:teuthology.orchestra.run.trial155.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-22T21:42:40.074 INFO:teuthology.orchestra.run.trial155.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-22T21:42:40.074 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:40.081 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T21:42:40.107 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-22T21:42:40.107 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-22T21:42:40.107 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:40.142 INFO:teuthology.orchestra.run.trial155.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-22T21:42:40.206 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 84/99 2026-02-22T21:42:40.209 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T21:42:40.223 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 85/99 2026-02-22T21:42:40.223 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:40.223 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-22T21:42:40.224 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:40.966 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T21:42:40.992 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 86/99 2026-02-22T21:42:40.992 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:40.992 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-22T21:42:40.992 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T21:42:40.992 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-22T21:42:40.993 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:41.052 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T21:42:41.053 INFO:teuthology.orchestra.run.trial155.stdout: Installing : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 87/99 2026-02-22T21:42:41.058 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 88/99 2026-02-22T21:42:41.078 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 89/99 2026-02-22T21:42:41.079 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T21:42:41.579 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 90/99 2026-02-22T21:42:41.582 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T21:42:42.056 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 91/99 2026-02-22T21:42:42.057 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T21:42:42.071 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 92/99 2026-02-22T21:42:42.071 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T21:42:42.128 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 93/99 2026-02-22T21:42:42.177 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 94/99 2026-02-22T21:42:42.178 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T21:42:42.200 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 95/99 2026-02-22T21:42:42.201 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:42.201 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-22T21:42:42.201 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T21:42:42.201 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-22T21:42:42.201 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:42.212 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T21:42:42.438 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 96/99 2026-02-22T21:42:42.439 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T21:42:42.462 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 97/99 2026-02-22T21:42:42.462 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:42.463 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-22T21:42:42.463 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T21:42:42.463 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-22T21:42:42.463 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:42.569 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T21:42:42.590 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 98/99 2026-02-22T21:42:42.590 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:42.590 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-22T21:42:42.591 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T21:42:42.591 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-22T21:42:42.591 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:42.608 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T21:42:43.300 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 99/99 2026-02-22T21:42:43.300 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 1/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 3/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 4/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 5/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9 6/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 7/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noar 8/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4e 9/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noar 10/99 2026-02-22T21:42:43.301 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.n 11/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 12/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9. 13/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 14/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 15/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-22T21:42:43.302 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-22T21:42:43.303 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-22T21:42:43.304 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-22T21:42:43.305 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-22T21:42:43.306 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-22T21:42:43.307 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-22T21:42:43.359 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-22T21:42:43.359 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-grafana-dashboards-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mds-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.360 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-k8sevents-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-modules-core-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: ceph-mon-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: ceph-osd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: ceph-prometheus-alerts-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: cephadm-2:19.2.3-689.gf90f4eae.el9.noarch 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-22T21:42:43.361 INFO:teuthology.orchestra.run.trial155.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: lua-5.4.4-4.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-22T21:42:43.362 INFO:teuthology.orchestra.run.trial155.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-22T21:42:43.363 INFO:teuthology.orchestra.run.trial155.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-22T21:42:43.364 INFO:teuthology.orchestra.run.trial155.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-22T21:42:43.365 INFO:teuthology.orchestra.run.trial155.stdout: python3-ply-3.11-14.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-22T21:42:43.366 INFO:teuthology.orchestra.run.trial155.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: unzip-6.0-59.el9.x86_64 2026-02-22T21:42:43.367 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-22T21:42:43.368 INFO:teuthology.orchestra.run.trial155.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-22T21:42:43.368 INFO:teuthology.orchestra.run.trial155.stdout: zip-3.0-35.el9.x86_64 2026-02-22T21:42:43.368 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:43.368 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:43.413 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-base 2026-02-22T21:42:43.722 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:29 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:43.786 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-base-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:43.804 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:43.805 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:43.805 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:43.825 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install cephadm 2026-02-22T21:42:44.129 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:30 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:44.193 INFO:teuthology.orchestra.run.trial155.stdout:Package cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T21:42:44.212 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:44.212 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:44.212 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:44.233 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-immutable-object-cache 2026-02-22T21:42:44.538 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:30 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:44.621 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:44.621 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:44.621 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T21:42:44.621 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 145 k 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 145 k 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 431 k 2026-02-22T21:42:44.622 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:44.761 INFO:teuthology.orchestra.run.trial155.stdout:ceph-immutable-object-cache-19.2.3-689.gf90f4ea 1.0 MB/s | 145 kB 00:00 2026-02-22T21:42:44.762 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:44.762 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.0 MB/s | 145 kB 00:00 2026-02-22T21:42:44.762 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:44.765 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:44.765 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:44.797 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:44.797 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:44.852 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:44.853 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T21:42:44.874 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T21:42:44.874 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:44.874 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-22T21:42:44.875 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:45.193 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.e 1/1 2026-02-22T21:42:45.193 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:45.193 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:45.193 INFO:teuthology.orchestra.run.trial155.stdout: ceph-immutable-object-cache-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:45.193 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:45.193 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:45.220 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr 2026-02-22T21:42:45.532 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:31 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:45.596 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:45.614 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:45.615 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:45.615 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:45.636 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-dashboard 2026-02-22T21:42:45.944 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:31 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:46.008 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-dashboard-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T21:42:46.027 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:46.027 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:46.027 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:46.048 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-22T21:42:46.354 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:32 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:46.418 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T21:42:46.436 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:46.437 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:46.437 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:46.458 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-rook 2026-02-22T21:42:46.766 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:32 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:46.831 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-rook-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T21:42:46.849 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:46.850 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:46.850 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:46.871 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-mgr-cephadm 2026-02-22T21:42:47.177 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:33 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:47.242 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-mgr-cephadm-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T21:42:47.260 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:47.261 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:47.261 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:47.282 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-fuse 2026-02-22T21:42:47.590 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:33 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:47.673 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:47.673 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:47.673 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T21:42:47.673 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 1.2 M 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 1.2 M 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 3.6 M 2026-02-22T21:42:47.674 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:47.797 INFO:teuthology.orchestra.run.trial155.stdout:ceph-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 9.3 MB/s | 1.2 MB 00:00 2026-02-22T21:42:47.798 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:47.798 INFO:teuthology.orchestra.run.trial155.stdout:Total 9.2 MB/s | 1.2 MB 00:00 2026-02-22T21:42:47.798 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:47.802 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:47.802 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:47.838 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:47.838 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:47.943 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:47.960 INFO:teuthology.orchestra.run.trial155.stdout: Installing : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:48.171 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:48.227 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:48.227 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:48.228 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:48.228 INFO:teuthology.orchestra.run.trial155.stdout: ceph-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:48.228 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:48.228 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:48.255 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install ceph-volume 2026-02-22T21:42:48.566 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:34 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:48.631 INFO:teuthology.orchestra.run.trial155.stdout:Package ceph-volume-2:19.2.3-689.gf90f4eae.el9.noarch is already installed. 2026-02-22T21:42:48.650 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:48.650 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:48.650 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:48.671 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados-devel 2026-02-22T21:42:48.983 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:34 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:49.066 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 126 k 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:49.067 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:49.068 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T21:42:49.068 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:49.068 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 126 k 2026-02-22T21:42:49.068 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 456 k 2026-02-22T21:42:49.068 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:49.154 INFO:teuthology.orchestra.run.trial155.stdout:librados-devel-19.2.3-689.gf90f4eae.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-22T21:42:49.155 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:49.155 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-22T21:42:49.155 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:49.157 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:49.158 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:49.190 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:49.190 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:49.244 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:49.260 INFO:teuthology.orchestra.run.trial155.stdout: Installing : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:49.340 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:49.398 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:49.398 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:49.398 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:49.398 INFO:teuthology.orchestra.run.trial155.stdout: librados-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:49.398 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:49.398 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:49.426 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs2 2026-02-22T21:42:49.737 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:35 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:49.802 INFO:teuthology.orchestra.run.trial155.stdout:Package libcephfs2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:49.820 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:49.821 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:49.821 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:49.841 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install libcephfs-devel 2026-02-22T21:42:50.151 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:36 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:50.233 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 34 k 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 34 k 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 153 k 2026-02-22T21:42:50.234 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:50.299 INFO:teuthology.orchestra.run.trial155.stdout:libcephfs-devel-19.2.3-689.gf90f4eae.el9.x86_64 522 kB/s | 34 kB 00:00 2026-02-22T21:42:50.300 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:50.300 INFO:teuthology.orchestra.run.trial155.stdout:Total 514 kB/s | 34 kB 00:00 2026-02-22T21:42:50.300 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:50.301 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:50.301 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:50.304 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:50.304 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:50.325 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:50.341 INFO:teuthology.orchestra.run.trial155.stdout: Installing : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:50.400 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:50.458 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:50.458 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:50.458 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:50.459 INFO:teuthology.orchestra.run.trial155.stdout: libcephfs-devel-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:50.459 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:50.459 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:50.487 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librados2 2026-02-22T21:42:50.793 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:36 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:50.857 INFO:teuthology.orchestra.run.trial155.stdout:Package librados2-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:50.875 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:50.876 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:50.876 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:50.896 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install librbd1 2026-02-22T21:42:51.200 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:51.264 INFO:teuthology.orchestra.run.trial155.stdout:Package librbd1-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:51.282 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:51.283 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:51.283 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:51.304 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rados 2026-02-22T21:42:51.616 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:37 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:51.681 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rados-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:51.700 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:51.700 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:51.701 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:51.722 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rgw 2026-02-22T21:42:52.033 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:52.098 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rgw-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:52.116 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:52.117 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:52.117 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:52.138 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-cephfs 2026-02-22T21:42:52.444 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:52.509 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-cephfs-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:52.527 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:52.528 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:52.528 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:52.549 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install python3-rbd 2026-02-22T21:42:52.856 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:38 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:52.921 INFO:teuthology.orchestra.run.trial155.stdout:Package python3-rbd-2:19.2.3-689.gf90f4eae.el9.x86_64 is already installed. 2026-02-22T21:42:52.939 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:52.940 INFO:teuthology.orchestra.run.trial155.stdout:Nothing to do. 2026-02-22T21:42:52.940 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:52.961 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-fuse 2026-02-22T21:42:53.270 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:39 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:53.353 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 85 k 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 85 k 2026-02-22T21:42:53.354 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 227 k 2026-02-22T21:42:53.355 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:53.505 INFO:teuthology.orchestra.run.trial155.stdout:rbd-fuse-19.2.3-689.gf90f4eae.el9.x86_64.rpm 568 kB/s | 85 kB 00:00 2026-02-22T21:42:53.505 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:53.505 INFO:teuthology.orchestra.run.trial155.stdout:Total 565 kB/s | 85 kB 00:00 2026-02-22T21:42:53.505 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:53.508 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:53.509 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:53.540 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:53.540 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:53.591 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:53.607 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:53.690 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:53.747 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:53.748 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:53.748 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:53.748 INFO:teuthology.orchestra.run.trial155.stdout: rbd-fuse-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:53.748 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:53.748 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:53.775 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-mirror 2026-02-22T21:42:54.091 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:40 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:54.174 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout: Package Arch Version Repo Size 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 3.1 M 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 3.1 M 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 13 M 2026-02-22T21:42:54.175 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:54.328 INFO:teuthology.orchestra.run.trial155.stdout:rbd-mirror-19.2.3-689.gf90f4eae.el9.x86_64.rpm 20 MB/s | 3.1 MB 00:00 2026-02-22T21:42:54.329 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:54.329 INFO:teuthology.orchestra.run.trial155.stdout:Total 20 MB/s | 3.1 MB 00:00 2026-02-22T21:42:54.329 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:54.333 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:54.333 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:54.374 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:54.374 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:54.565 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:54.567 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:54.591 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:54.591 INFO:teuthology.orchestra.run.trial155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-22T21:42:54.592 INFO:teuthology.orchestra.run.trial155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-22T21:42:54.592 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T21:42:54.592 INFO:teuthology.orchestra.run.trial155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-22T21:42:54.592 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:54.907 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:54.907 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:54.907 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:54.907 INFO:teuthology.orchestra.run.trial155.stdout: rbd-mirror-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:54.907 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:54.907 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:54.935 DEBUG:teuthology.orchestra.run.trial155:> sudo yum -y install rbd-nbd 2026-02-22T21:42:55.243 INFO:teuthology.orchestra.run.trial155.stdout:Last metadata expiration check: 0:00:41 ago on Sun 22 Feb 2026 09:42:14 PM UTC. 2026-02-22T21:42:55.327 INFO:teuthology.orchestra.run.trial155.stdout:Dependencies resolved. 2026-02-22T21:42:55.327 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:55.327 INFO:teuthology.orchestra.run.trial155.stdout: Package Architecture Version Repository Size 2026-02-22T21:42:55.327 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:55.327 INFO:teuthology.orchestra.run.trial155.stdout:Installing: 2026-02-22T21:42:55.327 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd x86_64 2:19.2.3-689.gf90f4eae.el9 ceph 170 k 2026-02-22T21:42:55.327 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:55.328 INFO:teuthology.orchestra.run.trial155.stdout:Transaction Summary 2026-02-22T21:42:55.328 INFO:teuthology.orchestra.run.trial155.stdout:================================================================================ 2026-02-22T21:42:55.328 INFO:teuthology.orchestra.run.trial155.stdout:Install 1 Package 2026-02-22T21:42:55.328 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:55.328 INFO:teuthology.orchestra.run.trial155.stdout:Total download size: 170 k 2026-02-22T21:42:55.328 INFO:teuthology.orchestra.run.trial155.stdout:Installed size: 490 k 2026-02-22T21:42:55.328 INFO:teuthology.orchestra.run.trial155.stdout:Downloading Packages: 2026-02-22T21:42:55.414 INFO:teuthology.orchestra.run.trial155.stdout:rbd-nbd-19.2.3-689.gf90f4eae.el9.x86_64.rpm 1.9 MB/s | 170 kB 00:00 2026-02-22T21:42:55.415 INFO:teuthology.orchestra.run.trial155.stdout:-------------------------------------------------------------------------------- 2026-02-22T21:42:55.415 INFO:teuthology.orchestra.run.trial155.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-22T21:42:55.415 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction check 2026-02-22T21:42:55.419 INFO:teuthology.orchestra.run.trial155.stdout:Transaction check succeeded. 2026-02-22T21:42:55.419 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction test 2026-02-22T21:42:55.451 INFO:teuthology.orchestra.run.trial155.stdout:Transaction test succeeded. 2026-02-22T21:42:55.451 INFO:teuthology.orchestra.run.trial155.stdout:Running transaction 2026-02-22T21:42:55.510 INFO:teuthology.orchestra.run.trial155.stdout: Preparing : 1/1 2026-02-22T21:42:55.527 INFO:teuthology.orchestra.run.trial155.stdout: Installing : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:55.611 INFO:teuthology.orchestra.run.trial155.stdout: Running scriptlet: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:55.668 INFO:teuthology.orchestra.run.trial155.stdout: Verifying : rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 1/1 2026-02-22T21:42:55.668 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:55.668 INFO:teuthology.orchestra.run.trial155.stdout:Installed: 2026-02-22T21:42:55.668 INFO:teuthology.orchestra.run.trial155.stdout: rbd-nbd-2:19.2.3-689.gf90f4eae.el9.x86_64 2026-02-22T21:42:55.668 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:55.669 INFO:teuthology.orchestra.run.trial155.stdout:Complete! 2026-02-22T21:42:55.700 DEBUG:teuthology.parallel:result is None 2026-02-22T21:42:55.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:42:55.857 DEBUG:teuthology.orchestra.run.trial155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-22T21:42:55.878 INFO:teuthology.orchestra.run.trial155.stdout:19.2.3-689.gf90f4eae.el9 2026-02-22T21:42:55.878 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.gf90f4eae.el9 2026-02-22T21:42:55.878 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.gf90f4eae is installed. 2026-02-22T21:42:55.881 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T21:42:55.881 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:55.881 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T21:42:55.943 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T21:42:55.943 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:55.943 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T21:42:56.007 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T21:42:56.069 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T21:42:56.069 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:56.069 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T21:42:56.134 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T21:42:56.198 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T21:42:56.198 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:56.198 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T21:42:56.262 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T21:42:56.326 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T21:42:56.399 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T21:42:56.399 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 777 /var/log/ceph 2026-02-22T21:42:56.423 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T21:42:56.424 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T21:42:56.486 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T21:42:56.487 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T21:42:56.559 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T21:42:56.559 INFO:tasks.ceph:config {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-22T21:42:56.559 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64097', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64097', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0']], 'seed': 5907, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHr1F9TEWccXVN01kPAWpzI7ZBuwbH49p/Uy8ItjRxnioqasPpyhyO5iP8D3wCFiZew6obj/M3dJJxSOk/EFhM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'log-ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['rados/test_health_warnings.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:40', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T21:42:56.560 DEBUG:teuthology.orchestra.run.trial155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T21:42:56.606 DEBUG:teuthology.orchestra.run.trial155:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T21:42:56.671 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:56.671 DEBUG:teuthology.orchestra.run.trial155:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T21:42:56.728 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T21:42:56.729 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_1 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 21:42:54.734342595 +0000 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:56.786 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:56.787 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T21:42:56.851 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T21:42:56.851 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T21:42:56.851 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000144977 s, 3.5 MB/s 2026-02-22T21:42:56.852 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T21:42:56.909 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_2 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 21:42:54.734342595 +0000 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:56.965 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:56.965 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T21:42:57.028 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T21:42:57.028 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T21:42:57.028 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.00014635 s, 3.5 MB/s 2026-02-22T21:42:57.029 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T21:42:57.086 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_3 2026-02-22T21:42:57.141 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T21:42:57.141 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:42:57.141 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-22T21:42:57.142 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:42:57.142 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T21:42:57.142 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 21:42:54.734342595 +0000 2026-02-22T21:42:57.142 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:57.142 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:57.142 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:57.142 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T21:42:57.205 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T21:42:57.206 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T21:42:57.206 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000143855 s, 3.6 MB/s 2026-02-22T21:42:57.207 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T21:42:57.264 DEBUG:teuthology.orchestra.run.trial155:> stat /dev/vg_nvme/lv_4 2026-02-22T21:42:57.321 INFO:teuthology.orchestra.run.trial155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T21:42:57.321 INFO:teuthology.orchestra.run.trial155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T21:42:57.322 INFO:teuthology.orchestra.run.trial155.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-22T21:42:57.322 INFO:teuthology.orchestra.run.trial155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T21:42:57.322 INFO:teuthology.orchestra.run.trial155.stdout:Context: system_u:object_r:device_t:s0 2026-02-22T21:42:57.322 INFO:teuthology.orchestra.run.trial155.stdout:Access: 2026-02-22 21:42:54.734342595 +0000 2026-02-22T21:42:57.322 INFO:teuthology.orchestra.run.trial155.stdout:Modify: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:57.322 INFO:teuthology.orchestra.run.trial155.stdout:Change: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:57.322 INFO:teuthology.orchestra.run.trial155.stdout: Birth: 2026-02-22 21:42:19.284700729 +0000 2026-02-22T21:42:57.322 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T21:42:57.384 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records in 2026-02-22T21:42:57.385 INFO:teuthology.orchestra.run.trial155.stderr:1+0 records out 2026-02-22T21:42:57.385 INFO:teuthology.orchestra.run.trial155.stderr:512 bytes copied, 0.000132484 s, 3.9 MB/s 2026-02-22T21:42:57.386 DEBUG:teuthology.orchestra.run.trial155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T21:42:57.443 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:42:57.443 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-22T21:42:57.443 INFO:tasks.ceph:Generating config... 2026-02-22T21:42:57.444 INFO:tasks.ceph:[osd] osd max object name len = 400 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd max object namespace len = 64 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-22T21:42:57.445 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-22T21:42:57.445 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-22T21:42:57.445 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T21:42:57.445 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T21:42:57.445 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T21:42:57.445 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T21:42:57.445 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T21:42:57.445 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-22T21:42:57.445 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T21:42:57.446 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T21:42:57.519 INFO:teuthology.orchestra.run.trial155.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T21:42:57.522 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T21:42:57.600 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T21:42:57.667 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.155')] 2026-02-22T21:42:57.667 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.155', 'mon election default strategy': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-22T21:42:57.668 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:57.668 DEBUG:teuthology.orchestra.run.trial155:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T21:42:57.725 DEBUG:teuthology.orchestra.run.trial155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.155 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:42:57.796 INFO:teuthology.orchestra.run.trial155.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:42:57.796 INFO:teuthology.orchestra.run.trial155.stdout:monmaptool: generated fsid c45bd854-fea0-47c3-9758-4cd66777c959 2026-02-22T21:42:57.796 INFO:teuthology.orchestra.run.trial155.stdout:setting min_mon_release = quincy 2026-02-22T21:42:57.796 INFO:teuthology.orchestra.run.trial155.stdout:epoch 0 2026-02-22T21:42:57.796 INFO:teuthology.orchestra.run.trial155.stdout:fsid c45bd854-fea0-47c3-9758-4cd66777c959 2026-02-22T21:42:57.796 INFO:teuthology.orchestra.run.trial155.stdout:last_changed 2026-02-22T21:42:57.793956+0000 2026-02-22T21:42:57.796 INFO:teuthology.orchestra.run.trial155.stdout:created 2026-02-22T21:42:57.793956+0000 2026-02-22T21:42:57.797 INFO:teuthology.orchestra.run.trial155.stdout:min_mon_release 17 (quincy) 2026-02-22T21:42:57.797 INFO:teuthology.orchestra.run.trial155.stdout:election_strategy: 1 2026-02-22T21:42:57.797 INFO:teuthology.orchestra.run.trial155.stdout:0: [v2:10.20.193.155:3300/0,v1:10.20.193.155:6789/0] mon.a 2026-02-22T21:42:57.797 INFO:teuthology.orchestra.run.trial155.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-22T21:42:57.798 DEBUG:teuthology.orchestra.run.trial155:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T21:42:57.854 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c45bd854-fea0-47c3-9758-4cd66777c959... 2026-02-22T21:42:57.855 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T21:42:57.936 INFO:teuthology.orchestra.run.trial155.stdout:[global] 2026-02-22T21:42:57.936 INFO:teuthology.orchestra.run.trial155.stdout: chdir = "" 2026-02-22T21:42:57.936 INFO:teuthology.orchestra.run.trial155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: auth supported = cephx 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: filestore xattr use omap = true 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: mon clock drift allowed = 1.000 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: osd crush chooseleaf type = 0 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: auth debug = true 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: ms die on old message = true 2026-02-22T21:42:57.937 INFO:teuthology.orchestra.run.trial155.stdout: ms die on bug = true 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: mon pg warn max object skew = 0 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default size = 2 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow primary affinity = true 2026-02-22T21:42:57.938 INFO:teuthology.orchestra.run.trial155.stdout: mon osd allow pg remap = true 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on legacy crush tunables = false 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on crush straw calc version zero = false 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on no sortbitwise = false 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on osd down out interval zero = false 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon warn on too few osds = false 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: mon_allow_pool_size_one = true 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.939 INFO:teuthology.orchestra.run.trial155.stdout: osd default data pool replay window = 5 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: mon allow pool delete = true 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: mon cluster log file level = debug 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: debug asserts on shutdown = true 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: mon health detail to clog = false 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: mon host = 10.20.193.155 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: mon election default strategy = 1 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: fsid = c45bd854-fea0-47c3-9758-4cd66777c959 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout:[osd] 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: osd journal size = 100 2026-02-22T21:42:57.940 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub load threshold = 5.0 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd scrub max interval = 600 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock profile = high_recovery_ops 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock skip benchmark = True 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd recover clone overlap = true 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd recovery max chunk = 1048576 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd debug shutdown = true 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd debug op order = true 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify stray on activate = true 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: osd debug trim objects = true 2026-02-22T21:42:57.941 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: osd open classes on start = true 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: osd debug pg log writeout = true 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: osd deep scrub update digest min age = 30 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: osd map max advance = 10 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: journal zero on create = true 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: filestore ondisk finisher threads = 3 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: filestore apply finisher threads = 3 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.942 INFO:teuthology.orchestra.run.trial155.stdout: bdev debug aio = true 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd debug misdirected ops = true 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd max object name len = 400 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd max object namespace len = 64 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: bluestore zero block detection = True 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: debug osd = 20 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify cached snaps = True 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd debug verify missing on start = True 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd mclock override recovery settings = True 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue = debug_random 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: osd op queue cut off = debug_random 2026-02-22T21:42:57.943 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout:[mgr] 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: debug mgr = 20 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: mgr/telemetry/nag = false 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout:[mon] 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: debug ms = 1 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: debug mon = 20 2026-02-22T21:42:57.944 INFO:teuthology.orchestra.run.trial155.stdout: debug paxos = 20 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: debug auth = 20 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: mon data avail warn = 5 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: mon mgr mkfs grace = 240 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min pgs per osd = 4 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: mon osd reporter subtree level = osd 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: mon osd prime pg temp = true 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: mon reweight min bytes per osd = 10 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.945 INFO:teuthology.orchestra.run.trial155.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: # 1m isn't quite enough 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: mon_down_mkfs_grace = 2m 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: mon_warn_on_filestore_osds = false 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: mon scrub interval = 300 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout:[client] 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: rgw cache enabled = true 2026-02-22T21:42:57.946 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable ops log = true 2026-02-22T21:42:57.947 INFO:teuthology.orchestra.run.trial155.stdout: rgw enable usage log = true 2026-02-22T21:42:57.947 INFO:teuthology.orchestra.run.trial155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T21:42:57.947 INFO:teuthology.orchestra.run.trial155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T21:42:57.947 INFO:teuthology.orchestra.run.trial155.stdout:[mon.a] 2026-02-22T21:42:57.948 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T21:42:57.948 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T21:42:58.033 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T21:42:58.033 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:58.033 DEBUG:teuthology.orchestra.run.trial155:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T21:42:58.050 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:58.050 DEBUG:teuthology.orchestra.run.trial155:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T21:42:58.107 INFO:tasks.ceph:Sending monmap to node ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:42:58.107 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:58.107 DEBUG:teuthology.orchestra.run.trial155:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T21:42:58.107 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T21:42:58.180 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:42:58.180 DEBUG:teuthology.orchestra.run.trial155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:42:58.236 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T21:42:58.236 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T21:42:58.237 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T21:42:58.320 INFO:teuthology.orchestra.run.trial155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T21:42:58.323 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T21:42:58.323 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T21:42:58.324 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T21:42:58.359 INFO:teuthology.orchestra.run.trial155.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T21:42:58.370 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T21:42:58.371 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-22T21:42:58.371 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T21:42:58.435 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:42:58.435 INFO:tasks.ceph:role: osd.0 2026-02-22T21:42:58.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:42:58.435 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T21:42:58.500 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T21:42:59.071 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T21:42:59.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T21:42:59.073 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T21:42:59.141 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T21:42:59.209 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T21:42:59.272 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:42:59.272 INFO:tasks.ceph:role: osd.1 2026-02-22T21:42:59.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:42:59.273 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T21:42:59.337 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T21:42:59.337 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T21:42:59.338 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T21:42:59.896 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T21:42:59.899 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T21:42:59.899 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T21:42:59.969 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T21:43:00.037 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T21:43:00.102 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:00.102 INFO:tasks.ceph:role: osd.2 2026-02-22T21:43:00.102 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:43:00.102 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T21:43:00.168 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T21:43:00.169 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T21:43:00.728 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T21:43:00.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T21:43:00.731 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T21:43:00.800 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T21:43:00.866 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-22T21:43:00.930 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:00.930 INFO:tasks.ceph:role: osd.3 2026-02-22T21:43:00.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:43:00.930 DEBUG:teuthology.orchestra.run.trial155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout: = sunit=0 swidth=0 blks 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T21:43:00.995 INFO:teuthology.orchestra.run.trial155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T21:43:01.552 INFO:teuthology.orchestra.run.trial155.stdout:Discarding blocks...Done. 2026-02-22T21:43:01.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial155.front.sepia.ceph.com -o noatime 2026-02-22T21:43:01.555 DEBUG:teuthology.orchestra.run.trial155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-22T21:43:01.622 DEBUG:teuthology.orchestra.run.trial155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-22T21:43:01.689 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-22T21:43:01.753 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:01.754 INFO:tasks.ceph:role: osd.4 2026-02-22T21:43:01.754 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-22T21:43:01.818 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:01.818 INFO:tasks.ceph:role: osd.5 2026-02-22T21:43:01.818 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-22T21:43:01.882 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:01.882 INFO:tasks.ceph:role: osd.6 2026-02-22T21:43:01.882 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-22T21:43:01.946 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:01.946 INFO:tasks.ceph:role: osd.7 2026-02-22T21:43:01.947 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-22T21:43:02.012 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:02.012 INFO:tasks.ceph:role: osd.8 2026-02-22T21:43:02.012 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-22T21:43:02.077 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T21:43:02.077 INFO:tasks.ceph:role: osd.9 2026-02-22T21:43:02.077 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:02.156 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:02.153+0000 7f0d950d2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T21:43:02.157 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:02.153+0000 7f0d950d2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T21:43:02.157 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:02.153+0000 7f0d950d2780 -1 bdev(0x55cdf5471800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:02.157 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:02.153+0000 7f0d950d2780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T21:43:04.520 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T21:43:04.586 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:04.664 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:04.660+0000 7f8d04dd2780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T21:43:04.665 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:04.661+0000 7f8d04dd2780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T21:43:04.665 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:04.661+0000 7f8d04dd2780 -1 bdev(0x564c3b42f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:04.665 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:04.661+0000 7f8d04dd2780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T21:43:07.047 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T21:43:07.113 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:07.190 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:07.186+0000 7f227270e780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T21:43:07.191 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:07.186+0000 7f227270e780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T21:43:07.191 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:07.186+0000 7f227270e780 -1 bdev(0x55c609725800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:07.191 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:07.186+0000 7f227270e780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T21:43:09.307 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T21:43:09.375 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:09.454 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:09.449+0000 7fbae8c1a780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-22T21:43:09.454 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:09.449+0000 7fbae8c1a780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-22T21:43:09.454 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:09.449+0000 7fbae8c1a780 -1 bdev(0x56306d851800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:09.454 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:09.449+0000 7fbae8c1a780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-22T21:43:11.815 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-22T21:43:11.881 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:11.957 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:11.953+0000 7f196a0c6780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-22T21:43:11.958 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:11.953+0000 7f196a0c6780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-22T21:43:11.958 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:11.953+0000 7f196a0c6780 -1 bdev(0x562413a65800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:11.958 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:11.953+0000 7f196a0c6780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-22T21:43:14.316 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-22T21:43:14.381 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:14.459 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:14.454+0000 7f4fdbb3b780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-22T21:43:14.459 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:14.454+0000 7f4fdbb3b780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-22T21:43:14.459 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:14.454+0000 7f4fdbb3b780 -1 bdev(0x561f7ce87800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:14.459 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:14.454+0000 7f4fdbb3b780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-22T21:43:16.816 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-22T21:43:16.882 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:16.960 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:16.956+0000 7f31c19a7780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-22T21:43:16.960 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:16.956+0000 7f31c19a7780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-22T21:43:16.960 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:16.956+0000 7f31c19a7780 -1 bdev(0x55a3e3e6b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:16.960 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:16.956+0000 7f31c19a7780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-22T21:43:19.070 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-22T21:43:19.136 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:19.212 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:19.209+0000 7faff923f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-22T21:43:19.213 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:19.209+0000 7faff923f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-22T21:43:19.213 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:19.209+0000 7faff923f780 -1 bdev(0x55f3226e9800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:19.213 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:19.209+0000 7faff923f780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-22T21:43:21.576 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-22T21:43:21.640 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:21.718 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:21.715+0000 7f937c227780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-22T21:43:21.719 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:21.715+0000 7f937c227780 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-22T21:43:21.719 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:21.715+0000 7f937c227780 -1 bdev(0x55f90735d800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:21.719 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:21.715+0000 7f937c227780 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-22T21:43:23.835 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-22T21:43:23.899 DEBUG:teuthology.orchestra.run.trial155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:23.978 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:23.976+0000 7fd1da620780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-22T21:43:23.978 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:23.976+0000 7fd1da620780 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-22T21:43:23.979 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:23.976+0000 7fd1da620780 -1 bdev(0x55cedd6ad800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-22T21:43:23.979 INFO:teuthology.orchestra.run.trial155.stderr:2026-02-22T21:43:23.976+0000 7fd1da620780 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-22T21:43:26.103 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-22T21:43:26.167 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T21:43:26.167 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.167 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T21:43:26.233 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.233 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T21:43:26.296 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.297 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T21:43:26.361 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.361 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T21:43:26.424 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.424 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-22T21:43:26.488 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.488 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-22T21:43:26.552 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.552 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-22T21:43:26.615 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.615 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-22T21:43:26.678 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.678 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-22T21:43:26.743 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.743 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-22T21:43:26.806 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.806 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-22T21:43:26.868 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:26.869 DEBUG:teuthology.orchestra.run.trial155:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T21:43:26.925 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T21:43:26.925 DEBUG:teuthology.orchestra.run.trial155:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout:[mgr.x] 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBieJtpUxL3EhAAhfpCnxW0mj9OPvcS60b0wA== 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout:[osd.0] 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBmeJtpf3wpCRAA95+sxkRS91k0XDfcKzj8Qg== 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout:[osd.1] 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBoeJtpv+h5JxAAtcfLZHqjTFWkHTcGkzc2pQ== 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout:[osd.2] 2026-02-22T21:43:26.987 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBreJtpELEuCxAApSWqWNgE8XI/gqAn9RAI5Q== 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout:[osd.3] 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBteJtpeqDfGhAAjn36FAa6/o00xq8QVCfICg== 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout:[osd.4] 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBveJtpgXzlOBAA2CSnkT0mtJDSTVEHwWYKCA== 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout:[osd.5] 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout: key = AQByeJtpcHktGxAA4WTBdkidxozh5RhCoEpwUA== 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout:[osd.6] 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout: key = AQB0eJtpRVoRORAAy3BtaZDWbFd3ZmAjeYsGhQ== 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout:[osd.7] 2026-02-22T21:43:26.988 INFO:teuthology.orchestra.run.trial155.stdout: key = AQB3eJtpcmeNDBAAq2UWbre/cuNIgi6MTfdFDw== 2026-02-22T21:43:26.989 INFO:teuthology.orchestra.run.trial155.stdout:[osd.8] 2026-02-22T21:43:26.989 INFO:teuthology.orchestra.run.trial155.stdout: key = AQB5eJtpyG63KhAAvz2Q3TfVxBiw9uWprZR82A== 2026-02-22T21:43:26.989 INFO:teuthology.orchestra.run.trial155.stdout:[osd.9] 2026-02-22T21:43:26.989 INFO:teuthology.orchestra.run.trial155.stdout: key = AQB7eJtpGAM3OhAAQeGcAhmisk28SPAE5GvSqw== 2026-02-22T21:43:26.989 INFO:teuthology.orchestra.run.trial155.stdout:[client.0] 2026-02-22T21:43:26.989 INFO:teuthology.orchestra.run.trial155.stdout: key = AQBieJtpkTlGFRAAH4eZHZuBr7JJhOQlow9TUw== 2026-02-22T21:43:26.990 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T21:43:27.070 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.150 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.230 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.309 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.390 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.470 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.549 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.627 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.707 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.788 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T21:43:27.867 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T21:43:27.947 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T21:43:27.948 DEBUG:teuthology.orchestra.run.trial155:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T21:43:28.012 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T21:43:28.098 DEBUG:teuthology.orchestra.run.trial155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T21:43:28.122 DEBUG:teuthology.orchestra.run.trial155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T21:43:28.176 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T21:43:28.176 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T21:43:28.176 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T21:43:28.219 INFO:tasks.ceph.mon.a:Started 2026-02-22T21:43:28.219 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph config set mgr mgr_pool false --force 2026-02-22T21:43:28.326 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T21:43:28.327 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T21:43:28.327 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T21:43:28.330 INFO:tasks.ceph.mgr.x:Started 2026-02-22T21:43:28.330 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T21:43:28.331 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T21:43:28.430 INFO:teuthology.orchestra.run.trial155.stderr:adjusted tunables profile to default 2026-02-22T21:43:28.438 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T21:43:28.438 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T21:43:28.439 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.439 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T21:43:28.465 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.466 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T21:43:28.529 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.530 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T21:43:28.594 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.594 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-22T21:43:28.659 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.659 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-22T21:43:28.723 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.723 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-22T21:43:28.735 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:28.733+0000 7f588ee4b140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T21:43:28.759 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.759 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-22T21:43:28.824 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.824 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-22T21:43:28.856 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:28.854+0000 7f588ee4b140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T21:43:28.880 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.880 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-22T21:43:28.883 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:28.881+0000 7f588ee4b140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T21:43:28.907 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:43:28.907 DEBUG:teuthology.orchestra.run.trial155:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-22T21:43:28.917 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:28.914+0000 7f588ee4b140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T21:43:28.939 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new a4f08513-24ab-4d1d-aae3-26ed1420b6f0 0 2026-02-22T21:43:28.940 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:28.937+0000 7f588ee4b140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T21:43:28.966 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:28.964+0000 7f588ee4b140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T21:43:29.022 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.020+0000 7f588ee4b140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T21:43:29.042 INFO:teuthology.orchestra.run.trial155.stdout:0 2026-02-22T21:43:29.051 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new eaa37151-85b4-41db-8c92-f2eac34575dc 1 2026-02-22T21:43:29.084 INFO:tasks.ceph.mgr.x.trial155.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T21:43:29.085 INFO:tasks.ceph.mgr.x.trial155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T21:43:29.085 INFO:tasks.ceph.mgr.x.trial155.stderr: from numpy import show_config as show_numpy_config 2026-02-22T21:43:29.087 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.085+0000 7f588ee4b140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T21:43:29.113 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.111+0000 7f588ee4b140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T21:43:29.169 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.167+0000 7f588ee4b140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-22T21:43:29.188 INFO:teuthology.orchestra.run.trial155.stdout:1 2026-02-22T21:43:29.197 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new f4b15007-f3ea-434f-8658-3071a2d414a9 2 2026-02-22T21:43:29.213 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.210+0000 7f588ee4b140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T21:43:29.239 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.237+0000 7f588ee4b140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T21:43:29.263 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.261+0000 7f588ee4b140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T21:43:29.289 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.287+0000 7f588ee4b140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T21:43:29.312 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.310+0000 7f588ee4b140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T21:43:29.315 INFO:teuthology.orchestra.run.trial155.stdout:2 2026-02-22T21:43:29.325 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new c4ef956d-d523-479d-baad-885762d04eed 3 2026-02-22T21:43:29.470 INFO:teuthology.orchestra.run.trial155.stdout:3 2026-02-22T21:43:29.480 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 8889f289-f5ca-44b0-99de-80b602390d97 4 2026-02-22T21:43:29.513 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.510+0000 7f588ee4b140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-22T21:43:29.568 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.566+0000 7f588ee4b140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T21:43:29.584 INFO:teuthology.orchestra.run.trial155.stdout:4 2026-02-22T21:43:29.591 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.589+0000 7f588ee4b140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T21:43:29.592 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new dd9bb116-9daf-4949-8e6f-a1ff3491815c 5 2026-02-22T21:43:29.614 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.612+0000 7f588ee4b140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T21:43:29.668 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.666+0000 7f588ee4b140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T21:43:29.690 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.687+0000 7f588ee4b140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T21:43:29.717 INFO:teuthology.orchestra.run.trial155.stdout:5 2026-02-22T21:43:29.726 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 4770e5ca-1786-451f-844c-a11d94a40986 6 2026-02-22T21:43:29.742 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:29.740+0000 7f588ee4b140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T21:43:29.829 INFO:teuthology.orchestra.run.trial155.stdout:6 2026-02-22T21:43:29.838 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new ddf38fa7-90be-487e-b37f-65188913b794 7 2026-02-22T21:43:29.981 INFO:teuthology.orchestra.run.trial155.stdout:7 2026-02-22T21:43:29.988 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 5042959c-0b17-4d80-92fc-1a3f8eb98f3f 8 2026-02-22T21:43:30.093 INFO:teuthology.orchestra.run.trial155.stdout:8 2026-02-22T21:43:30.102 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd new 3a85d59d-2ad6-4279-ba1c-b634fc26ca9d 9 2026-02-22T21:43:30.151 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:30.149+0000 7f588ee4b140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T21:43:30.175 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:30.172+0000 7f588ee4b140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T21:43:30.205 INFO:teuthology.orchestra.run.trial155.stdout:9 2026-02-22T21:43:30.214 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T21:43:30.214 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T21:43:30.216 INFO:tasks.ceph.osd.0:Started 2026-02-22T21:43:30.216 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T21:43:30.217 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T21:43:30.219 INFO:tasks.ceph.osd.1:Started 2026-02-22T21:43:30.219 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T21:43:30.219 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T21:43:30.221 INFO:tasks.ceph.osd.2:Started 2026-02-22T21:43:30.222 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-22T21:43:30.222 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-22T21:43:30.224 INFO:tasks.ceph.osd.3:Started 2026-02-22T21:43:30.224 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-22T21:43:30.224 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-22T21:43:30.226 INFO:tasks.ceph.osd.4:Started 2026-02-22T21:43:30.226 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-22T21:43:30.226 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-22T21:43:30.229 INFO:tasks.ceph.osd.5:Started 2026-02-22T21:43:30.229 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-22T21:43:30.229 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-22T21:43:30.231 INFO:tasks.ceph.osd.6:Started 2026-02-22T21:43:30.232 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-22T21:43:30.232 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-22T21:43:30.234 INFO:tasks.ceph.osd.7:Started 2026-02-22T21:43:30.234 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-22T21:43:30.235 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2026-02-22T21:43:30.237 INFO:tasks.ceph.osd.8:Started 2026-02-22T21:43:30.237 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-22T21:43:30.237 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2026-02-22T21:43:30.239 INFO:tasks.ceph.osd.9:Started 2026-02-22T21:43:30.240 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:43:30.348 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:43:30.348 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":12,"fsid":"c45bd854-fea0-47c3-9758-4cd66777c959","created":"2026-02-22T21:43:28.280279+0000","modified":"2026-02-22T21:43:30.203458+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T21:43:30.203458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4f08513-24ab-4d1d-aae3-26ed1420b6f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eaa37151-85b4-41db-8c92-f2eac34575dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4b15007-f3ea-434f-8658-3071a2d414a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c4ef956d-d523-479d-baad-885762d04eed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8889f289-f5ca-44b0-99de-80b602390d97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dd9bb116-9daf-4949-8e6f-a1ff3491815c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4770e5ca-1786-451f-844c-a11d94a40986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ddf38fa7-90be-487e-b37f-65188913b794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"5042959c-0b17-4d80-92fc-1a3f8eb98f3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"3a85d59d-2ad6-4279-ba1c-b634fc26ca9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:43:30.355 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T21:43:30.355 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T21:43:30.530 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:30.527+0000 7f588ee4b140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T21:43:31.361 DEBUG:teuthology.orchestra.run.trial155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T21:43:31.451 INFO:teuthology.misc.health.trial155.stdout: 2026-02-22T21:43:31.451 INFO:teuthology.misc.health.trial155.stdout:{"epoch":12,"fsid":"c45bd854-fea0-47c3-9758-4cd66777c959","created":"2026-02-22T21:43:28.280279+0000","modified":"2026-02-22T21:43:30.203458+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T21:43:30.203458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4f08513-24ab-4d1d-aae3-26ed1420b6f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eaa37151-85b4-41db-8c92-f2eac34575dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4b15007-f3ea-434f-8658-3071a2d414a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c4ef956d-d523-479d-baad-885762d04eed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8889f289-f5ca-44b0-99de-80b602390d97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dd9bb116-9daf-4949-8e6f-a1ff3491815c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4770e5ca-1786-451f-844c-a11d94a40986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ddf38fa7-90be-487e-b37f-65188913b794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"5042959c-0b17-4d80-92fc-1a3f8eb98f3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"3a85d59d-2ad6-4279-ba1c-b634fc26ca9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:43:31.455 DEBUG:teuthology.misc:0 of 10 OSDs are up 2026-02-22T21:43:31.536 INFO:tasks.ceph.mgr.x.trial155.stderr:2026-02-22T21:43:31.533+0000 7f57ac5e0640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-22T21:43:31.663 INFO:tasks.ceph.osd.3.trial155.stderr:2026-02-22T21:43:31.661+0000 7fcfb1e12780 -1 Falling back to public interface 2026-02-22T21:43:31.671 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T21:43:31.669+0000 7f20ba72e780 -1 Falling back to public interface 2026-02-22T21:43:31.913 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:43:31.911+0000 7f066b014780 -1 Falling back to public interface 2026-02-22T21:43:31.914 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T21:43:31.911+0000 7f0e0aa10780 -1 Falling back to public interface 2026-02-22T21:43:31.914 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:43:31.912+0000 7f0669a0c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2026-02-22T21:43:31.915 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T21:43:31.913+0000 7f0e09361640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6825/0: (98) Address already in use 2026-02-22T21:43:31.924 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T21:43:31.922+0000 7f588192e780 -1 Falling back to public interface 2026-02-22T21:43:31.962 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-22T21:43:31.960+0000 7f1f2ceb4780 -1 Falling back to public interface 2026-02-22T21:43:32.135 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T21:43:32.133+0000 7fc348a3f780 -1 Falling back to public interface 2026-02-22T21:43:32.141 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T21:43:32.139+0000 7ff0a6ac6780 -1 Falling back to public interface 2026-02-22T21:43:32.141 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T21:43:32.139+0000 7fa8565ab780 -1 Falling back to public interface 2026-02-22T21:43:32.184 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:43:32.181+0000 7f877b128780 -1 Falling back to public interface 2026-02-22T21:43:34.682 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T21:43:34.680+0000 7f0e0aa10780 -1 osd.4 0 log_to_monitors true 2026-02-22T21:43:34.710 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T21:43:34.707+0000 7f20ba72e780 -1 osd.7 0 log_to_monitors true 2026-02-22T21:43:34.718 INFO:tasks.ceph.osd.3.trial155.stderr:2026-02-22T21:43:34.716+0000 7fcfb1e12780 -1 osd.3 0 log_to_monitors true 2026-02-22T21:43:34.934 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:43:34.932+0000 7f066b014780 -1 osd.1 0 log_to_monitors true 2026-02-22T21:43:35.145 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T21:43:35.143+0000 7fa8565ab780 -1 osd.2 0 log_to_monitors true 2026-02-22T21:43:35.465 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T21:43:35.463+0000 7f588192e780 -1 osd.6 0 log_to_monitors true 2026-02-22T21:43:35.491 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-22T21:43:35.488+0000 7f1f2ceb4780 -1 osd.9 0 log_to_monitors true 2026-02-22T21:43:35.571 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T21:43:35.569+0000 7fc348a3f780 -1 osd.0 0 log_to_monitors true 2026-02-22T21:43:35.658 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T21:43:35.655+0000 7ff0a6ac6780 -1 osd.5 0 log_to_monitors true 2026-02-22T21:43:35.705 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:43:35.702+0000 7f877b128780 -1 osd.8 0 log_to_monitors true 2026-02-22T21:43:36.308 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T21:43:36.306+0000 7f0e06349640 -1 osd.4 0 waiting for initial osdmap 2026-02-22T21:43:36.309 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:43:36.307+0000 7f06669f4640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T21:43:36.309 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T21:43:36.307+0000 7f20b66bd640 -1 osd.7 0 waiting for initial osdmap 2026-02-22T21:43:36.309 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T21:43:36.307+0000 7fa852538640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T21:43:36.311 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T21:43:36.309+0000 7f0e02173640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:36.311 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:43:36.309+0000 7f065e816640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:36.312 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T21:43:36.309+0000 7fa84e362640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:36.312 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T21:43:36.309+0000 7f20b24e7640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:36.314 INFO:tasks.ceph.osd.3.trial155.stderr:2026-02-22T21:43:36.312+0000 7fcfad6f9640 -1 osd.3 0 waiting for initial osdmap 2026-02-22T21:43:36.316 INFO:tasks.ceph.osd.3.trial155.stderr:2026-02-22T21:43:36.313+0000 7fcfa551b640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:37.296 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-22T21:43:37.293+0000 7f1f28e41640 -1 osd.9 0 waiting for initial osdmap 2026-02-22T21:43:37.296 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T21:43:37.293+0000 7f587d8bd640 -1 osd.6 0 waiting for initial osdmap 2026-02-22T21:43:37.307 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T21:43:37.305+0000 7fc3449cc640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T21:43:37.309 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T21:43:37.307+0000 7fc3407f6640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:37.312 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T21:43:37.310+0000 7ff0a2a53640 -1 osd.5 0 waiting for initial osdmap 2026-02-22T21:43:37.312 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T21:43:37.310+0000 7f58756df640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:37.313 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:43:37.311+0000 7f87770b5640 -1 osd.8 0 waiting for initial osdmap 2026-02-22T21:43:37.313 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-22T21:43:37.311+0000 7f1f24c6b640 -1 osd.9 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:37.314 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T21:43:37.312+0000 7ff09a875640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:37.315 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:43:37.313+0000 7f876eed7640 -1 osd.8 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:43:38.460 DEBUG:teuthology.orchestra.run.trial155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T21:43:38.611 INFO:teuthology.misc.health.trial155.stdout: 2026-02-22T21:43:38.611 INFO:teuthology.misc.health.trial155.stdout:{"epoch":16,"fsid":"c45bd854-fea0-47c3-9758-4cd66777c959","created":"2026-02-22T21:43:28.280279+0000","modified":"2026-02-22T21:43:38.292710+0000","last_up_change":"2026-02-22T21:43:38.292710+0000","last_in_change":"2026-02-22T21:43:30.203458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4f08513-24ab-4d1d-aae3-26ed1420b6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6850","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6851","nonce":3494561764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6852","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6853","nonce":3494561764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6856","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6857","nonce":3494561764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6854","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6855","nonce":3494561764}]},"public_addr":"10.20.193.155:6851/3494561764","cluster_addr":"10.20.193.155:6853/3494561764","heartbeat_back_addr":"10.20.193.155:6857/3494561764","heartbeat_front_addr":"10.20.193.155:6855/3494561764","state":["exists","up"]},{"osd":1,"uuid":"eaa37151-85b4-41db-8c92-f2eac34575dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6819","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6821","nonce":1335458352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6823","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6825","nonce":1335458352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6832","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6833","nonce":1335458352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6828","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6830","nonce":1335458352}]},"public_addr":"10.20.193.155:6821/1335458352","cluster_addr":"10.20.193.155:6825/1335458352","heartbeat_back_addr":"10.20.193.155:6833/1335458352","heartbeat_front_addr":"10.20.193.155:6830/1335458352","state":["exists","up"]},{"osd":2,"uuid":"f4b15007-f3ea-434f-8658-3071a2d414a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6858","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6860","nonce":3348076260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6862","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6864","nonce":3348076260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6871","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6873","nonce":3348076260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6867","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6869","nonce":3348076260}]},"public_addr":"10.20.193.155:6860/3348076260","cluster_addr":"10.20.193.155:6864/3348076260","heartbeat_back_addr":"10.20.193.155:6873/3348076260","heartbeat_front_addr":"10.20.193.155:6869/3348076260","state":["exists","up"]},{"osd":3,"uuid":"c4ef956d-d523-479d-baad-885762d04eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6803","nonce":2357208874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6805","nonce":2357208874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6809","nonce":2357208874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6807","nonce":2357208874}]},"public_addr":"10.20.193.155:6803/2357208874","cluster_addr":"10.20.193.155:6805/2357208874","heartbeat_back_addr":"10.20.193.155:6809/2357208874","heartbeat_front_addr":"10.20.193.155:6807/2357208874","state":["exists","up"]},{"osd":4,"uuid":"8889f289-f5ca-44b0-99de-80b602390d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6820","nonce":1473195548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6824","nonce":1473195548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6829","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6831","nonce":1473195548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6826","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6827","nonce":1473195548}]},"public_addr":"10.20.193.155:6820/1473195548","cluster_addr":"10.20.193.155:6824/1473195548","heartbeat_back_addr":"10.20.193.155:6831/1473195548","heartbeat_front_addr":"10.20.193.155:6827/1473195548","state":["exists","up"]},{"osd":5,"uuid":"dd9bb116-9daf-4949-8e6f-a1ff3491815c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6859","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6861","nonce":3578142312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6863","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6865","nonce":3578142312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6870","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6872","nonce":3578142312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6866","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6868","nonce":3578142312}]},"public_addr":"10.20.193.155:6861/3578142312","cluster_addr":"10.20.193.155:6865/3578142312","heartbeat_back_addr":"10.20.193.155:6872/3578142312","heartbeat_front_addr":"10.20.193.155:6868/3578142312","state":["exists","up"]},{"osd":6,"uuid":"4770e5ca-1786-451f-844c-a11d94a40986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6834","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6835","nonce":3606448570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6836","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6837","nonce":3606448570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6840","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6841","nonce":3606448570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6838","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6839","nonce":3606448570}]},"public_addr":"10.20.193.155:6835/3606448570","cluster_addr":"10.20.193.155:6837/3606448570","heartbeat_back_addr":"10.20.193.155:6841/3606448570","heartbeat_front_addr":"10.20.193.155:6839/3606448570","state":["exists","up"]},{"osd":7,"uuid":"ddf38fa7-90be-487e-b37f-65188913b794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6811","nonce":3496130001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6813","nonce":3496130001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6817","nonce":3496130001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6815","nonce":3496130001}]},"public_addr":"10.20.193.155:6811/3496130001","cluster_addr":"10.20.193.155:6813/3496130001","heartbeat_back_addr":"10.20.193.155:6817/3496130001","heartbeat_front_addr":"10.20.193.155:6815/3496130001","state":["exists","up"]},{"osd":8,"uuid":"5042959c-0b17-4d80-92fc-1a3f8eb98f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6874","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6875","nonce":3263333326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6876","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6877","nonce":3263333326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6880","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6881","nonce":3263333326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6878","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6879","nonce":3263333326}]},"public_addr":"10.20.193.155:6875/3263333326","cluster_addr":"10.20.193.155:6877/3263333326","heartbeat_back_addr":"10.20.193.155:6881/3263333326","heartbeat_front_addr":"10.20.193.155:6879/3263333326","state":["exists","up"]},{"osd":9,"uuid":"3a85d59d-2ad6-4279-ba1c-b634fc26ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6842","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6843","nonce":2400902815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6844","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6845","nonce":2400902815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6848","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6849","nonce":2400902815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6846","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6847","nonce":2400902815}]},"public_addr":"10.20.193.155:6843/2400902815","cluster_addr":"10.20.193.155:6845/2400902815","heartbeat_back_addr":"10.20.193.155:6849/2400902815","heartbeat_front_addr":"10.20.193.155:6847/2400902815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.888962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.171467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.757581+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.672018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.746379+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:43:38.617 DEBUG:teuthology.misc:10 of 10 OSDs are up 2026-02-22T21:43:38.617 INFO:tasks.ceph:Creating RBD pool 2026-02-22T21:43:38.617 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T21:43:39.299 INFO:teuthology.orchestra.run.trial155.stderr:pool 'rbd' created 2026-02-22T21:43:39.310 DEBUG:teuthology.orchestra.run.trial155:> rbd --cluster ceph pool init rbd 2026-02-22T21:43:42.309 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T21:43:42.310 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T21:43:42.310 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T21:43:42.310 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T21:43:42.311 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T21:43:42.491 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:43:42.498 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6800","nonce":227545611},{"type":"v1","addr":"10.20.193.155:6801","nonce":227545611}]},"active_addr":"10.20.193.155:6801/227545611","active_change":"2026-02-22T21:43:30.530242+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":3271332823}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":3498482419}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.155:0","nonce":3089838562}]}]} 2026-02-22T21:43:42.502 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T21:43:42.502 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T21:43:42.503 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:43:42.671 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:43:42.671 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":20,"fsid":"c45bd854-fea0-47c3-9758-4cd66777c959","created":"2026-02-22T21:43:28.280279+0000","modified":"2026-02-22T21:43:42.301858+0000","last_up_change":"2026-02-22T21:43:38.292710+0000","last_in_change":"2026-02-22T21:43:30.203458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T21:43:38.776683+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4f08513-24ab-4d1d-aae3-26ed1420b6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6850","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6851","nonce":3494561764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6852","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6853","nonce":3494561764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6856","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6857","nonce":3494561764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6854","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6855","nonce":3494561764}]},"public_addr":"10.20.193.155:6851/3494561764","cluster_addr":"10.20.193.155:6853/3494561764","heartbeat_back_addr":"10.20.193.155:6857/3494561764","heartbeat_front_addr":"10.20.193.155:6855/3494561764","state":["exists","up"]},{"osd":1,"uuid":"eaa37151-85b4-41db-8c92-f2eac34575dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6819","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6821","nonce":1335458352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6823","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6825","nonce":1335458352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6832","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6833","nonce":1335458352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6828","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6830","nonce":1335458352}]},"public_addr":"10.20.193.155:6821/1335458352","cluster_addr":"10.20.193.155:6825/1335458352","heartbeat_back_addr":"10.20.193.155:6833/1335458352","heartbeat_front_addr":"10.20.193.155:6830/1335458352","state":["exists","up"]},{"osd":2,"uuid":"f4b15007-f3ea-434f-8658-3071a2d414a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6858","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6860","nonce":3348076260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6862","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6864","nonce":3348076260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6871","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6873","nonce":3348076260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6867","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6869","nonce":3348076260}]},"public_addr":"10.20.193.155:6860/3348076260","cluster_addr":"10.20.193.155:6864/3348076260","heartbeat_back_addr":"10.20.193.155:6873/3348076260","heartbeat_front_addr":"10.20.193.155:6869/3348076260","state":["exists","up"]},{"osd":3,"uuid":"c4ef956d-d523-479d-baad-885762d04eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6803","nonce":2357208874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6805","nonce":2357208874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6809","nonce":2357208874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6807","nonce":2357208874}]},"public_addr":"10.20.193.155:6803/2357208874","cluster_addr":"10.20.193.155:6805/2357208874","heartbeat_back_addr":"10.20.193.155:6809/2357208874","heartbeat_front_addr":"10.20.193.155:6807/2357208874","state":["exists","up"]},{"osd":4,"uuid":"8889f289-f5ca-44b0-99de-80b602390d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6820","nonce":1473195548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6824","nonce":1473195548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6829","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6831","nonce":1473195548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6826","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6827","nonce":1473195548}]},"public_addr":"10.20.193.155:6820/1473195548","cluster_addr":"10.20.193.155:6824/1473195548","heartbeat_back_addr":"10.20.193.155:6831/1473195548","heartbeat_front_addr":"10.20.193.155:6827/1473195548","state":["exists","up"]},{"osd":5,"uuid":"dd9bb116-9daf-4949-8e6f-a1ff3491815c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6859","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6861","nonce":3578142312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6863","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6865","nonce":3578142312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6870","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6872","nonce":3578142312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6866","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6868","nonce":3578142312}]},"public_addr":"10.20.193.155:6861/3578142312","cluster_addr":"10.20.193.155:6865/3578142312","heartbeat_back_addr":"10.20.193.155:6872/3578142312","heartbeat_front_addr":"10.20.193.155:6868/3578142312","state":["exists","up"]},{"osd":6,"uuid":"4770e5ca-1786-451f-844c-a11d94a40986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6834","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6835","nonce":3606448570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6836","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6837","nonce":3606448570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6840","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6841","nonce":3606448570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6838","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6839","nonce":3606448570}]},"public_addr":"10.20.193.155:6835/3606448570","cluster_addr":"10.20.193.155:6837/3606448570","heartbeat_back_addr":"10.20.193.155:6841/3606448570","heartbeat_front_addr":"10.20.193.155:6839/3606448570","state":["exists","up"]},{"osd":7,"uuid":"ddf38fa7-90be-487e-b37f-65188913b794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6811","nonce":3496130001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6813","nonce":3496130001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6817","nonce":3496130001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6815","nonce":3496130001}]},"public_addr":"10.20.193.155:6811/3496130001","cluster_addr":"10.20.193.155:6813/3496130001","heartbeat_back_addr":"10.20.193.155:6817/3496130001","heartbeat_front_addr":"10.20.193.155:6815/3496130001","state":["exists","up"]},{"osd":8,"uuid":"5042959c-0b17-4d80-92fc-1a3f8eb98f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6874","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6875","nonce":3263333326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6876","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6877","nonce":3263333326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6880","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6881","nonce":3263333326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6878","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6879","nonce":3263333326}]},"public_addr":"10.20.193.155:6875/3263333326","cluster_addr":"10.20.193.155:6877/3263333326","heartbeat_back_addr":"10.20.193.155:6881/3263333326","heartbeat_front_addr":"10.20.193.155:6879/3263333326","state":["exists","up"]},{"osd":9,"uuid":"3a85d59d-2ad6-4279-ba1c-b634fc26ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6842","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6843","nonce":2400902815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6844","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6845","nonce":2400902815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6848","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6849","nonce":2400902815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6846","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6847","nonce":2400902815}]},"public_addr":"10.20.193.155:6843/2400902815","cluster_addr":"10.20.193.155:6845/2400902815","heartbeat_back_addr":"10.20.193.155:6849/2400902815","heartbeat_front_addr":"10.20.193.155:6847/2400902815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.607072+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.888962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.171467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.757581+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.672018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.676696+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.491709+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.746379+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.714069+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.497911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:43:42.680 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T21:43:42.681 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:43:42.837 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:43:42.838 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":20,"fsid":"c45bd854-fea0-47c3-9758-4cd66777c959","created":"2026-02-22T21:43:28.280279+0000","modified":"2026-02-22T21:43:42.301858+0000","last_up_change":"2026-02-22T21:43:38.292710+0000","last_in_change":"2026-02-22T21:43:30.203458+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T21:43:38.776683+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4f08513-24ab-4d1d-aae3-26ed1420b6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6850","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6851","nonce":3494561764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6852","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6853","nonce":3494561764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6856","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6857","nonce":3494561764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6854","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6855","nonce":3494561764}]},"public_addr":"10.20.193.155:6851/3494561764","cluster_addr":"10.20.193.155:6853/3494561764","heartbeat_back_addr":"10.20.193.155:6857/3494561764","heartbeat_front_addr":"10.20.193.155:6855/3494561764","state":["exists","up"]},{"osd":1,"uuid":"eaa37151-85b4-41db-8c92-f2eac34575dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6819","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6821","nonce":1335458352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6823","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6825","nonce":1335458352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6832","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6833","nonce":1335458352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6828","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6830","nonce":1335458352}]},"public_addr":"10.20.193.155:6821/1335458352","cluster_addr":"10.20.193.155:6825/1335458352","heartbeat_back_addr":"10.20.193.155:6833/1335458352","heartbeat_front_addr":"10.20.193.155:6830/1335458352","state":["exists","up"]},{"osd":2,"uuid":"f4b15007-f3ea-434f-8658-3071a2d414a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6858","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6860","nonce":3348076260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6862","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6864","nonce":3348076260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6871","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6873","nonce":3348076260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6867","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6869","nonce":3348076260}]},"public_addr":"10.20.193.155:6860/3348076260","cluster_addr":"10.20.193.155:6864/3348076260","heartbeat_back_addr":"10.20.193.155:6873/3348076260","heartbeat_front_addr":"10.20.193.155:6869/3348076260","state":["exists","up"]},{"osd":3,"uuid":"c4ef956d-d523-479d-baad-885762d04eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6803","nonce":2357208874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6805","nonce":2357208874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6809","nonce":2357208874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6807","nonce":2357208874}]},"public_addr":"10.20.193.155:6803/2357208874","cluster_addr":"10.20.193.155:6805/2357208874","heartbeat_back_addr":"10.20.193.155:6809/2357208874","heartbeat_front_addr":"10.20.193.155:6807/2357208874","state":["exists","up"]},{"osd":4,"uuid":"8889f289-f5ca-44b0-99de-80b602390d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6820","nonce":1473195548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6822","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6824","nonce":1473195548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6829","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6831","nonce":1473195548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6826","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6827","nonce":1473195548}]},"public_addr":"10.20.193.155:6820/1473195548","cluster_addr":"10.20.193.155:6824/1473195548","heartbeat_back_addr":"10.20.193.155:6831/1473195548","heartbeat_front_addr":"10.20.193.155:6827/1473195548","state":["exists","up"]},{"osd":5,"uuid":"dd9bb116-9daf-4949-8e6f-a1ff3491815c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6859","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6861","nonce":3578142312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6863","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6865","nonce":3578142312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6870","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6872","nonce":3578142312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6866","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6868","nonce":3578142312}]},"public_addr":"10.20.193.155:6861/3578142312","cluster_addr":"10.20.193.155:6865/3578142312","heartbeat_back_addr":"10.20.193.155:6872/3578142312","heartbeat_front_addr":"10.20.193.155:6868/3578142312","state":["exists","up"]},{"osd":6,"uuid":"4770e5ca-1786-451f-844c-a11d94a40986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6834","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6835","nonce":3606448570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6836","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6837","nonce":3606448570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6840","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6841","nonce":3606448570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6838","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6839","nonce":3606448570}]},"public_addr":"10.20.193.155:6835/3606448570","cluster_addr":"10.20.193.155:6837/3606448570","heartbeat_back_addr":"10.20.193.155:6841/3606448570","heartbeat_front_addr":"10.20.193.155:6839/3606448570","state":["exists","up"]},{"osd":7,"uuid":"ddf38fa7-90be-487e-b37f-65188913b794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6811","nonce":3496130001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6813","nonce":3496130001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6817","nonce":3496130001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6815","nonce":3496130001}]},"public_addr":"10.20.193.155:6811/3496130001","cluster_addr":"10.20.193.155:6813/3496130001","heartbeat_back_addr":"10.20.193.155:6817/3496130001","heartbeat_front_addr":"10.20.193.155:6815/3496130001","state":["exists","up"]},{"osd":8,"uuid":"5042959c-0b17-4d80-92fc-1a3f8eb98f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6874","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6875","nonce":3263333326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6876","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6877","nonce":3263333326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6880","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6881","nonce":3263333326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6878","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6879","nonce":3263333326}]},"public_addr":"10.20.193.155:6875/3263333326","cluster_addr":"10.20.193.155:6877/3263333326","heartbeat_back_addr":"10.20.193.155:6881/3263333326","heartbeat_front_addr":"10.20.193.155:6879/3263333326","state":["exists","up"]},{"osd":9,"uuid":"3a85d59d-2ad6-4279-ba1c-b634fc26ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6842","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6843","nonce":2400902815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6844","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6845","nonce":2400902815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6848","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6849","nonce":2400902815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6846","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6847","nonce":2400902815}]},"public_addr":"10.20.193.155:6843/2400902815","cluster_addr":"10.20.193.155:6845/2400902815","heartbeat_back_addr":"10.20.193.155:6849/2400902815","heartbeat_front_addr":"10.20.193.155:6847/2400902815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.607072+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.888962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.171467+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.757581+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.672018+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.676696+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.491709+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.746379+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.714069+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.497911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:43:42.847 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T21:43:42.847 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T21:43:42.848 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T21:43:42.848 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-22T21:43:42.849 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-22T21:43:42.849 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-22T21:43:42.849 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-22T21:43:42.850 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-22T21:43:42.850 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-22T21:43:42.851 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-22T21:43:42.952 INFO:teuthology.orchestra.run.trial155.stdout:64424509443 2026-02-22T21:43:42.953 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T21:43:42.954 INFO:teuthology.orchestra.run.trial155.stdout:68719476738 2026-02-22T21:43:42.955 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T21:43:42.956 INFO:teuthology.orchestra.run.trial155.stdout:64424509443 2026-02-22T21:43:42.957 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T21:43:42.958 INFO:teuthology.orchestra.run.trial155.stdout:64424509443 2026-02-22T21:43:42.958 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T21:43:42.959 INFO:teuthology.orchestra.run.trial155.stdout:64424509444 2026-02-22T21:43:42.960 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T21:43:42.960 INFO:teuthology.orchestra.run.trial155.stdout:64424509443 2026-02-22T21:43:42.961 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T21:43:42.962 INFO:teuthology.orchestra.run.trial155.stdout:68719476738 2026-02-22T21:43:42.963 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T21:43:42.964 INFO:teuthology.orchestra.run.trial155.stdout:68719476739 2026-02-22T21:43:42.964 INFO:teuthology.orchestra.run.trial155.stdout:68719476739 2026-02-22T21:43:42.965 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T21:43:42.965 INFO:teuthology.orchestra.run.trial155.stdout:68719476740 2026-02-22T21:43:42.966 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-22T21:43:42.967 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-22T21:43:43.130 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:43.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.1 2026-02-22T21:43:43.177 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:43.180 INFO:teuthology.orchestra.run.trial155.stdout:68719476738 2026-02-22T21:43:43.180 INFO:teuthology.orchestra.run.trial155.stdout:68719476737 2026-02-22T21:43:43.181 INFO:teuthology.orchestra.run.trial155.stdout:64424509443 2026-02-22T21:43:43.186 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:43.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.7 2026-02-22T21:43:43.188 INFO:teuthology.orchestra.run.trial155.stdout:68719476737 2026-02-22T21:43:43.191 INFO:teuthology.orchestra.run.trial155.stdout:68719476739 2026-02-22T21:43:43.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476738 got 68719476737 for osd.0 2026-02-22T21:43:43.193 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:43.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476738 for osd.6 2026-02-22T21:43:43.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.3 2026-02-22T21:43:43.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.2 2026-02-22T21:43:43.197 INFO:teuthology.orchestra.run.trial155.stdout:68719476738 2026-02-22T21:43:43.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476738 got 68719476737 for osd.5 2026-02-22T21:43:43.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2026-02-22T21:43:43.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476740 got 68719476739 for osd.9 2026-02-22T21:43:43.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476738 for osd.8 2026-02-22T21:43:44.142 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T21:43:44.188 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T21:43:44.193 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T21:43:44.195 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T21:43:44.195 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T21:43:44.198 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T21:43:44.199 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T21:43:44.203 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T21:43:44.204 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-22T21:43:44.208 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-22T21:43:44.311 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:44.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.1 2026-02-22T21:43:44.364 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:44.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.7 2026-02-22T21:43:44.401 INFO:teuthology.orchestra.run.trial155.stdout:68719476737 2026-02-22T21:43:44.404 INFO:teuthology.orchestra.run.trial155.stdout:64424509443 2026-02-22T21:43:44.408 INFO:teuthology.orchestra.run.trial155.stdout:68719476738 2026-02-22T21:43:44.411 INFO:teuthology.orchestra.run.trial155.stdout:68719476737 2026-02-22T21:43:44.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476738 got 68719476737 for osd.5 2026-02-22T21:43:44.413 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:44.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.3 2026-02-22T21:43:44.415 INFO:teuthology.orchestra.run.trial155.stdout:68719476738 2026-02-22T21:43:44.416 INFO:teuthology.orchestra.run.trial155.stdout:64424509442 2026-02-22T21:43:44.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476738 for osd.6 2026-02-22T21:43:44.419 INFO:teuthology.orchestra.run.trial155.stdout:68719476739 2026-02-22T21:43:44.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476738 got 68719476737 for osd.0 2026-02-22T21:43:44.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2026-02-22T21:43:44.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476738 for osd.8 2026-02-22T21:43:44.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.2 2026-02-22T21:43:44.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476740 got 68719476739 for osd.9 2026-02-22T21:43:45.323 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T21:43:45.375 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T21:43:45.413 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T21:43:45.416 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T21:43:45.419 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T21:43:45.423 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T21:43:45.424 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T21:43:45.426 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-22T21:43:45.427 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T21:43:45.430 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-22T21:43:45.509 INFO:teuthology.orchestra.run.trial155.stdout:64424509444 2026-02-22T21:43:45.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.1 2026-02-22T21:43:45.509 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.546 INFO:teuthology.orchestra.run.trial155.stdout:64424509444 2026-02-22T21:43:45.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.7 2026-02-22T21:43:45.561 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.588 INFO:teuthology.orchestra.run.trial155.stdout:68719476739 2026-02-22T21:43:45.593 INFO:teuthology.orchestra.run.trial155.stdout:64424509445 2026-02-22T21:43:45.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476738 got 68719476739 for osd.5 2026-02-22T21:43:45.599 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.3 2026-02-22T21:43:45.604 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.632 INFO:teuthology.orchestra.run.trial155.stdout:68719476740 2026-02-22T21:43:45.633 INFO:teuthology.orchestra.run.trial155.stdout:68719476740 2026-02-22T21:43:45.635 INFO:teuthology.orchestra.run.trial155.stdout:64424509444 2026-02-22T21:43:45.639 INFO:teuthology.orchestra.run.trial155.stdout:64424509444 2026-02-22T21:43:45.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476740 for osd.8 2026-02-22T21:43:45.644 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476740 for osd.6 2026-02-22T21:43:45.645 INFO:teuthology.orchestra.run.trial155.stdout:68719476741 2026-02-22T21:43:45.645 INFO:teuthology.orchestra.run.trial155.stdout:68719476739 2026-02-22T21:43:45.646 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.2 2026-02-22T21:43:45.646 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.4 2026-02-22T21:43:45.651 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476740 got 68719476741 for osd.9 2026-02-22T21:43:45.654 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476738 got 68719476739 for osd.0 2026-02-22T21:43:45.655 DEBUG:teuthology.parallel:result is None 2026-02-22T21:43:45.656 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T21:43:45.656 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:43:45.851 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:43:45.852 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:43:45.859 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-22T21:43:44.533691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271440,"kb_used_data":1780,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048304560,"statfs":{"total":1073741824000,"available":1073463869440,"internally_reserved":0,"allocated":1822720,"data_stored":592602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:43.511922+0000","last_change":"2026-02-22T21:43:43.512025+0000","last_active":"2026-02-22T21:43:43.511922+0000","last_peered":"2026-02-22T21:43:43.511922+0000","last_clean":"2026-02-22T21:43:43.511922+0000","last_became_active":"2026-02-22T21:43:40.307104+0000","last_became_peered":"2026-02-22T21:43:40.307104+0000","last_unstale":"2026-02-22T21:43:43.511922+0000","last_undegraded":"2026-02-22T21:43:43.511922+0000","last_fullsized":"2026-02-22T21:43:43.511922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:04:26.473835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:43.511943+0000","last_change":"2026-02-22T21:43:43.512039+0000","last_active":"2026-02-22T21:43:43.511943+0000","last_peered":"2026-02-22T21:43:43.511943+0000","last_clean":"2026-02-22T21:43:43.511943+0000","last_became_active":"2026-02-22T21:43:40.307115+0000","last_became_peered":"2026-02-22T21:43:40.307115+0000","last_unstale":"2026-02-22T21:43:43.511943+0000","last_undegraded":"2026-02-22T21:43:43.511943+0000","last_fullsized":"2026-02-22T21:43:43.511943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:12:48.749846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T21:43:40.303364+0000","last_change":"2026-02-22T21:43:40.303103+0000","last_active":"2026-02-22T21:43:40.303364+0000","last_peered":"2026-02-22T21:43:40.303364+0000","last_clean":"2026-02-22T21:43:40.303364+0000","last_became_active":"2026-02-22T21:43:40.302950+0000","last_became_peered":"2026-02-22T21:43:40.302950+0000","last_unstale":"2026-02-22T21:43:40.303364+0000","last_undegraded":"2026-02-22T21:43:40.303364+0000","last_fullsized":"2026-02-22T21:43:40.303364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:28.108475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T21:43:41.302493+0000","last_change":"2026-02-22T21:43:40.303048+0000","last_active":"2026-02-22T21:43:41.302493+0000","last_peered":"2026-02-22T21:43:41.302493+0000","last_clean":"2026-02-22T21:43:41.302493+0000","last_became_active":"2026-02-22T21:43:40.302951+0000","last_became_peered":"2026-02-22T21:43:40.302951+0000","last_unstale":"2026-02-22T21:43:41.302493+0000","last_undegraded":"2026-02-22T21:43:41.302493+0000","last_fullsized":"2026-02-22T21:43:41.302493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:39:43.882713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T21:43:40.307607+0000","last_change":"2026-02-22T21:43:40.307360+0000","last_active":"2026-02-22T21:43:40.307607+0000","last_peered":"2026-02-22T21:43:40.307607+0000","last_clean":"2026-02-22T21:43:40.307607+0000","last_became_active":"2026-02-22T21:43:40.306896+0000","last_became_peered":"2026-02-22T21:43:40.306896+0000","last_unstale":"2026-02-22T21:43:40.307607+0000","last_undegraded":"2026-02-22T21:43:40.307607+0000","last_fullsized":"2026-02-22T21:43:40.307607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:21:43.038271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:42.305316+0000","last_change":"2026-02-22T21:43:42.305030+0000","last_active":"2026-02-22T21:43:42.305316+0000","last_peered":"2026-02-22T21:43:42.305316+0000","last_clean":"2026-02-22T21:43:42.305316+0000","last_became_active":"2026-02-22T21:43:40.307099+0000","last_became_peered":"2026-02-22T21:43:40.307099+0000","last_unstale":"2026-02-22T21:43:42.305316+0000","last_undegraded":"2026-02-22T21:43:42.305316+0000","last_fullsized":"2026-02-22T21:43:42.305316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:30:48.955139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:42.304288+0000","last_change":"2026-02-22T21:43:42.304288+0000","last_active":"2026-02-22T21:43:42.304288+0000","last_peered":"2026-02-22T21:43:42.304288+0000","last_clean":"2026-02-22T21:43:42.304288+0000","last_became_active":"2026-02-22T21:43:40.302779+0000","last_became_peered":"2026-02-22T21:43:40.302779+0000","last_unstale":"2026-02-22T21:43:42.304288+0000","last_undegraded":"2026-02-22T21:43:42.304288+0000","last_fullsized":"2026-02-22T21:43:42.304288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:58.168604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:42.561153+0000","last_change":"2026-02-22T21:43:42.561153+0000","last_active":"2026-02-22T21:43:42.561153+0000","last_peered":"2026-02-22T21:43:42.561153+0000","last_clean":"2026-02-22T21:43:42.561153+0000","last_became_active":"2026-02-22T21:43:40.303173+0000","last_became_peered":"2026-02-22T21:43:40.303173+0000","last_unstale":"2026-02-22T21:43:42.561153+0000","last_undegraded":"2026-02-22T21:43:42.561153+0000","last_fullsized":"2026-02-22T21:43:42.561153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:14:39.829313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000182411,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":192512,"data_stored":64801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":16,"seq":68719476740,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":192512,"data_stored":64801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27160,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830440,"statfs":{"total":107374182400,"available":107346370560,"internally_reserved":0,"allocated":196608,"data_stored":64820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476740,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":192512,"data_stored":64801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":180224,"data_stored":58603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":196608,"data_stored":64820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:43:45.861 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:43:46.015 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:43:46.016 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:43:46.023 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-22T21:43:44.533691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271440,"kb_used_data":1780,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048304560,"statfs":{"total":1073741824000,"available":1073463869440,"internally_reserved":0,"allocated":1822720,"data_stored":592602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:43.511922+0000","last_change":"2026-02-22T21:43:43.512025+0000","last_active":"2026-02-22T21:43:43.511922+0000","last_peered":"2026-02-22T21:43:43.511922+0000","last_clean":"2026-02-22T21:43:43.511922+0000","last_became_active":"2026-02-22T21:43:40.307104+0000","last_became_peered":"2026-02-22T21:43:40.307104+0000","last_unstale":"2026-02-22T21:43:43.511922+0000","last_undegraded":"2026-02-22T21:43:43.511922+0000","last_fullsized":"2026-02-22T21:43:43.511922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:04:26.473835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:43.511943+0000","last_change":"2026-02-22T21:43:43.512039+0000","last_active":"2026-02-22T21:43:43.511943+0000","last_peered":"2026-02-22T21:43:43.511943+0000","last_clean":"2026-02-22T21:43:43.511943+0000","last_became_active":"2026-02-22T21:43:40.307115+0000","last_became_peered":"2026-02-22T21:43:40.307115+0000","last_unstale":"2026-02-22T21:43:43.511943+0000","last_undegraded":"2026-02-22T21:43:43.511943+0000","last_fullsized":"2026-02-22T21:43:43.511943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:12:48.749846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T21:43:40.303364+0000","last_change":"2026-02-22T21:43:40.303103+0000","last_active":"2026-02-22T21:43:40.303364+0000","last_peered":"2026-02-22T21:43:40.303364+0000","last_clean":"2026-02-22T21:43:40.303364+0000","last_became_active":"2026-02-22T21:43:40.302950+0000","last_became_peered":"2026-02-22T21:43:40.302950+0000","last_unstale":"2026-02-22T21:43:40.303364+0000","last_undegraded":"2026-02-22T21:43:40.303364+0000","last_fullsized":"2026-02-22T21:43:40.303364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:26:28.108475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-22T21:43:41.302493+0000","last_change":"2026-02-22T21:43:40.303048+0000","last_active":"2026-02-22T21:43:41.302493+0000","last_peered":"2026-02-22T21:43:41.302493+0000","last_clean":"2026-02-22T21:43:41.302493+0000","last_became_active":"2026-02-22T21:43:40.302951+0000","last_became_peered":"2026-02-22T21:43:40.302951+0000","last_unstale":"2026-02-22T21:43:41.302493+0000","last_undegraded":"2026-02-22T21:43:41.302493+0000","last_fullsized":"2026-02-22T21:43:41.302493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:39:43.882713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-22T21:43:40.307607+0000","last_change":"2026-02-22T21:43:40.307360+0000","last_active":"2026-02-22T21:43:40.307607+0000","last_peered":"2026-02-22T21:43:40.307607+0000","last_clean":"2026-02-22T21:43:40.307607+0000","last_became_active":"2026-02-22T21:43:40.306896+0000","last_became_peered":"2026-02-22T21:43:40.306896+0000","last_unstale":"2026-02-22T21:43:40.307607+0000","last_undegraded":"2026-02-22T21:43:40.307607+0000","last_fullsized":"2026-02-22T21:43:40.307607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:21:43.038271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:42.305316+0000","last_change":"2026-02-22T21:43:42.305030+0000","last_active":"2026-02-22T21:43:42.305316+0000","last_peered":"2026-02-22T21:43:42.305316+0000","last_clean":"2026-02-22T21:43:42.305316+0000","last_became_active":"2026-02-22T21:43:40.307099+0000","last_became_peered":"2026-02-22T21:43:40.307099+0000","last_unstale":"2026-02-22T21:43:42.305316+0000","last_undegraded":"2026-02-22T21:43:42.305316+0000","last_fullsized":"2026-02-22T21:43:42.305316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:30:48.955139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:42.304288+0000","last_change":"2026-02-22T21:43:42.304288+0000","last_active":"2026-02-22T21:43:42.304288+0000","last_peered":"2026-02-22T21:43:42.304288+0000","last_clean":"2026-02-22T21:43:42.304288+0000","last_became_active":"2026-02-22T21:43:40.302779+0000","last_became_peered":"2026-02-22T21:43:40.302779+0000","last_unstale":"2026-02-22T21:43:42.304288+0000","last_undegraded":"2026-02-22T21:43:42.304288+0000","last_fullsized":"2026-02-22T21:43:42.304288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:20:58.168604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-22T21:43:42.561153+0000","last_change":"2026-02-22T21:43:42.561153+0000","last_active":"2026-02-22T21:43:42.561153+0000","last_peered":"2026-02-22T21:43:42.561153+0000","last_clean":"2026-02-22T21:43:42.561153+0000","last_became_active":"2026-02-22T21:43:40.303173+0000","last_became_peered":"2026-02-22T21:43:40.303173+0000","last_unstale":"2026-02-22T21:43:42.561153+0000","last_undegraded":"2026-02-22T21:43:42.561153+0000","last_fullsized":"2026-02-22T21:43:42.561153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:14:39.829313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000182411,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":192512,"data_stored":64801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":16,"seq":68719476740,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":192512,"data_stored":64801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27160,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830440,"statfs":{"total":107374182400,"available":107346370560,"internally_reserved":0,"allocated":196608,"data_stored":64820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476740,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":192512,"data_stored":64801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":180224,"data_stored":58603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830468,"statfs":{"total":107374182400,"available":107346399232,"internally_reserved":0,"allocated":167936,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27156,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830444,"statfs":{"total":107374182400,"available":107346374656,"internally_reserved":0,"allocated":196608,"data_stored":64820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:43:46.025 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T21:43:46.025 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T21:43:46.025 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T21:43:46.025 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T21:43:46.197 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:43:46.197 INFO:teuthology.orchestra.run.trial155.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T21:43:46.205 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T21:43:46.206 INFO:teuthology.run_tasks:Running task workunit... 2026-02-22T21:43:46.217 INFO:tasks.workunit:Pulling workunits from ref f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:43:46.217 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-22T21:43:46.218 INFO:tasks.workunit:timeout=3h 2026-02-22T21:43:46.218 INFO:tasks.workunit:cleanup=True 2026-02-22T21:43:46.218 DEBUG:teuthology.orchestra.run.trial155:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-22T21:43:46.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:43:46.236 INFO:teuthology.orchestra.run.trial155.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-22T21:43:46.236 DEBUG:teuthology.orchestra.run.trial155:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T21:43:46.293 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-22T21:43:46.293 DEBUG:teuthology.orchestra.run.trial155:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-22T21:43:46.349 DEBUG:teuthology.orchestra.run.trial155:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T21:43:46.411 INFO:tasks.workunit.client.0.trial155.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-22T21:44:06.321 INFO:tasks.workunit.client.0.trial155.stderr:Note: switching to 'f90f4eaebb28b619cf76e80cbbe997656da69579'. 2026-02-22T21:44:06.321 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr:state without impacting any branches by switching back to a branch. 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr: git switch -c 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-22T21:44:06.322 INFO:tasks.workunit.client.0.trial155.stderr:Or undo this operation with: 2026-02-22T21:44:06.323 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-22T21:44:06.323 INFO:tasks.workunit.client.0.trial155.stderr: git switch - 2026-02-22T21:44:06.323 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-22T21:44:06.323 INFO:tasks.workunit.client.0.trial155.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-22T21:44:06.323 INFO:tasks.workunit.client.0.trial155.stderr: 2026-02-22T21:44:06.323 INFO:tasks.workunit.client.0.trial155.stderr:HEAD is now at f90f4eaebb2 Merge branch 'wip-74712-squid' of https://github.com/idryomov/ceph into wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T21:44:06.329 DEBUG:teuthology.orchestra.run.trial155:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-22T21:44:06.386 INFO:tasks.workunit.client.0.trial155.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-22T21:44:06.388 INFO:tasks.workunit.client.0.trial155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T21:44:06.388 INFO:tasks.workunit.client.0.trial155.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-22T21:44:06.477 INFO:tasks.workunit.client.0.trial155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-22T21:44:06.507 INFO:tasks.workunit.client.0.trial155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-22T21:44:06.531 INFO:tasks.workunit.client.0.trial155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T21:44:06.533 INFO:tasks.workunit.client.0.trial155.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T21:44:06.533 INFO:tasks.workunit.client.0.trial155.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-22T21:44:06.560 INFO:tasks.workunit.client.0.trial155.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T21:44:06.563 DEBUG:teuthology.orchestra.run.trial155:> set -ex 2026-02-22T21:44:06.564 DEBUG:teuthology.orchestra.run.trial155:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-22T21:44:06.621 INFO:tasks.workunit:Running workunits matching rados/test_health_warnings.sh on client.0... 2026-02-22T21:44:06.626 INFO:tasks.workunit:Running workunit rados/test_health_warnings.sh... 2026-02-22T21:44:06.626 DEBUG:teuthology.orchestra.run.trial155:workunit test rados/test_health_warnings.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f90f4eaebb28b619cf76e80cbbe997656da69579 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh 2026-02-22T21:44:06.682 INFO:tasks.workunit.client.0.trial155.stderr:+ crushtool -o crushmap --build --num_osds 10 host straw 2 rack straw 2 row straw 2 root straw 0 2026-02-22T21:44:06.693 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd setcrushmap -i crushmap 2026-02-22T21:44:08.290 INFO:tasks.workunit.client.0.trial155.stderr:7 2026-02-22T21:44:08.299 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd tree 2026-02-22T21:44:08.484 INFO:tasks.workunit.client.0.trial155.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout:-11 10.00000 root root 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: -9 8.00000 row row0 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: -6 4.00000 rack rack0 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: -1 2.00000 host host0 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: 0 1.00000 osd.0 up 1.00000 1.00000 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: 1 1.00000 osd.1 up 1.00000 1.00000 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: -2 2.00000 host host1 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: 2 1.00000 osd.2 up 1.00000 1.00000 2026-02-22T21:44:08.485 INFO:tasks.workunit.client.0.trial155.stdout: 3 1.00000 osd.3 up 1.00000 1.00000 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: -7 4.00000 rack rack1 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: -3 2.00000 host host2 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: 4 1.00000 osd.4 up 1.00000 1.00000 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: 5 1.00000 osd.5 up 1.00000 1.00000 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: -4 2.00000 host host3 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: 6 1.00000 osd.6 up 1.00000 1.00000 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: 7 1.00000 osd.7 up 1.00000 1.00000 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout:-10 2.00000 row row1 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: -8 2.00000 rack rack2 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: -5 2.00000 host host4 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: 8 1.00000 osd.8 up 1.00000 1.00000 2026-02-22T21:44:08.486 INFO:tasks.workunit.client.0.trial155.stdout: 9 1.00000 osd.9 up 1.00000 1.00000 2026-02-22T21:44:08.491 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph tell 'osd.*' injectargs --osd_max_markdown_count 1024 --osd_max_markdown_period 1 2026-02-22T21:44:08.557 INFO:tasks.workunit.client.0.trial155.stdout:osd.0: {} 2026-02-22T21:44:08.572 INFO:tasks.workunit.client.0.trial155.stdout:osd.1: {} 2026-02-22T21:44:08.586 INFO:tasks.workunit.client.0.trial155.stdout:osd.2: {} 2026-02-22T21:44:08.600 INFO:tasks.workunit.client.0.trial155.stdout:osd.3: {} 2026-02-22T21:44:08.614 INFO:tasks.workunit.client.0.trial155.stdout:osd.4: {} 2026-02-22T21:44:08.629 INFO:tasks.workunit.client.0.trial155.stdout:osd.5: {} 2026-02-22T21:44:08.643 INFO:tasks.workunit.client.0.trial155.stdout:osd.6: {} 2026-02-22T21:44:08.657 INFO:tasks.workunit.client.0.trial155.stdout:osd.7: {} 2026-02-22T21:44:08.671 INFO:tasks.workunit.client.0.trial155.stdout:osd.8: {} 2026-02-22T21:44:08.685 INFO:tasks.workunit.client.0.trial155.stdout:osd.9: {} 2026-02-22T21:44:08.691 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd set noout 2026-02-22T21:44:10.294 INFO:tasks.workunit.client.0.trial155.stderr:noout is set 2026-02-22T21:44:10.304 INFO:tasks.workunit.client.0.trial155.stderr:+ test_mark_two_osds_same_host_down 2026-02-22T21:44:10.304 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd set noup 2026-02-22T21:44:12.297 INFO:tasks.workunit.client.0.trial155.stderr:noup is set 2026-02-22T21:44:12.306 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd down osd.0 osd.1 2026-02-22T21:44:12.446 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:12.445+0000 7fbbc194f640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2026-02-22T21:44:13.350 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:13.349+0000 7fbbc194f640 -1 mon.a@0(leader).osd e28 definitely_dead 0 2026-02-22T21:44:13.351 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. osd.1 is already down. 2026-02-22T21:44:13.358 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:13.605 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-22T21:44:13.605 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-22T21:44:13.605 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-22T21:44:13.605 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:13.605 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:13.605 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-22T21:44:13.606 INFO:tasks.workunit.client.0.trial155.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-22T21:44:13.612 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:13.612 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '1 host' 2026-02-22T21:44:13.829 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-22T21:44:13.829 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:13.829 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '2 osds' 2026-02-22T21:44:14.047 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-22T21:44:14.048 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:14.048 INFO:tasks.workunit.client.0.trial155.stderr:+ grep osd.0 2026-02-22T21:44:14.294 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:14.294 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:14.295 INFO:tasks.workunit.client.0.trial155.stderr:+ grep osd.1 2026-02-22T21:44:14.546 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:14.546 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd unset noup 2026-02-22T21:44:16.304 INFO:tasks.workunit.client.0.trial155.stderr:noup is unset 2026-02-22T21:44:16.314 INFO:tasks.workunit.client.0.trial155.stderr:+ wait_for_healthy 2026-02-22T21:44:16.314 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:16.314 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:16.531 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-22T21:44:16.531 INFO:tasks.workunit.client.0.trial155.stderr:+ sleep 1 2026-02-22T21:44:16.666 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:44:16.664+0000 7f065e816640 -1 osd.1 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:17.532 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:17.532 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:17.754 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-22T21:44:17.754 INFO:tasks.workunit.client.0.trial155.stderr:+ sleep 1 2026-02-22T21:44:18.504 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T21:44:18.502+0000 7fc3407f6640 -1 osd.0 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:18.755 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:18.756 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:18.972 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-22T21:44:18.972 INFO:tasks.workunit.client.0.trial155.stderr:+ sleep 1 2026-02-22T21:44:19.973 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:19.974 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:20.192 INFO:tasks.workunit.client.0.trial155.stderr:+ test_mark_two_osds_same_rack_down 2026-02-22T21:44:20.193 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd set noup 2026-02-22T21:44:22.317 INFO:tasks.workunit.client.0.trial155.stderr:noup is set 2026-02-22T21:44:22.325 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd down osd.8 osd.9 2026-02-22T21:44:22.462 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:22.461+0000 7fbbc194f640 -1 mon.a@0(leader).osd e37 definitely_dead 0 2026-02-22T21:44:23.369 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:23.367+0000 7fbbc194f640 -1 mon.a@0(leader).osd e38 definitely_dead 0 2026-02-22T21:44:23.369 INFO:tasks.workunit.client.0.trial155.stderr:osd.8 is already down. osd.9 is already down. 2026-02-22T21:44:23.376 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:23.618 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-22T21:44:23.618 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-22T21:44:23.618 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-22T21:44:23.618 INFO:tasks.workunit.client.0.trial155.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-22T21:44:23.618 INFO:tasks.workunit.client.0.trial155.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-22T21:44:23.619 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-22T21:44:23.619 INFO:tasks.workunit.client.0.trial155.stdout: host host4 (root=root,row=row1,rack=rack2) (2 osds) is down 2026-02-22T21:44:23.619 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_RACK_DOWN: 1 rack (2 osds) down 2026-02-22T21:44:23.619 INFO:tasks.workunit.client.0.trial155.stdout: rack rack2 (root=root,row=row1) (2 osds) is down 2026-02-22T21:44:23.619 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_ROW_DOWN: 1 row (2 osds) down 2026-02-22T21:44:23.619 INFO:tasks.workunit.client.0.trial155.stdout: row row1 (root=root) (2 osds) is down 2026-02-22T21:44:23.626 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:23.626 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '1 host' 2026-02-22T21:44:23.795 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:44:23.793+0000 7f87778b6640 -1 osd.8 38 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:23.846 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-22T21:44:23.847 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:23.847 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '1 rack' 2026-02-22T21:44:24.066 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-22T21:44:24.067 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:24.067 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '1 row' 2026-02-22T21:44:24.273 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-22T21:44:24.272+0000 7f1f29642640 -1 osd.9 38 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:24.286 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-22T21:44:24.287 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:24.287 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '2 osds' 2026-02-22T21:44:24.321 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:44:24.320+0000 7f8766c9d640 -1 osd.8 39 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:24.321 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-22T21:44:24.320+0000 7f1f1ca31640 -1 osd.9 39 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:24.511 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-22T21:44:24.512 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:24.512 INFO:tasks.workunit.client.0.trial155.stderr:+ grep osd.8 2026-02-22T21:44:24.763 INFO:tasks.workunit.client.0.trial155.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-22T21:44:24.764 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:24.764 INFO:tasks.workunit.client.0.trial155.stderr:+ grep osd.9 2026-02-22T21:44:25.017 INFO:tasks.workunit.client.0.trial155.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-22T21:44:25.017 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd unset noup 2026-02-22T21:44:25.324 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:44:25.322+0000 7f876eed7640 -1 osd.8 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:25.324 INFO:tasks.ceph.osd.9.trial155.stderr:2026-02-22T21:44:25.322+0000 7f1f24c6b640 -1 osd.9 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:26.323 INFO:tasks.workunit.client.0.trial155.stderr:noup is unset 2026-02-22T21:44:26.332 INFO:tasks.workunit.client.0.trial155.stderr:+ wait_for_healthy 2026-02-22T21:44:26.332 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:26.333 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:26.551 INFO:tasks.workunit.client.0.trial155.stderr:+ test_mark_all_but_last_osds_down 2026-02-22T21:44:26.551 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd set noup 2026-02-22T21:44:28.328 INFO:tasks.workunit.client.0.trial155.stderr:noup is set 2026-02-22T21:44:28.338 INFO:tasks.workunit.client.0.trial155.stderr:++ ceph osd ls 2026-02-22T21:44:28.338 INFO:tasks.workunit.client.0.trial155.stderr:++ sed '$d' 2026-02-22T21:44:28.524 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd down 0 1 2 3 4 5 6 7 8 2026-02-22T21:44:28.666 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:28.664+0000 7fbbc194f640 -1 mon.a@0(leader).osd e43 definitely_dead 0 2026-02-22T21:44:29.381 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:29.380+0000 7fbbc194f640 -1 mon.a@0(leader).osd e44 definitely_dead 0 2026-02-22T21:44:29.381 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. osd.1 is already down. osd.2 is already down. osd.3 is already down. osd.4 is already down. osd.5 is already down. osd.6 is already down. osd.7 is already down. osd.8 is already down. 2026-02-22T21:44:29.389 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_DOWN: 9 osds down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.2 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.3 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.4 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.5 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.6 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.7 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_HOST_DOWN: 4 hosts (8 osds) down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-22T21:44:29.632 INFO:tasks.workunit.client.0.trial155.stdout: host host1 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-22T21:44:29.633 INFO:tasks.workunit.client.0.trial155.stdout: host host2 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-22T21:44:29.633 INFO:tasks.workunit.client.0.trial155.stdout: host host3 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-22T21:44:29.633 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_RACK_DOWN: 2 racks (8 osds) down 2026-02-22T21:44:29.633 INFO:tasks.workunit.client.0.trial155.stdout: rack rack0 (root=root,row=row0) (4 osds) is down 2026-02-22T21:44:29.633 INFO:tasks.workunit.client.0.trial155.stdout: rack rack1 (root=root,row=row0) (4 osds) is down 2026-02-22T21:44:29.633 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_ROW_DOWN: 1 row (8 osds) down 2026-02-22T21:44:29.633 INFO:tasks.workunit.client.0.trial155.stdout: row row0 (root=root) (8 osds) is down 2026-02-22T21:44:29.639 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:29.639 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '1 row' 2026-02-22T21:44:29.732 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T21:44:29.730+0000 7f20b6ebe640 -1 osd.7 44 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:29.860 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-22T21:44:29.861 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:29.861 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '2 racks' 2026-02-22T21:44:30.077 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-22T21:44:30.078 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:30.078 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '4 hosts' 2026-02-22T21:44:30.295 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-22T21:44:30.295 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:30.295 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '9 osds' 2026-02-22T21:44:30.332 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T21:44:30.330+0000 7f20aa2ad640 -1 osd.7 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:30.516 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-22T21:44:30.517 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd unset noup 2026-02-22T21:44:30.802 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:44:30.801+0000 7f87770b5640 -1 osd.8 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:31.058 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T21:44:31.057+0000 7fa852d39640 -1 osd.2 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:31.251 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T21:44:31.249+0000 7f587e0be640 -1 osd.6 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:31.335 INFO:tasks.ceph.osd.2.trial155.stderr:2026-02-22T21:44:31.334+0000 7fa84e362640 -1 osd.2 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:31.336 INFO:tasks.ceph.osd.6.trial155.stderr:2026-02-22T21:44:31.335+0000 7f58756df640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:31.337 INFO:tasks.ceph.osd.7.trial155.stderr:2026-02-22T21:44:31.335+0000 7f20b24e7640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:31.337 INFO:tasks.ceph.osd.8.trial155.stderr:2026-02-22T21:44:31.335+0000 7f876eed7640 -1 osd.8 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:31.665 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:44:31.664+0000 7f065e816640 -1 osd.1 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:31.711 INFO:tasks.ceph.osd.5.trial155.stderr:2026-02-22T21:44:31.710+0000 7ff09a875640 -1 osd.5 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:32.335 INFO:tasks.workunit.client.0.trial155.stderr:noup is unset 2026-02-22T21:44:32.346 INFO:tasks.workunit.client.0.trial155.stderr:+ wait_for_healthy 2026-02-22T21:44:32.346 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:32.346 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:32.569 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noout flag(s) set; 3 osds down 2026-02-22T21:44:32.569 INFO:tasks.workunit.client.0.trial155.stderr:+ sleep 1 2026-02-22T21:44:32.689 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T21:44:32.687+0000 7fc3407f6640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:33.570 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:33.571 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:33.668 INFO:tasks.ceph.osd.3.trial155.stderr:2026-02-22T21:44:33.666+0000 7fcfa551b640 -1 osd.3 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:33.716 INFO:tasks.ceph.osd.4.trial155.stderr:2026-02-22T21:44:33.714+0000 7f0e02173640 -1 osd.4 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:33.792 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noout flag(s) set; 2 osds down 2026-02-22T21:44:33.792 INFO:tasks.workunit.client.0.trial155.stderr:+ sleep 1 2026-02-22T21:44:34.794 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:34.794 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:35.015 INFO:tasks.workunit.client.0.trial155.stderr:+ test_mark_two_osds_same_host_down_with_classes 2026-02-22T21:44:35.015 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd set noup 2026-02-22T21:44:36.344 INFO:tasks.workunit.client.0.trial155.stderr:noup is set 2026-02-22T21:44:36.352 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd crush set-device-class ssd osd.0 osd.2 osd.4 osd.6 osd.8 2026-02-22T21:44:38.348 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. osd.2 already set to class ssd. set-device-class item id 2 name 'osd.2' device_class 'ssd': no change. osd.4 already set to class ssd. set-device-class item id 4 name 'osd.4' device_class 'ssd': no change. osd.6 already set to class ssd. set-device-class item id 6 name 'osd.6' device_class 'ssd': no change. osd.8 already set to class ssd. set-device-class item id 8 name 'osd.8' device_class 'ssd': no change. set osd(s) to class 'ssd' 2026-02-22T21:44:38.357 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd crush set-device-class hdd osd.1 osd.3 osd.5 osd.7 osd.9 2026-02-22T21:44:40.352 INFO:tasks.workunit.client.0.trial155.stderr:osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. osd.3 already set to class hdd. set-device-class item id 3 name 'osd.3' device_class 'hdd': no change. osd.5 already set to class hdd. set-device-class item id 5 name 'osd.5' device_class 'hdd': no change. osd.7 already set to class hdd. set-device-class item id 7 name 'osd.7' device_class 'hdd': no change. osd.9 already set to class hdd. set-device-class item id 9 name 'osd.9' device_class 'hdd': no change. set osd(s) to class 'hdd' 2026-02-22T21:44:40.362 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd down osd.0 osd.1 2026-02-22T21:44:40.504 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:40.502+0000 7fbbc194f640 -1 mon.a@0(leader).osd e55 definitely_dead 0 2026-02-22T21:44:41.405 INFO:tasks.ceph.mon.a.trial155.stderr:2026-02-22T21:44:41.403+0000 7fbbc194f640 -1 mon.a@0(leader).osd e56 definitely_dead 0 2026-02-22T21:44:41.406 INFO:tasks.workunit.client.0.trial155.stderr:osd.0 is already down. osd.1 is already down. 2026-02-22T21:44:41.414 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:41.659 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-22T21:44:41.659 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-22T21:44:41.660 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-22T21:44:41.660 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:41.660 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:41.660 INFO:tasks.workunit.client.0.trial155.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-22T21:44:41.660 INFO:tasks.workunit.client.0.trial155.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-22T21:44:41.667 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:41.667 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '1 host' 2026-02-22T21:44:41.888 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-22T21:44:41.889 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:41.889 INFO:tasks.workunit.client.0.trial155.stderr:+ grep '2 osds' 2026-02-22T21:44:42.111 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-22T21:44:42.112 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:42.112 INFO:tasks.workunit.client.0.trial155.stderr:+ grep osd.0 2026-02-22T21:44:42.325 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:44:42.322+0000 7f06671f5640 -1 osd.1 56 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:42.357 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:44:42.355+0000 7f06565dc640 -1 osd.1 57 osdmap NOUP flag is set, waiting for it to clear 2026-02-22T21:44:42.364 INFO:tasks.workunit.client.0.trial155.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:42.365 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health detail 2026-02-22T21:44:42.365 INFO:tasks.workunit.client.0.trial155.stderr:+ grep osd.1 2026-02-22T21:44:42.615 INFO:tasks.workunit.client.0.trial155.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-22T21:44:42.616 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph osd unset noup 2026-02-22T21:44:43.359 INFO:tasks.ceph.osd.1.trial155.stderr:2026-02-22T21:44:43.357+0000 7f065e816640 -1 osd.1 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:44.358 INFO:tasks.workunit.client.0.trial155.stderr:noup is unset 2026-02-22T21:44:44.367 INFO:tasks.workunit.client.0.trial155.stderr:+ wait_for_healthy 2026-02-22T21:44:44.367 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:44.368 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:44.592 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-22T21:44:44.592 INFO:tasks.workunit.client.0.trial155.stderr:+ sleep 1 2026-02-22T21:44:45.593 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:45.594 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:45.792 INFO:tasks.ceph.osd.0.trial155.stderr:2026-02-22T21:44:45.789+0000 7fc3407f6640 -1 osd.0 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T21:44:45.816 INFO:tasks.workunit.client.0.trial155.stdout:HEALTH_WARN noout flag(s) set; 1 osds down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-22T21:44:45.816 INFO:tasks.workunit.client.0.trial155.stderr:+ sleep 1 2026-02-22T21:44:46.818 INFO:tasks.workunit.client.0.trial155.stderr:+ ceph health 2026-02-22T21:44:46.818 INFO:tasks.workunit.client.0.trial155.stderr:+ grep down 2026-02-22T21:44:47.038 INFO:tasks.workunit.client.0.trial155.stderr:+ exit 0 2026-02-22T21:44:47.038 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-22T21:44:47.038 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-22T21:44:47.104 INFO:tasks.workunit:Stopping ['rados/test_health_warnings.sh'] on client.0... 2026-02-22T21:44:47.105 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-22T21:44:47.444 DEBUG:teuthology.parallel:result is None 2026-02-22T21:44:47.445 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T21:44:47.470 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T21:44:47.471 DEBUG:teuthology.orchestra.run.trial155:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T21:44:47.527 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T21:44:47.527 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T21:44:47.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T21:44:47.534 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:44:47.725 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:47.725 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:44:47.733 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-22T21:44:47.365450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275908,"kb_used_data":6220,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048300092,"statfs":{"total":1073741824000,"available":1073459294208,"internally_reserved":0,"allocated":6369280,"data_stored":2999174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008051"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.357121+0000","last_change":"2026-02-22T21:44:35.344918+0000","last_active":"2026-02-22T21:44:42.357121+0000","last_peered":"2026-02-22T21:44:42.357121+0000","last_clean":"2026-02-22T21:44:42.357121+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:42.357121+0000","last_undegraded":"2026-02-22T21:44:42.357121+0000","last_fullsized":"2026-02-22T21:44:42.357121+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:21:22.968102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2026-02-22T21:44:43.517819+0000","last_change":"2026-02-22T21:44:35.345084+0000","last_active":"2026-02-22T21:44:43.517819+0000","last_peered":"2026-02-22T21:44:43.517819+0000","last_clean":"2026-02-22T21:44:43.517819+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:43.517819+0000","last_undegraded":"2026-02-22T21:44:43.517819+0000","last_fullsized":"2026-02-22T21:44:43.517819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:14:48.058069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:40.352490+0000","last_change":"2026-02-22T21:44:43.359796+0000","last_active":"2026-02-22T21:44:43.359796+0000","last_peered":"2026-02-22T21:44:40.352490+0000","last_clean":"2026-02-22T21:44:40.352490+0000","last_became_active":"2026-02-22T21:44:34.855070+0000","last_became_peered":"2026-02-22T21:44:34.855070+0000","last_unstale":"2026-02-22T21:44:40.352490+0000","last_undegraded":"2026-02-22T21:44:40.352490+0000","last_fullsized":"2026-02-22T21:44:40.352490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"peering","last_fresh":"2026-02-22T21:44:43.518019+0000","last_change":"2026-02-22T21:44:32.335532+0000","last_active":"2026-02-22T21:44:32.335532+0000","last_peered":"2026-02-22T21:44:29.515530+0000","last_clean":"2026-02-22T21:44:29.515530+0000","last_became_active":"2026-02-22T21:44:18.632723+0000","last_became_peered":"2026-02-22T21:44:18.632723+0000","last_unstale":"2026-02-22T21:44:43.518019+0000","last_undegraded":"2026-02-22T21:44:43.518019+0000","last_fullsized":"2026-02-22T21:44:43.518019+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":82,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2026-02-22T21:44:42.357448+0000","last_change":"2026-02-22T21:44:42.357419+0000","last_active":"2026-02-22T21:44:42.357448+0000","last_peered":"2026-02-22T21:44:42.357448+0000","last_clean":"2026-02-22T21:44:41.354981+0000","last_became_active":"2026-02-22T21:44:42.357419+0000","last_became_peered":"2026-02-22T21:44:42.357419+0000","last_unstale":"2026-02-22T21:44:42.357448+0000","last_undegraded":"2026-02-22T21:44:42.357174+0000","last_fullsized":"2026-02-22T21:44:42.357136+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":76,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:42.656873+0000","last_change":"2026-02-22T21:44:42.710131+0000","last_active":"2026-02-22T21:44:42.710131+0000","last_peered":"2026-02-22T21:44:42.656873+0000","last_clean":"2026-02-22T21:44:42.656873+0000","last_became_active":"2026-02-22T21:44:35.345564+0000","last_became_peered":"2026-02-22T21:44:35.345564+0000","last_unstale":"2026-02-22T21:44:42.656873+0000","last_undegraded":"2026-02-22T21:44:42.656873+0000","last_fullsized":"2026-02-22T21:44:42.656873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.319749+0000","last_change":"2026-02-22T21:44:35.344663+0000","last_active":"2026-02-22T21:44:42.319749+0000","last_peered":"2026-02-22T21:44:42.319749+0000","last_clean":"2026-02-22T21:44:42.319749+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:42.319749+0000","last_undegraded":"2026-02-22T21:44:42.319749+0000","last_fullsized":"2026-02-22T21:44:42.319749+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:31:51.579380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.496234+0000","last_change":"2026-02-22T21:44:33.648912+0000","last_active":"2026-02-22T21:44:42.496234+0000","last_peered":"2026-02-22T21:44:42.496234+0000","last_clean":"2026-02-22T21:44:42.496234+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:42.496234+0000","last_undegraded":"2026-02-22T21:44:42.496234+0000","last_fullsized":"2026-02-22T21:44:42.496234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:24:46.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27608,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829992,"statfs":{"total":107374182400,"available":107345911808,"internally_reserved":0,"allocated":659456,"data_stored":314775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27596,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830004,"statfs":{"total":107374182400,"available":107345924096,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27588,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830012,"statfs":{"total":107374182400,"available":107345932288,"internally_reserved":0,"allocated":634880,"data_stored":299437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27580,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830020,"statfs":{"total":107374182400,"available":107345940480,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27568,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830032,"statfs":{"total":107374182400,"available":107345952768,"internally_reserved":0,"allocated":610304,"data_stored":281297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397520,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397521,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27600,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830000,"statfs":{"total":107374182400,"available":107345920000,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27576,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":48,"seq":206158430223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:44:47.734 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:44:47.894 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:47.894 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:44:47.903 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-22T21:44:47.365450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275908,"kb_used_data":6220,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048300092,"statfs":{"total":1073741824000,"available":1073459294208,"internally_reserved":0,"allocated":6369280,"data_stored":2999174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008051"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.357121+0000","last_change":"2026-02-22T21:44:35.344918+0000","last_active":"2026-02-22T21:44:42.357121+0000","last_peered":"2026-02-22T21:44:42.357121+0000","last_clean":"2026-02-22T21:44:42.357121+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:42.357121+0000","last_undegraded":"2026-02-22T21:44:42.357121+0000","last_fullsized":"2026-02-22T21:44:42.357121+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:21:22.968102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2026-02-22T21:44:43.517819+0000","last_change":"2026-02-22T21:44:35.345084+0000","last_active":"2026-02-22T21:44:43.517819+0000","last_peered":"2026-02-22T21:44:43.517819+0000","last_clean":"2026-02-22T21:44:43.517819+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:43.517819+0000","last_undegraded":"2026-02-22T21:44:43.517819+0000","last_fullsized":"2026-02-22T21:44:43.517819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:14:48.058069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:40.352490+0000","last_change":"2026-02-22T21:44:43.359796+0000","last_active":"2026-02-22T21:44:43.359796+0000","last_peered":"2026-02-22T21:44:40.352490+0000","last_clean":"2026-02-22T21:44:40.352490+0000","last_became_active":"2026-02-22T21:44:34.855070+0000","last_became_peered":"2026-02-22T21:44:34.855070+0000","last_unstale":"2026-02-22T21:44:40.352490+0000","last_undegraded":"2026-02-22T21:44:40.352490+0000","last_fullsized":"2026-02-22T21:44:40.352490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"peering","last_fresh":"2026-02-22T21:44:43.518019+0000","last_change":"2026-02-22T21:44:32.335532+0000","last_active":"2026-02-22T21:44:32.335532+0000","last_peered":"2026-02-22T21:44:29.515530+0000","last_clean":"2026-02-22T21:44:29.515530+0000","last_became_active":"2026-02-22T21:44:18.632723+0000","last_became_peered":"2026-02-22T21:44:18.632723+0000","last_unstale":"2026-02-22T21:44:43.518019+0000","last_undegraded":"2026-02-22T21:44:43.518019+0000","last_fullsized":"2026-02-22T21:44:43.518019+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":82,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2026-02-22T21:44:42.357448+0000","last_change":"2026-02-22T21:44:42.357419+0000","last_active":"2026-02-22T21:44:42.357448+0000","last_peered":"2026-02-22T21:44:42.357448+0000","last_clean":"2026-02-22T21:44:41.354981+0000","last_became_active":"2026-02-22T21:44:42.357419+0000","last_became_peered":"2026-02-22T21:44:42.357419+0000","last_unstale":"2026-02-22T21:44:42.357448+0000","last_undegraded":"2026-02-22T21:44:42.357174+0000","last_fullsized":"2026-02-22T21:44:42.357136+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":76,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:42.656873+0000","last_change":"2026-02-22T21:44:42.710131+0000","last_active":"2026-02-22T21:44:42.710131+0000","last_peered":"2026-02-22T21:44:42.656873+0000","last_clean":"2026-02-22T21:44:42.656873+0000","last_became_active":"2026-02-22T21:44:35.345564+0000","last_became_peered":"2026-02-22T21:44:35.345564+0000","last_unstale":"2026-02-22T21:44:42.656873+0000","last_undegraded":"2026-02-22T21:44:42.656873+0000","last_fullsized":"2026-02-22T21:44:42.656873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.319749+0000","last_change":"2026-02-22T21:44:35.344663+0000","last_active":"2026-02-22T21:44:42.319749+0000","last_peered":"2026-02-22T21:44:42.319749+0000","last_clean":"2026-02-22T21:44:42.319749+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:42.319749+0000","last_undegraded":"2026-02-22T21:44:42.319749+0000","last_fullsized":"2026-02-22T21:44:42.319749+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:31:51.579380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.496234+0000","last_change":"2026-02-22T21:44:33.648912+0000","last_active":"2026-02-22T21:44:42.496234+0000","last_peered":"2026-02-22T21:44:42.496234+0000","last_clean":"2026-02-22T21:44:42.496234+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:42.496234+0000","last_undegraded":"2026-02-22T21:44:42.496234+0000","last_fullsized":"2026-02-22T21:44:42.496234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:24:46.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27608,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829992,"statfs":{"total":107374182400,"available":107345911808,"internally_reserved":0,"allocated":659456,"data_stored":314775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27596,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830004,"statfs":{"total":107374182400,"available":107345924096,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27588,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830012,"statfs":{"total":107374182400,"available":107345932288,"internally_reserved":0,"allocated":634880,"data_stored":299437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27580,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830020,"statfs":{"total":107374182400,"available":107345940480,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27568,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830032,"statfs":{"total":107374182400,"available":107345952768,"internally_reserved":0,"allocated":610304,"data_stored":281297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397520,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397521,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27600,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830000,"statfs":{"total":107374182400,"available":107345920000,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27576,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":48,"seq":206158430223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:44:47.904 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:44:48.061 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:48.061 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:44:48.069 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-22T21:44:47.365450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275908,"kb_used_data":6220,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048300092,"statfs":{"total":1073741824000,"available":1073459294208,"internally_reserved":0,"allocated":6369280,"data_stored":2999174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008051"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.357121+0000","last_change":"2026-02-22T21:44:35.344918+0000","last_active":"2026-02-22T21:44:42.357121+0000","last_peered":"2026-02-22T21:44:42.357121+0000","last_clean":"2026-02-22T21:44:42.357121+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:42.357121+0000","last_undegraded":"2026-02-22T21:44:42.357121+0000","last_fullsized":"2026-02-22T21:44:42.357121+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:21:22.968102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2026-02-22T21:44:43.517819+0000","last_change":"2026-02-22T21:44:35.345084+0000","last_active":"2026-02-22T21:44:43.517819+0000","last_peered":"2026-02-22T21:44:43.517819+0000","last_clean":"2026-02-22T21:44:43.517819+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:43.517819+0000","last_undegraded":"2026-02-22T21:44:43.517819+0000","last_fullsized":"2026-02-22T21:44:43.517819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:14:48.058069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:40.352490+0000","last_change":"2026-02-22T21:44:43.359796+0000","last_active":"2026-02-22T21:44:43.359796+0000","last_peered":"2026-02-22T21:44:40.352490+0000","last_clean":"2026-02-22T21:44:40.352490+0000","last_became_active":"2026-02-22T21:44:34.855070+0000","last_became_peered":"2026-02-22T21:44:34.855070+0000","last_unstale":"2026-02-22T21:44:40.352490+0000","last_undegraded":"2026-02-22T21:44:40.352490+0000","last_fullsized":"2026-02-22T21:44:40.352490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"peering","last_fresh":"2026-02-22T21:44:43.518019+0000","last_change":"2026-02-22T21:44:32.335532+0000","last_active":"2026-02-22T21:44:32.335532+0000","last_peered":"2026-02-22T21:44:29.515530+0000","last_clean":"2026-02-22T21:44:29.515530+0000","last_became_active":"2026-02-22T21:44:18.632723+0000","last_became_peered":"2026-02-22T21:44:18.632723+0000","last_unstale":"2026-02-22T21:44:43.518019+0000","last_undegraded":"2026-02-22T21:44:43.518019+0000","last_fullsized":"2026-02-22T21:44:43.518019+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":82,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2026-02-22T21:44:42.357448+0000","last_change":"2026-02-22T21:44:42.357419+0000","last_active":"2026-02-22T21:44:42.357448+0000","last_peered":"2026-02-22T21:44:42.357448+0000","last_clean":"2026-02-22T21:44:41.354981+0000","last_became_active":"2026-02-22T21:44:42.357419+0000","last_became_peered":"2026-02-22T21:44:42.357419+0000","last_unstale":"2026-02-22T21:44:42.357448+0000","last_undegraded":"2026-02-22T21:44:42.357174+0000","last_fullsized":"2026-02-22T21:44:42.357136+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":76,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:42.656873+0000","last_change":"2026-02-22T21:44:42.710131+0000","last_active":"2026-02-22T21:44:42.710131+0000","last_peered":"2026-02-22T21:44:42.656873+0000","last_clean":"2026-02-22T21:44:42.656873+0000","last_became_active":"2026-02-22T21:44:35.345564+0000","last_became_peered":"2026-02-22T21:44:35.345564+0000","last_unstale":"2026-02-22T21:44:42.656873+0000","last_undegraded":"2026-02-22T21:44:42.656873+0000","last_fullsized":"2026-02-22T21:44:42.656873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.319749+0000","last_change":"2026-02-22T21:44:35.344663+0000","last_active":"2026-02-22T21:44:42.319749+0000","last_peered":"2026-02-22T21:44:42.319749+0000","last_clean":"2026-02-22T21:44:42.319749+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:42.319749+0000","last_undegraded":"2026-02-22T21:44:42.319749+0000","last_fullsized":"2026-02-22T21:44:42.319749+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:31:51.579380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.496234+0000","last_change":"2026-02-22T21:44:33.648912+0000","last_active":"2026-02-22T21:44:42.496234+0000","last_peered":"2026-02-22T21:44:42.496234+0000","last_clean":"2026-02-22T21:44:42.496234+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:42.496234+0000","last_undegraded":"2026-02-22T21:44:42.496234+0000","last_fullsized":"2026-02-22T21:44:42.496234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:24:46.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27608,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829992,"statfs":{"total":107374182400,"available":107345911808,"internally_reserved":0,"allocated":659456,"data_stored":314775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27596,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830004,"statfs":{"total":107374182400,"available":107345924096,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27588,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830012,"statfs":{"total":107374182400,"available":107345932288,"internally_reserved":0,"allocated":634880,"data_stored":299437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27580,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830020,"statfs":{"total":107374182400,"available":107345940480,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27568,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830032,"statfs":{"total":107374182400,"available":107345952768,"internally_reserved":0,"allocated":610304,"data_stored":281297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397520,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397521,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27600,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830000,"statfs":{"total":107374182400,"available":107345920000,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27576,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":48,"seq":206158430223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 87, 'reported_epoch': 55, 'state': 'peering', 'last_fresh': '2026-02-22T21:44:40.352490+0000', 'last_change': '2026-02-22T21:44:43.359796+0000', 'last_active': '2026-02-22T21:44:43.359796+0000', 'last_peered': '2026-02-22T21:44:40.352490+0000', 'last_clean': '2026-02-22T21:44:40.352490+0000', 'last_became_active': '2026-02-22T21:44:34.855070+0000', 'last_became_peered': '2026-02-22T21:44:34.855070+0000', 'last_unstale': '2026-02-22T21:44:40.352490+0000', 'last_undegraded': '2026-02-22T21:44:40.352490+0000', 'last_fullsized': '2026-02-22T21:44:40.352490+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 49, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_clean_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000182541, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9], 'acting': [9], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:PG 1.4 is not active+clean 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.4', 'version': "0'0", 'reported_seq': 51, 'reported_epoch': 58, 'state': 'peering', 'last_fresh': '2026-02-22T21:44:43.518019+0000', 'last_change': '2026-02-22T21:44:32.335532+0000', 'last_active': '2026-02-22T21:44:32.335532+0000', 'last_peered': '2026-02-22T21:44:29.515530+0000', 'last_clean': '2026-02-22T21:44:29.515530+0000', 'last_became_active': '2026-02-22T21:44:18.632723+0000', 'last_became_peered': '2026-02-22T21:44:18.632723+0000', 'last_unstale': '2026-02-22T21:44:43.518019+0000', 'last_undegraded': '2026-02-22T21:44:43.518019+0000', 'last_fullsized': '2026-02-22T21:44:43.518019+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_clean_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6], 'acting': [6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:PG 1.3 is not active+clean 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.3', 'version': "18'1", 'reported_seq': 82, 'reported_epoch': 57, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-22T21:44:42.357448+0000', 'last_change': '2026-02-22T21:44:42.357419+0000', 'last_active': '2026-02-22T21:44:42.357448+0000', 'last_peered': '2026-02-22T21:44:42.357448+0000', 'last_clean': '2026-02-22T21:44:41.354981+0000', 'last_became_active': '2026-02-22T21:44:42.357419+0000', 'last_became_peered': '2026-02-22T21:44:42.357419+0000', 'last_unstale': '2026-02-22T21:44:42.357448+0000', 'last_undegraded': '2026-02-22T21:44:42.357174+0000', 'last_fullsized': '2026-02-22T21:44:42.357136+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 50, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_clean_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3], 'acting': [3], 'avail_no_missing': ['3'], 'object_location_counts': [{'shards': '3', 'objects': 1}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:PG 1.2 is not active+clean 2026-02-22T21:44:48.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.2', 'version': "20'2", 'reported_seq': 76, 'reported_epoch': 55, 'state': 'peering', 'last_fresh': '2026-02-22T21:44:42.656873+0000', 'last_change': '2026-02-22T21:44:42.710131+0000', 'last_active': '2026-02-22T21:44:42.710131+0000', 'last_peered': '2026-02-22T21:44:42.656873+0000', 'last_clean': '2026-02-22T21:44:42.656873+0000', 'last_became_active': '2026-02-22T21:44:35.345564+0000', 'last_became_peered': '2026-02-22T21:44:35.345564+0000', 'last_unstale': '2026-02-22T21:44:42.656873+0000', 'last_undegraded': '2026-02-22T21:44:42.656873+0000', 'last_fullsized': '2026-02-22T21:44:42.656873+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 50, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'last_clean_scrub_stamp': '2026-02-22T21:43:39.295992+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000289561, 'stat_sum': {'num_bytes': 19, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 2, 'num_write_kb': 2, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4], 'acting': [4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2026-02-22T21:44:48.071 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-22T21:44:48.259 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:48.260 INFO:teuthology.orchestra.run.trial155.stdout:{"fsid":"c45bd854-fea0-47c3-9758-4cd66777c959","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":79,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":62,"num_osds":10,"num_up_osds":10,"osd_up_since":1771796686,"num_in_osds":10,"osd_in_since":1771796610,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"peering","count":3},{"state_name":"active+undersized+degraded","count":1}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":282529792,"bytes_avail":1073459294208,"bytes_total":1073741824000,"inactive_pgs_ratio":0.375,"degraded_objects":1,"degraded_total":4,"degraded_ratio":0.25},"fsmap":{"epoch":1,"btime":"2026-02-22T21:43:28:280153+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2026-02-22T21:44:40.539917+0000","services":{}},"progress_events":{}} 2026-02-22T21:44:48.268 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-22T21:44:48.269 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:44:48.426 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:48.427 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:44:48.435 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-22T21:44:47.365450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275908,"kb_used_data":6220,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048300092,"statfs":{"total":1073741824000,"available":1073459294208,"internally_reserved":0,"allocated":6369280,"data_stored":2999174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008051"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.357121+0000","last_change":"2026-02-22T21:44:35.344918+0000","last_active":"2026-02-22T21:44:42.357121+0000","last_peered":"2026-02-22T21:44:42.357121+0000","last_clean":"2026-02-22T21:44:42.357121+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:42.357121+0000","last_undegraded":"2026-02-22T21:44:42.357121+0000","last_fullsized":"2026-02-22T21:44:42.357121+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:21:22.968102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2026-02-22T21:44:43.517819+0000","last_change":"2026-02-22T21:44:35.345084+0000","last_active":"2026-02-22T21:44:43.517819+0000","last_peered":"2026-02-22T21:44:43.517819+0000","last_clean":"2026-02-22T21:44:43.517819+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:43.517819+0000","last_undegraded":"2026-02-22T21:44:43.517819+0000","last_fullsized":"2026-02-22T21:44:43.517819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:14:48.058069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:40.352490+0000","last_change":"2026-02-22T21:44:43.359796+0000","last_active":"2026-02-22T21:44:43.359796+0000","last_peered":"2026-02-22T21:44:40.352490+0000","last_clean":"2026-02-22T21:44:40.352490+0000","last_became_active":"2026-02-22T21:44:34.855070+0000","last_became_peered":"2026-02-22T21:44:34.855070+0000","last_unstale":"2026-02-22T21:44:40.352490+0000","last_undegraded":"2026-02-22T21:44:40.352490+0000","last_fullsized":"2026-02-22T21:44:40.352490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"peering","last_fresh":"2026-02-22T21:44:43.518019+0000","last_change":"2026-02-22T21:44:32.335532+0000","last_active":"2026-02-22T21:44:32.335532+0000","last_peered":"2026-02-22T21:44:29.515530+0000","last_clean":"2026-02-22T21:44:29.515530+0000","last_became_active":"2026-02-22T21:44:18.632723+0000","last_became_peered":"2026-02-22T21:44:18.632723+0000","last_unstale":"2026-02-22T21:44:43.518019+0000","last_undegraded":"2026-02-22T21:44:43.518019+0000","last_fullsized":"2026-02-22T21:44:43.518019+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":82,"reported_epoch":57,"state":"active+undersized+degraded","last_fresh":"2026-02-22T21:44:42.357448+0000","last_change":"2026-02-22T21:44:42.357419+0000","last_active":"2026-02-22T21:44:42.357448+0000","last_peered":"2026-02-22T21:44:42.357448+0000","last_clean":"2026-02-22T21:44:41.354981+0000","last_became_active":"2026-02-22T21:44:42.357419+0000","last_became_peered":"2026-02-22T21:44:42.357419+0000","last_unstale":"2026-02-22T21:44:42.357448+0000","last_undegraded":"2026-02-22T21:44:42.357174+0000","last_fullsized":"2026-02-22T21:44:42.357136+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":76,"reported_epoch":55,"state":"peering","last_fresh":"2026-02-22T21:44:42.656873+0000","last_change":"2026-02-22T21:44:42.710131+0000","last_active":"2026-02-22T21:44:42.710131+0000","last_peered":"2026-02-22T21:44:42.656873+0000","last_clean":"2026-02-22T21:44:42.656873+0000","last_became_active":"2026-02-22T21:44:35.345564+0000","last_became_peered":"2026-02-22T21:44:35.345564+0000","last_unstale":"2026-02-22T21:44:42.656873+0000","last_undegraded":"2026-02-22T21:44:42.656873+0000","last_fullsized":"2026-02-22T21:44:42.656873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.319749+0000","last_change":"2026-02-22T21:44:35.344663+0000","last_active":"2026-02-22T21:44:42.319749+0000","last_peered":"2026-02-22T21:44:42.319749+0000","last_clean":"2026-02-22T21:44:42.319749+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:42.319749+0000","last_undegraded":"2026-02-22T21:44:42.319749+0000","last_fullsized":"2026-02-22T21:44:42.319749+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:31:51.579380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-22T21:44:42.496234+0000","last_change":"2026-02-22T21:44:33.648912+0000","last_active":"2026-02-22T21:44:42.496234+0000","last_peered":"2026-02-22T21:44:42.496234+0000","last_clean":"2026-02-22T21:44:42.496234+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:42.496234+0000","last_undegraded":"2026-02-22T21:44:42.496234+0000","last_fullsized":"2026-02-22T21:44:42.496234+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:24:46.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27608,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829992,"statfs":{"total":107374182400,"available":107345911808,"internally_reserved":0,"allocated":659456,"data_stored":314775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27596,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830004,"statfs":{"total":107374182400,"available":107345924096,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27588,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830012,"statfs":{"total":107374182400,"available":107345932288,"internally_reserved":0,"allocated":634880,"data_stored":299437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27580,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830020,"statfs":{"total":107374182400,"available":107345940480,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27568,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830032,"statfs":{"total":107374182400,"available":107345952768,"internally_reserved":0,"allocated":610304,"data_stored":281297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397520,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397521,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27600,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830000,"statfs":{"total":107374182400,"available":107345920000,"internally_reserved":0,"allocated":647168,"data_stored":307131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27576,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":16,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27604,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829996,"statfs":{"total":107374182400,"available":107345915904,"internally_reserved":0,"allocated":651264,"data_stored":307150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":48,"seq":206158430223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27584,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830016,"statfs":{"total":107374182400,"available":107345936384,"internally_reserved":0,"allocated":622592,"data_stored":291701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:44:51.439 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:44:51.599 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:51.600 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:44:51.607 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2026-02-22T21:44:50.541007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276584,"kb_used_data":6892,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048299416,"statfs":{"total":1073741824000,"available":1073458601984,"internally_reserved":0,"allocated":7057408,"data_stored":3439285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000677"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410231+0000","last_change":"2026-02-22T21:44:35.344918+0000","last_active":"2026-02-22T21:44:47.410231+0000","last_peered":"2026-02-22T21:44:47.410231+0000","last_clean":"2026-02-22T21:44:47.410231+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:47.410231+0000","last_undegraded":"2026-02-22T21:44:47.410231+0000","last_fullsized":"2026-02-22T21:44:47.410231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:21:22.968102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410412+0000","last_change":"2026-02-22T21:44:35.345084+0000","last_active":"2026-02-22T21:44:47.410412+0000","last_peered":"2026-02-22T21:44:47.410412+0000","last_clean":"2026-02-22T21:44:47.410412+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:47.410412+0000","last_undegraded":"2026-02-22T21:44:47.410412+0000","last_fullsized":"2026-02-22T21:44:47.410412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:14:48.058069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.956367+0000","last_change":"2026-02-22T21:44:47.956367+0000","last_active":"2026-02-22T21:44:47.956367+0000","last_peered":"2026-02-22T21:44:47.956367+0000","last_clean":"2026-02-22T21:44:47.956367+0000","last_became_active":"2026-02-22T21:44:47.956202+0000","last_became_peered":"2026-02-22T21:44:47.956202+0000","last_unstale":"2026-02-22T21:44:47.956367+0000","last_undegraded":"2026-02-22T21:44:47.956367+0000","last_fullsized":"2026-02-22T21:44:47.956367+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:48:05.640948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410164+0000","last_change":"2026-02-22T21:44:45.424995+0000","last_active":"2026-02-22T21:44:47.410164+0000","last_peered":"2026-02-22T21:44:47.410164+0000","last_clean":"2026-02-22T21:44:47.410164+0000","last_became_active":"2026-02-22T21:44:45.424898+0000","last_became_peered":"2026-02-22T21:44:45.424898+0000","last_unstale":"2026-02-22T21:44:47.410164+0000","last_undegraded":"2026-02-22T21:44:47.410164+0000","last_fullsized":"2026-02-22T21:44:47.410164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:36.391798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410250+0000","last_change":"2026-02-22T21:44:45.363513+0000","last_active":"2026-02-22T21:44:47.410250+0000","last_peered":"2026-02-22T21:44:47.410250+0000","last_clean":"2026-02-22T21:44:47.410250+0000","last_became_active":"2026-02-22T21:44:45.363371+0000","last_became_peered":"2026-02-22T21:44:45.363371+0000","last_unstale":"2026-02-22T21:44:47.410250+0000","last_undegraded":"2026-02-22T21:44:47.410250+0000","last_fullsized":"2026-02-22T21:44:47.410250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:10:47.497622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":94,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.366089+0000","last_change":"2026-02-22T21:44:45.364223+0000","last_active":"2026-02-22T21:44:47.366089+0000","last_peered":"2026-02-22T21:44:47.366089+0000","last_clean":"2026-02-22T21:44:47.366089+0000","last_became_active":"2026-02-22T21:44:45.364111+0000","last_became_peered":"2026-02-22T21:44:45.364111+0000","last_unstale":"2026-02-22T21:44:47.366089+0000","last_undegraded":"2026-02-22T21:44:47.366089+0000","last_fullsized":"2026-02-22T21:44:47.366089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:31:40.830206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410406+0000","last_change":"2026-02-22T21:44:35.344663+0000","last_active":"2026-02-22T21:44:47.410406+0000","last_peered":"2026-02-22T21:44:47.410406+0000","last_clean":"2026-02-22T21:44:47.410406+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:47.410406+0000","last_undegraded":"2026-02-22T21:44:47.410406+0000","last_fullsized":"2026-02-22T21:44:47.410406+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:31:51.579380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410403+0000","last_change":"2026-02-22T21:44:33.648912+0000","last_active":"2026-02-22T21:44:47.410403+0000","last_peered":"2026-02-22T21:44:47.410403+0000","last_clean":"2026-02-22T21:44:47.410403+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:47.410403+0000","last_undegraded":"2026-02-22T21:44:47.410403+0000","last_fullsized":"2026-02-22T21:44:47.410403+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:24:46.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659154,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397521,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397522,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27640,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829960,"statfs":{"total":107374182400,"available":107345879040,"internally_reserved":0,"allocated":684032,"data_stored":330578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":59,"seq":253403070481,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":61,"seq":261993005072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":696320,"data_stored":338613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:44:51.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T21:44:51.609 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:44:51.764 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:51.764 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:44:51.772 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2026-02-22T21:44:50.541007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276584,"kb_used_data":6892,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048299416,"statfs":{"total":1073741824000,"available":1073458601984,"internally_reserved":0,"allocated":7057408,"data_stored":3439285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000677"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410231+0000","last_change":"2026-02-22T21:44:35.344918+0000","last_active":"2026-02-22T21:44:47.410231+0000","last_peered":"2026-02-22T21:44:47.410231+0000","last_clean":"2026-02-22T21:44:47.410231+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:47.410231+0000","last_undegraded":"2026-02-22T21:44:47.410231+0000","last_fullsized":"2026-02-22T21:44:47.410231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:21:22.968102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410412+0000","last_change":"2026-02-22T21:44:35.345084+0000","last_active":"2026-02-22T21:44:47.410412+0000","last_peered":"2026-02-22T21:44:47.410412+0000","last_clean":"2026-02-22T21:44:47.410412+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:47.410412+0000","last_undegraded":"2026-02-22T21:44:47.410412+0000","last_fullsized":"2026-02-22T21:44:47.410412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:14:48.058069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.956367+0000","last_change":"2026-02-22T21:44:47.956367+0000","last_active":"2026-02-22T21:44:47.956367+0000","last_peered":"2026-02-22T21:44:47.956367+0000","last_clean":"2026-02-22T21:44:47.956367+0000","last_became_active":"2026-02-22T21:44:47.956202+0000","last_became_peered":"2026-02-22T21:44:47.956202+0000","last_unstale":"2026-02-22T21:44:47.956367+0000","last_undegraded":"2026-02-22T21:44:47.956367+0000","last_fullsized":"2026-02-22T21:44:47.956367+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:48:05.640948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410164+0000","last_change":"2026-02-22T21:44:45.424995+0000","last_active":"2026-02-22T21:44:47.410164+0000","last_peered":"2026-02-22T21:44:47.410164+0000","last_clean":"2026-02-22T21:44:47.410164+0000","last_became_active":"2026-02-22T21:44:45.424898+0000","last_became_peered":"2026-02-22T21:44:45.424898+0000","last_unstale":"2026-02-22T21:44:47.410164+0000","last_undegraded":"2026-02-22T21:44:47.410164+0000","last_fullsized":"2026-02-22T21:44:47.410164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:36.391798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410250+0000","last_change":"2026-02-22T21:44:45.363513+0000","last_active":"2026-02-22T21:44:47.410250+0000","last_peered":"2026-02-22T21:44:47.410250+0000","last_clean":"2026-02-22T21:44:47.410250+0000","last_became_active":"2026-02-22T21:44:45.363371+0000","last_became_peered":"2026-02-22T21:44:45.363371+0000","last_unstale":"2026-02-22T21:44:47.410250+0000","last_undegraded":"2026-02-22T21:44:47.410250+0000","last_fullsized":"2026-02-22T21:44:47.410250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:10:47.497622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":94,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.366089+0000","last_change":"2026-02-22T21:44:45.364223+0000","last_active":"2026-02-22T21:44:47.366089+0000","last_peered":"2026-02-22T21:44:47.366089+0000","last_clean":"2026-02-22T21:44:47.366089+0000","last_became_active":"2026-02-22T21:44:45.364111+0000","last_became_peered":"2026-02-22T21:44:45.364111+0000","last_unstale":"2026-02-22T21:44:47.366089+0000","last_undegraded":"2026-02-22T21:44:47.366089+0000","last_fullsized":"2026-02-22T21:44:47.366089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:31:40.830206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410406+0000","last_change":"2026-02-22T21:44:35.344663+0000","last_active":"2026-02-22T21:44:47.410406+0000","last_peered":"2026-02-22T21:44:47.410406+0000","last_clean":"2026-02-22T21:44:47.410406+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:47.410406+0000","last_undegraded":"2026-02-22T21:44:47.410406+0000","last_fullsized":"2026-02-22T21:44:47.410406+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:31:51.579380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410403+0000","last_change":"2026-02-22T21:44:33.648912+0000","last_active":"2026-02-22T21:44:47.410403+0000","last_peered":"2026-02-22T21:44:47.410403+0000","last_clean":"2026-02-22T21:44:47.410403+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:47.410403+0000","last_undegraded":"2026-02-22T21:44:47.410403+0000","last_fullsized":"2026-02-22T21:44:47.410403+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:24:46.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659154,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397521,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397522,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27640,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829960,"statfs":{"total":107374182400,"available":107345879040,"internally_reserved":0,"allocated":684032,"data_stored":330578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":59,"seq":253403070481,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":61,"seq":261993005072,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":696320,"data_stored":338613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:44:51.772 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T21:44:51.930 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:51.930 INFO:teuthology.orchestra.run.trial155.stdout:{"epoch":62,"fsid":"c45bd854-fea0-47c3-9758-4cd66777c959","created":"2026-02-22T21:43:28.280279+0000","modified":"2026-02-22T21:44:47.363692+0000","last_up_change":"2026-02-22T21:44:46.361097+0000","last_in_change":"2026-02-22T21:43:30.203458+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":11,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-22T21:43:38.776683+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.80000001192092896,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4f08513-24ab-4d1d-aae3-26ed1420b6f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":60,"up_from":61,"up_thru":38,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6850","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6851","nonce":3494561764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6836","nonce":3497561764},{"type":"v1","addr":"10.20.193.155:6837","nonce":3497561764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6856","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6857","nonce":3494561764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6854","nonce":3494561764},{"type":"v1","addr":"10.20.193.155:6855","nonce":3494561764}]},"public_addr":"10.20.193.155:6851/3494561764","cluster_addr":"10.20.193.155:6837/3497561764","heartbeat_back_addr":"10.20.193.155:6857/3494561764","heartbeat_front_addr":"10.20.193.155:6855/3494561764","state":["exists","up"]},{"osd":1,"uuid":"eaa37151-85b4-41db-8c92-f2eac34575dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":58,"up_from":59,"up_thru":59,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6819","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6821","nonce":1335458352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6823","nonce":1338458352},{"type":"v1","addr":"10.20.193.155:6825","nonce":1338458352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6832","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6833","nonce":1335458352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6828","nonce":1335458352},{"type":"v1","addr":"10.20.193.155:6830","nonce":1335458352}]},"public_addr":"10.20.193.155:6821/1335458352","cluster_addr":"10.20.193.155:6825/1338458352","heartbeat_back_addr":"10.20.193.155:6833/1335458352","heartbeat_front_addr":"10.20.193.155:6830/1335458352","state":["exists","up"]},{"osd":2,"uuid":"f4b15007-f3ea-434f-8658-3071a2d414a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":0,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6858","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6860","nonce":3348076260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6812","nonce":3349076260},{"type":"v1","addr":"10.20.193.155:6813","nonce":3349076260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6871","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6873","nonce":3348076260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6867","nonce":3348076260},{"type":"v1","addr":"10.20.193.155:6869","nonce":3348076260}]},"public_addr":"10.20.193.155:6860/3348076260","cluster_addr":"10.20.193.155:6813/3349076260","heartbeat_back_addr":"10.20.193.155:6873/3348076260","heartbeat_front_addr":"10.20.193.155:6869/3348076260","state":["exists","up"]},{"osd":3,"uuid":"c4ef956d-d523-479d-baad-885762d04eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":48,"up_from":49,"up_thru":59,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6802","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6803","nonce":2357208874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6863","nonce":2358208874},{"type":"v1","addr":"10.20.193.155:6865","nonce":2358208874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6808","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6809","nonce":2357208874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6806","nonce":2357208874},{"type":"v1","addr":"10.20.193.155:6807","nonce":2357208874}]},"public_addr":"10.20.193.155:6803/2357208874","cluster_addr":"10.20.193.155:6865/2358208874","heartbeat_back_addr":"10.20.193.155:6809/2357208874","heartbeat_front_addr":"10.20.193.155:6807/2357208874","state":["exists","up"]},{"osd":4,"uuid":"8889f289-f5ca-44b0-99de-80b602390d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":48,"up_from":49,"up_thru":59,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6818","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6820","nonce":1473195548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6804","nonce":1474195548},{"type":"v1","addr":"10.20.193.155:6805","nonce":1474195548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6829","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6831","nonce":1473195548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6826","nonce":1473195548},{"type":"v1","addr":"10.20.193.155:6827","nonce":1473195548}]},"public_addr":"10.20.193.155:6820/1473195548","cluster_addr":"10.20.193.155:6805/1474195548","heartbeat_back_addr":"10.20.193.155:6831/1473195548","heartbeat_front_addr":"10.20.193.155:6827/1473195548","state":["exists","up"]},{"osd":5,"uuid":"dd9bb116-9daf-4949-8e6f-a1ff3491815c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":46,"up_from":47,"up_thru":47,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6859","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6861","nonce":3578142312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6882","nonce":3579142312},{"type":"v1","addr":"10.20.193.155:6883","nonce":3579142312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6870","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6872","nonce":3578142312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6866","nonce":3578142312},{"type":"v1","addr":"10.20.193.155:6868","nonce":3578142312}]},"public_addr":"10.20.193.155:6861/3578142312","cluster_addr":"10.20.193.155:6883/3579142312","heartbeat_back_addr":"10.20.193.155:6872/3578142312","heartbeat_front_addr":"10.20.193.155:6868/3578142312","state":["exists","up"]},{"osd":6,"uuid":"4770e5ca-1786-451f-844c-a11d94a40986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":46,"up_from":47,"up_thru":58,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6834","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6835","nonce":3606448570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6852","nonce":3607448570},{"type":"v1","addr":"10.20.193.155:6853","nonce":3607448570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6840","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6841","nonce":3606448570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6838","nonce":3606448570},{"type":"v1","addr":"10.20.193.155:6839","nonce":3606448570}]},"public_addr":"10.20.193.155:6835/3606448570","cluster_addr":"10.20.193.155:6853/3607448570","heartbeat_back_addr":"10.20.193.155:6841/3606448570","heartbeat_front_addr":"10.20.193.155:6839/3606448570","state":["exists","up"]},{"osd":7,"uuid":"ddf38fa7-90be-487e-b37f-65188913b794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":49,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6810","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6811","nonce":3496130001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6844","nonce":3497130001},{"type":"v1","addr":"10.20.193.155:6845","nonce":3497130001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6816","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6817","nonce":3496130001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6814","nonce":3496130001},{"type":"v1","addr":"10.20.193.155:6815","nonce":3496130001}]},"public_addr":"10.20.193.155:6811/3496130001","cluster_addr":"10.20.193.155:6845/3497130001","heartbeat_back_addr":"10.20.193.155:6817/3496130001","heartbeat_front_addr":"10.20.193.155:6815/3496130001","state":["exists","up"]},{"osd":8,"uuid":"5042959c-0b17-4d80-92fc-1a3f8eb98f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":46,"up_from":47,"up_thru":17,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6874","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6875","nonce":3263333326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6862","nonce":3265333326},{"type":"v1","addr":"10.20.193.155:6864","nonce":3265333326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6880","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6881","nonce":3263333326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6878","nonce":3263333326},{"type":"v1","addr":"10.20.193.155:6879","nonce":3263333326}]},"public_addr":"10.20.193.155:6875/3263333326","cluster_addr":"10.20.193.155:6864/3265333326","heartbeat_back_addr":"10.20.193.155:6881/3263333326","heartbeat_front_addr":"10.20.193.155:6879/3263333326","state":["exists","up"]},{"osd":9,"uuid":"3a85d59d-2ad6-4279-ba1c-b634fc26ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":40,"up_from":41,"up_thru":61,"down_at":38,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6842","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6843","nonce":2400902815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6876","nonce":2401902815},{"type":"v1","addr":"10.20.193.155:6877","nonce":2401902815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6848","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6849","nonce":2400902815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.155:6846","nonce":2400902815},{"type":"v1","addr":"10.20.193.155:6847","nonce":2400902815}]},"public_addr":"10.20.193.155:6843/2400902815","cluster_addr":"10.20.193.155:6877/2401902815","heartbeat_back_addr":"10.20.193.155:6849/2400902815","heartbeat_front_addr":"10.20.193.155:6847/2400902815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-22T21:44:41.351663+0000","laggy_probability":0.65700000524520874,"laggy_interval":1,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.607072+0000","dead_epoch":59},{"osd":1,"down_stamp":"2026-02-22T21:44:41.351663+0000","laggy_probability":0.65700000524520874,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.888962+0000","dead_epoch":56},{"osd":2,"down_stamp":"2026-02-22T21:44:29.327746+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.171467+0000","dead_epoch":45},{"osd":3,"down_stamp":"2026-02-22T21:44:29.327746+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.757581+0000","dead_epoch":46},{"osd":4,"down_stamp":"2026-02-22T21:44:29.327746+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.672018+0000","dead_epoch":46},{"osd":5,"down_stamp":"2026-02-22T21:44:29.327746+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.676696+0000","dead_epoch":46},{"osd":6,"down_stamp":"2026-02-22T21:44:29.327746+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.491709+0000","dead_epoch":45},{"osd":7,"down_stamp":"2026-02-22T21:44:29.327746+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:35.746379+0000","dead_epoch":44},{"osd":8,"down_stamp":"2026-02-22T21:44:29.327746+0000","laggy_probability":0.50999999046325684,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.714069+0000","dead_epoch":45},{"osd":9,"down_stamp":"2026-02-22T21:44:23.315788+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T21:43:36.497911+0000","dead_epoch":38}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T21:44:52.940 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T21:44:52.940 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:53.022 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:53.022 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:53.022 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:53.028 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T21:44:53.188 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T21:44:53.197 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T21:44:53.198 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:53.279 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:53.280 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:53.280 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:53.286 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T21:44:53.447 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T21:44:53.456 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T21:44:53.456 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:53.537 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:53.537 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:53.538 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:53.543 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T21:44:53.700 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T21:44:53.709 INFO:tasks.ceph:Scrubbing osd.3 2026-02-22T21:44:53.709 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:53.791 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:53.791 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:53.791 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:53.797 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-22T21:44:53.956 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 3 to deep-scrub 2026-02-22T21:44:53.964 INFO:tasks.ceph:Scrubbing osd.4 2026-02-22T21:44:53.964 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:54.042 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:54.042 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:54.043 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:54.050 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-22T21:44:54.207 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 4 to deep-scrub 2026-02-22T21:44:54.215 INFO:tasks.ceph:Scrubbing osd.5 2026-02-22T21:44:54.216 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:54.297 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:54.297 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:54.297 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:54.303 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-22T21:44:54.459 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 5 to deep-scrub 2026-02-22T21:44:54.468 INFO:tasks.ceph:Scrubbing osd.6 2026-02-22T21:44:54.468 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:54.548 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:54.549 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:54.549 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:54.555 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-22T21:44:54.712 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 6 to deep-scrub 2026-02-22T21:44:54.720 INFO:tasks.ceph:Scrubbing osd.7 2026-02-22T21:44:54.721 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:54.802 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:54.802 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:54.802 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:54.809 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-22T21:44:54.968 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 7 to deep-scrub 2026-02-22T21:44:54.977 INFO:tasks.ceph:Scrubbing osd.8 2026-02-22T21:44:54.977 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:55.058 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:55.058 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:55.058 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:55.064 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-22T21:44:55.222 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 8 to deep-scrub 2026-02-22T21:44:55.231 INFO:tasks.ceph:Scrubbing osd.9 2026-02-22T21:44:55.231 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-22T21:44:55.312 INFO:teuthology.orchestra.run.trial155.stdout:{ 2026-02-22T21:44:55.312 INFO:teuthology.orchestra.run.trial155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T21:44:55.312 INFO:teuthology.orchestra.run.trial155.stdout:} 2026-02-22T21:44:55.317 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-22T21:44:55.475 INFO:teuthology.orchestra.run.trial155.stderr:instructed osd(s) 9 to deep-scrub 2026-02-22T21:44:55.484 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:44:55.640 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:44:55.640 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:44:55.647 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2026-02-22T21:44:54.541451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276608,"kb_used_data":6928,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048299392,"statfs":{"total":1073741824000,"available":1073458577408,"internally_reserved":0,"allocated":7094272,"data_stored":3462608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.179373"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410231+0000","last_change":"2026-02-22T21:44:35.344918+0000","last_active":"2026-02-22T21:44:47.410231+0000","last_peered":"2026-02-22T21:44:47.410231+0000","last_clean":"2026-02-22T21:44:47.410231+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:47.410231+0000","last_undegraded":"2026-02-22T21:44:47.410231+0000","last_fullsized":"2026-02-22T21:44:47.410231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:21:22.968102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410412+0000","last_change":"2026-02-22T21:44:35.345084+0000","last_active":"2026-02-22T21:44:47.410412+0000","last_peered":"2026-02-22T21:44:47.410412+0000","last_clean":"2026-02-22T21:44:47.410412+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:47.410412+0000","last_undegraded":"2026-02-22T21:44:47.410412+0000","last_fullsized":"2026-02-22T21:44:47.410412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:14:48.058069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.956367+0000","last_change":"2026-02-22T21:44:47.956367+0000","last_active":"2026-02-22T21:44:47.956367+0000","last_peered":"2026-02-22T21:44:47.956367+0000","last_clean":"2026-02-22T21:44:47.956367+0000","last_became_active":"2026-02-22T21:44:47.956202+0000","last_became_peered":"2026-02-22T21:44:47.956202+0000","last_unstale":"2026-02-22T21:44:47.956367+0000","last_undegraded":"2026-02-22T21:44:47.956367+0000","last_fullsized":"2026-02-22T21:44:47.956367+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:48:05.640948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":81,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410164+0000","last_change":"2026-02-22T21:44:45.424995+0000","last_active":"2026-02-22T21:44:47.410164+0000","last_peered":"2026-02-22T21:44:47.410164+0000","last_clean":"2026-02-22T21:44:47.410164+0000","last_became_active":"2026-02-22T21:44:45.424898+0000","last_became_peered":"2026-02-22T21:44:45.424898+0000","last_unstale":"2026-02-22T21:44:47.410164+0000","last_undegraded":"2026-02-22T21:44:47.410164+0000","last_fullsized":"2026-02-22T21:44:47.410164+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:25:36.391798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"18'1","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410250+0000","last_change":"2026-02-22T21:44:45.363513+0000","last_active":"2026-02-22T21:44:47.410250+0000","last_peered":"2026-02-22T21:44:47.410250+0000","last_clean":"2026-02-22T21:44:47.410250+0000","last_became_active":"2026-02-22T21:44:45.363371+0000","last_became_peered":"2026-02-22T21:44:45.363371+0000","last_unstale":"2026-02-22T21:44:47.410250+0000","last_undegraded":"2026-02-22T21:44:47.410250+0000","last_fullsized":"2026-02-22T21:44:47.410250+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:10:47.497622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"20'2","reported_seq":94,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.366089+0000","last_change":"2026-02-22T21:44:45.364223+0000","last_active":"2026-02-22T21:44:47.366089+0000","last_peered":"2026-02-22T21:44:47.366089+0000","last_clean":"2026-02-22T21:44:47.366089+0000","last_became_active":"2026-02-22T21:44:45.364111+0000","last_became_peered":"2026-02-22T21:44:45.364111+0000","last_unstale":"2026-02-22T21:44:47.366089+0000","last_undegraded":"2026-02-22T21:44:47.366089+0000","last_fullsized":"2026-02-22T21:44:47.366089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:31:40.830206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":85,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410406+0000","last_change":"2026-02-22T21:44:35.344663+0000","last_active":"2026-02-22T21:44:47.410406+0000","last_peered":"2026-02-22T21:44:47.410406+0000","last_clean":"2026-02-22T21:44:47.410406+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:47.410406+0000","last_undegraded":"2026-02-22T21:44:47.410406+0000","last_fullsized":"2026-02-22T21:44:47.410406+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:31:51.579380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:47.410403+0000","last_change":"2026-02-22T21:44:33.648912+0000","last_active":"2026-02-22T21:44:47.410403+0000","last_peered":"2026-02-22T21:44:47.410403+0000","last_clean":"2026-02-22T21:44:47.410403+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:47.410403+0000","last_undegraded":"2026-02-22T21:44:47.410403+0000","last_fullsized":"2026-02-22T21:44:47.410403+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:43:39.295992+0000","last_clean_scrub_stamp":"2026-02-22T21:43:39.295992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:24:46.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659155,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397522,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397523,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":59,"seq":253403070482,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27664,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":61,"seq":261993005073,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27656,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829944,"statfs":{"total":107374182400,"available":107345862656,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T21:43:39.295992+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=43, tm_sec=39, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=21, tm_min=44, tm_sec=51, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T21:44:55.650 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T21:45:15.651 DEBUG:teuthology.orchestra.run.trial155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T21:45:15.812 INFO:teuthology.orchestra.run.trial155.stdout: 2026-02-22T21:45:15.812 INFO:teuthology.orchestra.run.trial155.stderr:dumped all 2026-02-22T21:45:15.820 INFO:teuthology.orchestra.run.trial155.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2026-02-22T21:45:14.543173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276552,"kb_used_data":6928,"kb_used_omap":15,"kb_used_meta":269424,"kb_avail":1048299448,"statfs":{"total":1073741824000,"available":1073458634752,"internally_reserved":0,"allocated":7094272,"data_stored":3462608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15937,"internal_metadata":275890623},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000966"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":86,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:54.574910+0000","last_change":"2026-02-22T21:44:54.574923+0000","last_active":"2026-02-22T21:44:54.574910+0000","last_peered":"2026-02-22T21:44:54.574910+0000","last_clean":"2026-02-22T21:44:54.574910+0000","last_became_active":"2026-02-22T21:44:35.344780+0000","last_became_peered":"2026-02-22T21:44:35.344780+0000","last_unstale":"2026-02-22T21:44:54.574910+0000","last_undegraded":"2026-02-22T21:44:54.574910+0000","last_fullsized":"2026-02-22T21:44:54.574910+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:44:54.574869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:44:54.574869+0000","last_clean_scrub_stamp":"2026-02-22T21:44:54.574869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:15:49.288565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000163265,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":109,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:55.513908+0000","last_change":"2026-02-22T21:44:55.513917+0000","last_active":"2026-02-22T21:44:55.513908+0000","last_peered":"2026-02-22T21:44:55.513908+0000","last_clean":"2026-02-22T21:44:55.513908+0000","last_became_active":"2026-02-22T21:44:35.344926+0000","last_became_peered":"2026-02-22T21:44:35.344926+0000","last_unstale":"2026-02-22T21:44:55.513908+0000","last_undegraded":"2026-02-22T21:44:55.513908+0000","last_fullsized":"2026-02-22T21:44:55.513908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:44:55.513877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:44:55.513877+0000","last_clean_scrub_stamp":"2026-02-22T21:44:55.513877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:39:16.741611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017829400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":113,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:55.757855+0000","last_change":"2026-02-22T21:44:55.757867+0000","last_active":"2026-02-22T21:44:55.757855+0000","last_peered":"2026-02-22T21:44:55.757855+0000","last_clean":"2026-02-22T21:44:55.757855+0000","last_became_active":"2026-02-22T21:44:47.956202+0000","last_became_peered":"2026-02-22T21:44:47.956202+0000","last_unstale":"2026-02-22T21:44:55.757855+0000","last_undegraded":"2026-02-22T21:44:55.757855+0000","last_fullsized":"2026-02-22T21:44:55.757855+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:44:55.757821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:44:55.757821+0000","last_clean_scrub_stamp":"2026-02-22T21:44:55.757821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:15:44.824363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018254100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":90,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:54.174166+0000","last_change":"2026-02-22T21:44:54.174181+0000","last_active":"2026-02-22T21:44:54.174166+0000","last_peered":"2026-02-22T21:44:54.174166+0000","last_clean":"2026-02-22T21:44:54.174166+0000","last_became_active":"2026-02-22T21:44:45.424898+0000","last_became_peered":"2026-02-22T21:44:45.424898+0000","last_unstale":"2026-02-22T21:44:54.174166+0000","last_undegraded":"2026-02-22T21:44:54.174166+0000","last_fullsized":"2026-02-22T21:44:54.174166+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:44:54.174124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:44:54.174124+0000","last_clean_scrub_stamp":"2026-02-22T21:44:54.174124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:22:23.671596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"62'2","reported_seq":107,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:55.545845+0000","last_change":"2026-02-22T21:44:55.545859+0000","last_active":"2026-02-22T21:44:55.545845+0000","last_peered":"2026-02-22T21:44:55.545845+0000","last_clean":"2026-02-22T21:44:55.545845+0000","last_became_active":"2026-02-22T21:44:45.363371+0000","last_became_peered":"2026-02-22T21:44:45.363371+0000","last_unstale":"2026-02-22T21:44:55.545845+0000","last_undegraded":"2026-02-22T21:44:55.545845+0000","last_fullsized":"2026-02-22T21:44:55.545845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2026-02-22T21:44:55.545818+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2026-02-22T21:44:55.545818+0000","last_clean_scrub_stamp":"2026-02-22T21:44:55.545818+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:28:42.964229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"62'3","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:55.072428+0000","last_change":"2026-02-22T21:44:55.072439+0000","last_active":"2026-02-22T21:44:55.072428+0000","last_peered":"2026-02-22T21:44:55.072428+0000","last_clean":"2026-02-22T21:44:55.072428+0000","last_became_active":"2026-02-22T21:44:45.364111+0000","last_became_peered":"2026-02-22T21:44:45.364111+0000","last_unstale":"2026-02-22T21:44:55.072428+0000","last_undegraded":"2026-02-22T21:44:55.072428+0000","last_fullsized":"2026-02-22T21:44:55.072428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'3","last_scrub_stamp":"2026-02-22T21:44:55.072401+0000","last_deep_scrub":"62'3","last_deep_scrub_stamp":"2026-02-22T21:44:55.072401+0000","last_clean_scrub_stamp":"2026-02-22T21:44:55.072401+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:19:20.223076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00028956099999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":94,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:55.905525+0000","last_change":"2026-02-22T21:44:55.905538+0000","last_active":"2026-02-22T21:44:55.905525+0000","last_peered":"2026-02-22T21:44:55.905525+0000","last_clean":"2026-02-22T21:44:55.905525+0000","last_became_active":"2026-02-22T21:44:35.344535+0000","last_became_peered":"2026-02-22T21:44:35.344535+0000","last_unstale":"2026-02-22T21:44:55.905525+0000","last_undegraded":"2026-02-22T21:44:55.905525+0000","last_fullsized":"2026-02-22T21:44:55.905525+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:44:55.905491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:44:55.905491+0000","last_clean_scrub_stamp":"2026-02-22T21:44:55.905491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:48:03.160063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017100000000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T21:44:55.447197+0000","last_change":"2026-02-22T21:44:55.447209+0000","last_active":"2026-02-22T21:44:55.447197+0000","last_peered":"2026-02-22T21:44:55.447197+0000","last_clean":"2026-02-22T21:44:55.447197+0000","last_became_active":"2026-02-22T21:44:33.648810+0000","last_became_peered":"2026-02-22T21:44:33.648810+0000","last_unstale":"2026-02-22T21:44:55.447197+0000","last_undegraded":"2026-02-22T21:44:55.447197+0000","last_fullsized":"2026-02-22T21:44:55.447197+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T21:44:55.447160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T21:44:55.447160+0000","last_clean_scrub_stamp":"2026-02-22T21:44:55.447160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:30:18.373725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":41,"seq":176093659159,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27664,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829936,"statfs":{"total":107374182400,"available":107345854464,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462934,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":49,"seq":210453397526,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27656,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829944,"statfs":{"total":107374182400,"available":107345862656,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":49,"seq":210453397527,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27652,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829948,"statfs":{"total":107374182400,"available":107345866752,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27660,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829940,"statfs":{"total":107374182400,"available":107345858560,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":59,"seq":253403070486,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27656,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829944,"statfs":{"total":107374182400,"available":107345862656,"internally_reserved":0,"allocated":712704,"data_stored":346276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":61,"seq":261993005077,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27656,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104829944,"statfs":{"total":107374182400,"available":107345862656,"internally_reserved":0,"allocated":708608,"data_stored":346257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T21:45:15.822 DEBUG:teuthology.orchestra.run.trial155:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T21:45:15.992 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T21:45:15.992 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T21:45:15.992 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T21:45:15.992 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.028 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T21:45:16.028 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T21:45:16.028 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.096 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T21:45:16.096 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T21:45:16.096 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.166 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T21:45:16.166 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-22T21:45:16.166 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.242 INFO:tasks.ceph.osd.3:Stopped 2026-02-22T21:45:16.242 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-22T21:45:16.242 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.312 INFO:tasks.ceph.osd.4:Stopped 2026-02-22T21:45:16.312 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-22T21:45:16.312 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.380 INFO:tasks.ceph.osd.5:Stopped 2026-02-22T21:45:16.381 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-22T21:45:16.381 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.449 INFO:tasks.ceph.osd.6:Stopped 2026-02-22T21:45:16.450 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-22T21:45:16.450 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.523 INFO:tasks.ceph.osd.7:Stopped 2026-02-22T21:45:16.524 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-22T21:45:16.524 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.598 INFO:tasks.ceph.osd.8:Stopped 2026-02-22T21:45:16.599 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-22T21:45:16.599 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.675 INFO:tasks.ceph.osd.9:Stopped 2026-02-22T21:45:16.675 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T21:45:16.675 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T21:45:16.676 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.751 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T21:45:16.751 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T21:45:16.751 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T21:45:16.751 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T21:45:16.802 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T21:45:16.802 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T21:45:16.802 DEBUG:teuthology.orchestra.run.trial155:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-22T21:45:16.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:45:16.868 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T21:45:16.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:45:16.939 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T21:45:17.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:45:17.009 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T21:45:17.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:45:17.083 DEBUG:teuthology.orchestra.run.trial155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-22T21:45:17.154 INFO:tasks.ceph:Archiving mon data... 2026-02-22T21:45:17.158 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64097/data/mon.a.tgz 2026-02-22T21:45:17.159 DEBUG:teuthology.orchestra.run.trial155:> mktemp 2026-02-22T21:45:17.210 INFO:teuthology.orchestra.run.trial155.stdout:/tmp/tmp.ulMbZeyww5 2026-02-22T21:45:17.211 DEBUG:teuthology.orchestra.run.trial155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ulMbZeyww5 2026-02-22T21:45:17.300 DEBUG:teuthology.orchestra.run.trial155:> sudo chmod 0666 /tmp/tmp.ulMbZeyww5 2026-02-22T21:45:17.382 DEBUG:teuthology.orchestra.remote:trial155:/tmp/tmp.ulMbZeyww5 is 206KB 2026-02-22T21:45:17.473 DEBUG:teuthology.orchestra.run.trial155:> rm -fr /tmp/tmp.ulMbZeyww5 2026-02-22T21:45:17.490 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T21:45:17.490 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T21:45:17.610 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T21:45:17.610 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T21:45:17.613 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64097/remote/trial155/crash 2026-02-22T21:45:17.614 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T21:45:17.675 INFO:tasks.ceph:Compressing logs... 2026-02-22T21:45:17.675 DEBUG:teuthology.orchestra.run.trial155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:45:17.739 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57313.log 2026-02-22T21:45:17.739 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T21:45:17.740 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57313.log.gz 2026-02-22T21:45:17.740 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T21:45:17.740 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57338.log 2026-02-22T21:45:17.740 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56819.log 2026-02-22T21:45:17.740 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57240.log 2026-02-22T21:45:17.741 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57338.log: /var/log/ceph/ceph-client.admin.56819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57338.log.gz 2026-02-22T21:45:17.741 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56819.log.gz 2026-02-22T21:45:17.741 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57438.log 2026-02-22T21:45:17.741 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54112.log 2026-02-22T21:45:17.741 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57240.log.gz 2026-02-22T21:45:17.741 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57388.log 2026-02-22T21:45:17.741 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57438.log.gz 2026-02-22T21:45:17.742 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54112.log.gz 2026-02-22T21:45:17.742 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T21:45:17.742 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48363.log 2026-02-22T21:45:17.742 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57388.log.gz 2026-02-22T21:45:17.742 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56794.log 2026-02-22T21:45:17.742 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48363.log.gz 2026-02-22T21:45:17.742 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57264.log 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54109.log 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56794.log.gz 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56719.log 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57264.log.gz 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54109.log.gz 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58937.log 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57464.log 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56719.log.gz 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56468.log 2026-02-22T21:45:17.743 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58937.log.gz 2026-02-22T21:45:17.744 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57464.log.gz 2026-02-22T21:45:17.744 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57216.log 2026-02-22T21:45:17.744 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56468.log.gz 2026-02-22T21:45:17.744 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-22T21:45:17.744 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58790.log 2026-02-22T21:45:17.744 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57216.log.gz 2026-02-22T21:45:17.744 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54114.log 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56443.log 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58790.log.gz 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54111.log 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54114.log.gz 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55101.log 0.0% 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56443.log.gz 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48316.log 2026-02-22T21:45:17.745 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54111.log.gz 2026-02-22T21:45:17.746 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55101.log.gz 2026-02-22T21:45:17.746 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56546.log 2026-02-22T21:45:17.746 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53724.log 2026-02-22T21:45:17.746 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48316.log.gz 2026-02-22T21:45:17.746 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55616.log 2026-02-22T21:45:17.746 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56546.log.gz 2026-02-22T21:45:17.746 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.53724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53633.log 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53724.log.gz 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56194.log 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55616.log.gz 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.53633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57363.log 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53633.log.gz 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55341.log 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56194.log.gz 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57363.log.gz 2026-02-22T21:45:17.747 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59035.log 2026-02-22T21:45:17.748 INFO:teuthology.orchestra.run.trial155.stderr:gzip/var/log/ceph/ceph-client.admin.55341.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56744.log 2026-02-22T21:45:17.748 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55341.log.gz 2026-02-22T21:45:17.748 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.59035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59035.log.gz 2026-02-22T21:45:17.748 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53773.log 2026-02-22T21:45:17.748 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 2026-02-22T21:45:17.748 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56744.log.gz 2026-02-22T21:45:17.748 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.53773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55880.log 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53773.log.gz 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55132.log 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55880.log.gz 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58104.log 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55132.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55132.log.gz 2026-02-22T21:45:17.749 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58104.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.58104.log.gz -- 2026-02-22T21:45:17.750 INFO:teuthology.orchestra.run.trial155.stderr: /var/log/ceph/ceph-client.admin.57711.log 2026-02-22T21:45:17.750 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56694.log 2026-02-22T21:45:17.750 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.57711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57711.log.gz 2026-02-22T21:45:17.750 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57041.log 2026-02-22T21:45:17.750 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54614.log 2026-02-22T21:45:17.750 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56694.log.gz 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57041.log.gz 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58300.log 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56344.log 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54614.log.gz 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58300.log.gz 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53658.log 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53822.log 2026-02-22T21:45:17.751 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56344.log.gz 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.53658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57091.log 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53658.log.gz 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.53822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57613.log 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53822.log.gz 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58496.log 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57091.log.gz 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54611.log 2026-02-22T21:45:17.752 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57613.log.gz 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57412.log 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58496.log.gz 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55388.log 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54611.log.gz 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53563.log 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57412.log.gz 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54107.log 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55388.log.gz 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.53563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55645.log 2026-02-22T21:45:17.753 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53563.log.gz 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58202.log 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54107.log.gz 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56645.log 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55645.log.gz 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56166.log 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58202.log.gz 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56893.log 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56645.log.gz 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57143.log 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56166.log.gz 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56520.log 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56893.log.gz 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54099.log 2026-02-22T21:45:17.755 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57143.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56319.log 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56520.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55122.log 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54099.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48515.log 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56319.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55122.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55638.log 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48515.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56393.log 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56572.log 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55638.log.gz 2026-02-22T21:45:17.756 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56597.log 2026-02-22T21:45:17.757 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56393.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54093.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56572.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55119.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56597.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54105.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54093.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56218.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55119.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58741.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54105.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55624.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56218.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58153.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58741.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55624.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55624.log.gz 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49090.log 2026-02-22T21:45:17.758 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58153.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57066.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.49090.log: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57957.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57066.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57957.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58349.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54598.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54592.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58349.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54601.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54598.log.gz 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57760.log 2026-02-22T21:45:17.760 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54592.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48128.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54601.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48222.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57760.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58692.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48128.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48222.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48222.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48468.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58692.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55112.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.48468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55654.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48468.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58545.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55112.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58594.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55654.log.gz 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56991.log 2026-02-22T21:45:17.762 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58545.log.gz 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55637.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58594.log.gz 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55929.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56991.log.gz 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55637.log.gz 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58986.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56294.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55929.log.gz 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58986.log.gz 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56294.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56294.log.gz 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54590.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57288.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57662.log 2026-02-22T21:45:17.764 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54590.log.gz 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57288.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.57288.log.gz --verbose 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr: -- /var/log/ceph/ceph-client.admin.58006.log 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58839.log 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57662.log.gz 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58006.log.gz 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47760.log 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56966.log 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58839.log.gz 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.47760.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47760.log.gz -5 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54113.log 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56942.log 2026-02-22T21:45:17.765 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56966.log.gz 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54113.log.gz 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56493.log 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54609.log 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56942.log.gz 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58251.log 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56493.log.gz 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2026-02-22T21:45:17.766 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54609.log.gz 2026-02-22T21:45:17.767 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54098.log 2026-02-22T21:45:17.767 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58251.log.gz 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.47648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56918.log 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54098.log.gz 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56843.log 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57192.log 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56918.log.gz 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56270.log 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56843.log.gz 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55118.log 2026-02-22T21:45:17.768 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57192.log.gz 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56270.log.gz 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58888.log 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58055.log 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55118.log.gz 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57859.log 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58888.log.gz 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58055.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58055.log.gz 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58643.log 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57859.log.gz 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48417.log 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48175.log 2026-02-22T21:45:17.769 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58643.log.gz 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54612.log 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55831.log 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48175.log.gz 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56769.log 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54612.log.gz 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55831.log.gz 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55121.log 2026-02-22T21:45:17.770 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57117.log 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56769.log.gz 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55444.log 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55121.log.gz 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57117.log.gz 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56418.log 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5/var/log/ceph/ceph-client.admin.55444.log: --verbose -- /var/log/ceph/ceph-client.admin.57809.log 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55444.log.gz 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56868.log 2026-02-22T21:45:17.771 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56418.log.gz 2026-02-22T21:45:17.772 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57809.log.gz 2026-02-22T21:45:17.772 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2026-02-22T21:45:17.772 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T21:45:17.772 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56868.log.gz 2026-02-22T21:45:17.772 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.48269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56368.log 2026-02-22T21:45:17.772 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56368.log.gz 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58398.log 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55129.log 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58398.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.58398.log.gz 2026-02-22T21:45:17.773 INFO:teuthology.orchestra.run.trial155.stderr: /var/log/ceph/ceph-client.admin.55443.log 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58447.log 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55129.log.gz 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.55443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55443.log.gz 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54361.log 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.58447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58447.log.gz 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57908.log 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57168.log 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54361.log.gz 2026-02-22T21:45:17.774 INFO:teuthology.orchestra.run.trial155.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-22T21:45:17.775 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57016.log 2026-02-22T21:45:17.775 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57908.log.gz 2026-02-22T21:45:17.775 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57168.log.gz 2026-02-22T21:45:17.775 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54851.log 2026-02-22T21:45:17.775 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.57016.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37803.log 2026-02-22T21:45:17.775 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57016.log.gz 2026-02-22T21:45:17.775 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56669.log 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54851.log.gz 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph.tmp-client.admin.37803.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37803.log.gz 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54617.log 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.56669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59082.log 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56669.log.gz 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.54617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54617.log.gz 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-22T21:45:17.776 INFO:teuthology.orchestra.run.trial155.stderr:/var/log/ceph/ceph-client.admin.59082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59082.log.gz 2026-02-22T21:45:17.781 INFO:teuthology.orchestra.run.trial155.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T21:45:17.788 INFO:teuthology.orchestra.run.trial155.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-22T21:45:17.791 INFO:teuthology.orchestra.run.trial155.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-22T21:45:17.794 INFO:teuthology.orchestra.run.trial155.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T21:45:17.794 INFO:teuthology.orchestra.run.trial155.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-22T21:45:17.801 INFO:teuthology.orchestra.run.trial155.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T21:45:17.804 INFO:teuthology.orchestra.run.trial155.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-22T21:45:17.805 INFO:teuthology.orchestra.run.trial155.stderr: 2026-02-22T21:45:17.805 INFO:teuthology.orchestra.run.trial155.stderr:real 0m0.074s 2026-02-22T21:45:17.805 INFO:teuthology.orchestra.run.trial155.stderr:user 0m0.372s 2026-02-22T21:45:17.806 INFO:teuthology.orchestra.run.trial155.stderr:sys 0m0.075s 2026-02-22T21:45:17.806 INFO:tasks.ceph:Archiving logs... 2026-02-22T21:45:17.806 DEBUG:teuthology.misc:Transferring archived files from trial155:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64097/remote/trial155/log 2026-02-22T21:45:17.808 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T21:45:18.094 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T21:45:18.119 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T21:45:18.119 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T21:45:18.228 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T21:45:18.239 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T21:45:18.239 DEBUG:teuthology.orchestra.run.trial155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T21:45:18.254 INFO:teuthology.orchestra.run.trial155.stderr:bash: line 1: ntpq: command not found 2026-02-22T21:45:18.315 INFO:teuthology.orchestra.run.trial155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-22T21:45:18.316 INFO:teuthology.orchestra.run.trial155.stdout:=============================================================================== 2026-02-22T21:45:18.316 INFO:teuthology.orchestra.run.trial155.stdout:^* 66.59.198.178 2 6 77 62 -49us[ -208us] +/- 15ms 2026-02-22T21:45:18.316 INFO:teuthology.orchestra.run.trial155.stdout:^+ rain.bz 1 6 77 61 +101us[ +101us] +/- 24ms 2026-02-22T21:45:18.316 INFO:teuthology.orchestra.run.trial155.stdout:^- 69-10-208-170.rainiercon> 2 6 77 62 +8077us[+7919us] +/- 92ms 2026-02-22T21:45:18.316 INFO:teuthology.orchestra.run.trial155.stdout:^+ s2-a.time.mci1.us.rozint> 2 6 77 60 +259us[ +259us] +/- 23ms 2026-02-22T21:45:18.317 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T21:45:18.329 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T21:45:18.330 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T21:45:18.342 DEBUG:teuthology.orchestra.run.trial155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-22T21:45:18.414 DEBUG:teuthology.orchestra.run.trial155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-22T21:45:18.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:45:18.441 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T21:45:18.455 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T21:45:18.470 INFO:teuthology.task.internal:Duration was 357.519769 seconds 2026-02-22T21:45:18.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T21:45:18.484 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T21:45:18.484 DEBUG:teuthology.orchestra.run.trial155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T21:45:18.521 INFO:teuthology.orchestra.run.trial155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-22T21:45:18.695 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T21:45:18.695 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial155.front.sepia.ceph.com 2026-02-22T21:45:18.695 DEBUG:teuthology.orchestra.run.trial155:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T21:45:18.752 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T21:45:18.753 DEBUG:teuthology.orchestra.run.trial155:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:45:18.854 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T21:45:18.854 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T21:45:18.878 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T21:45:18.878 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T21:45:18.878 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T21:45:18.879 INFO:teuthology.orchestra.run.trial155.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T21:45:18.879 INFO:teuthology.orchestra.run.trial155.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/journalctl.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T21:45:18.889 INFO:teuthology.orchestra.run.trial155.stderr: 82.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T21:45:18.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T21:45:18.908 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T21:45:18.908 DEBUG:teuthology.orchestra.run.trial155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T21:45:18.956 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T21:45:18.974 DEBUG:teuthology.orchestra.run.trial155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:45:19.021 INFO:teuthology.orchestra.run.trial155.stdout:kernel.core_pattern = core 2026-02-22T21:45:19.039 DEBUG:teuthology.orchestra.run.trial155:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T21:45:19.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T21:45:19.095 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T21:45:19.110 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T21:45:19.111 DEBUG:teuthology.misc:Transferring archived files from trial155:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64097/remote/trial155 2026-02-22T21:45:19.111 DEBUG:teuthology.orchestra.run.trial155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T21:45:19.172 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T21:45:19.172 DEBUG:teuthology.orchestra.run.trial155:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T21:45:19.223 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T21:45:19.243 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T21:45:19.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T21:45:19.262 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T21:45:19.262 DEBUG:teuthology.orchestra.run.trial155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T21:45:19.279 INFO:teuthology.orchestra.run.trial155.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 21:45 /home/ubuntu/cephtest 2026-02-22T21:45:19.280 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T21:45:19.298 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T21:45:19.329 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_latest}} duration: 357.5197687149048 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T21:45:19.330 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T21:45:19.415 INFO:teuthology.run:pass