2026-02-22T22:30:09.836 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T22:30:09.850 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T22:30:09.926 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64249 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64249' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 9196 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial041.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPtdrd8fIQe5gMVQO5/XY1zaMWPRdzSp39/OcpF7GlzFGahaWviSEmlO9zRuyOuagvij8NAmGcrymq6CemKwEoo= tasks: - install: null - ceph: null - workunit: clients: client.0: - rbd/import_export.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:38 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T22:30:09.926 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T22:30:09.927 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T22:30:09.927 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T22:30:09.928 INFO:teuthology.task.internal:Checking packages... 2026-02-22T22:30:09.929 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T22:30:09.929 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T22:30:09.929 INFO:teuthology.packaging:ref: None 2026-02-22T22:30:09.929 INFO:teuthology.packaging:tag: None 2026-02-22T22:30:09.929 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:30:09.929 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:30:09.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:30:10.048 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:30:10.049 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T22:30:10.061 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T22:30:10.061 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T22:30:10.074 INFO:teuthology.task.internal:Saving configuration 2026-02-22T22:30:10.084 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T22:30:10.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T22:30:10.175 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial041.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64249', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 22:26:39.168679', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEUl23sdc2IONZ8fvyOUSjpcfi/QGDVhpkqyAnuF+sXd'} 2026-02-22T22:30:10.175 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T22:30:10.186 INFO:teuthology.task.internal:roles: ubuntu@trial041.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-22T22:30:10.186 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T22:30:10.273 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x704efcae23e0>, signals=[15]) 2026-02-22T22:30:10.273 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T22:30:10.284 INFO:teuthology.task.internal:Opening connections... 2026-02-22T22:30:10.284 DEBUG:teuthology.task.internal:connecting to ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:30:10.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:30:10.350 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T22:30:10.361 DEBUG:teuthology.orchestra.run.trial041:> uname -m 2026-02-22T22:30:10.430 INFO:teuthology.orchestra.run.trial041.stdout:x86_64 2026-02-22T22:30:10.430 DEBUG:teuthology.orchestra.run.trial041:> cat /etc/os-release 2026-02-22T22:30:10.474 INFO:teuthology.orchestra.run.trial041.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-22T22:30:10.474 INFO:teuthology.orchestra.run.trial041.stdout:NAME="Ubuntu" 2026-02-22T22:30:10.474 INFO:teuthology.orchestra.run.trial041.stdout:VERSION_ID="22.04" 2026-02-22T22:30:10.474 INFO:teuthology.orchestra.run.trial041.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-22T22:30:10.474 INFO:teuthology.orchestra.run.trial041.stdout:VERSION_CODENAME=jammy 2026-02-22T22:30:10.474 INFO:teuthology.orchestra.run.trial041.stdout:ID=ubuntu 2026-02-22T22:30:10.475 INFO:teuthology.orchestra.run.trial041.stdout:ID_LIKE=debian 2026-02-22T22:30:10.475 INFO:teuthology.orchestra.run.trial041.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-22T22:30:10.475 INFO:teuthology.orchestra.run.trial041.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-22T22:30:10.475 INFO:teuthology.orchestra.run.trial041.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-22T22:30:10.475 INFO:teuthology.orchestra.run.trial041.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-22T22:30:10.475 INFO:teuthology.orchestra.run.trial041.stdout:UBUNTU_CODENAME=jammy 2026-02-22T22:30:10.476 INFO:teuthology.lock.ops:Updating trial041.front.sepia.ceph.com on lock server 2026-02-22T22:30:10.564 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T22:30:10.576 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T22:30:10.598 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T22:30:10.598 DEBUG:teuthology.orchestra.run.trial041:> test '!' -e /home/ubuntu/cephtest 2026-02-22T22:30:10.602 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T22:30:10.613 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T22:30:10.613 DEBUG:teuthology.orchestra.run.trial041:> test -z $(ls -A /var/lib/ceph) 2026-02-22T22:30:10.646 INFO:teuthology.orchestra.run.trial041.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-22T22:30:10.647 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T22:30:10.774 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T22:30:10.794 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T22:30:10.794 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T22:30:10.794 DEBUG:teuthology.orchestra.run.trial041:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T22:30:10.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:30:10.797 DEBUG:teuthology.orchestra.run.trial041:> uname -r 2026-02-22T22:30:10.842 INFO:teuthology.orchestra.run.trial041.stdout:5.15.0-170-generic 2026-02-22T22:30:10.842 INFO:teuthology.task.kernel:Running kernel on trial041: 5.15.0-170-generic 2026-02-22T22:30:10.842 DEBUG:teuthology.orchestra.run.trial041:> sudo apt-get clean 2026-02-22T22:30:10.901 DEBUG:teuthology.orchestra.run.trial041:> sudo apt-get update 2026-02-22T22:30:11.394 INFO:teuthology.orchestra.run.trial041.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T22:30:11.484 INFO:teuthology.orchestra.run.trial041.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-22T22:30:11.820 INFO:teuthology.orchestra.run.trial041.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-22T22:30:11.968 INFO:teuthology.orchestra.run.trial041.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-22T22:30:12.106 INFO:teuthology.orchestra.run.trial041.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3245 kB] 2026-02-22T22:30:12.507 INFO:teuthology.orchestra.run.trial041.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-22T22:30:12.518 INFO:teuthology.orchestra.run.trial041.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-22T22:30:12.519 INFO:teuthology.orchestra.run.trial041.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-22T22:30:12.554 INFO:teuthology.orchestra.run.trial041.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-22T22:30:12.561 INFO:teuthology.orchestra.run.trial041.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-22T22:30:12.561 INFO:teuthology.orchestra.run.trial041.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-22T22:30:12.716 INFO:teuthology.orchestra.run.trial041.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-22T22:30:12.741 INFO:teuthology.orchestra.run.trial041.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-22T22:30:12.826 INFO:teuthology.orchestra.run.trial041.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-22T22:30:12.835 INFO:teuthology.orchestra.run.trial041.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-22T22:30:12.835 INFO:teuthology.orchestra.run.trial041.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-22T22:30:12.866 INFO:teuthology.orchestra.run.trial041.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-22T22:30:12.868 INFO:teuthology.orchestra.run.trial041.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-22T22:30:13.017 INFO:teuthology.orchestra.run.trial041.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-22T22:30:16.513 INFO:teuthology.orchestra.run.trial041.stdout:Fetched 22.6 MB in 3s (7752 kB/s) 2026-02-22T22:30:17.049 INFO:teuthology.orchestra.run.trial041.stdout:Reading package lists... 2026-02-22T22:30:17.062 DEBUG:teuthology.orchestra.run.trial041:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-22T22:30:17.096 INFO:teuthology.orchestra.run.trial041.stdout:Reading package lists... 2026-02-22T22:30:17.208 INFO:teuthology.orchestra.run.trial041.stdout:Building dependency tree... 2026-02-22T22:30:17.209 INFO:teuthology.orchestra.run.trial041.stdout:Reading state information... 2026-02-22T22:30:17.297 INFO:teuthology.orchestra.run.trial041.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-22T22:30:17.297 INFO:teuthology.orchestra.run.trial041.stdout:linux-image-generic set to manually installed. 2026-02-22T22:30:17.298 INFO:teuthology.orchestra.run.trial041.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T22:30:17.298 INFO:teuthology.orchestra.run.trial041.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T22:30:17.298 INFO:teuthology.orchestra.run.trial041.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T22:30:17.298 INFO:teuthology.orchestra.run.trial041.stdout: sg3-utils-udev 2026-02-22T22:30:17.298 INFO:teuthology.orchestra.run.trial041.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T22:30:17.317 INFO:teuthology.orchestra.run.trial041.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T22:30:17.319 DEBUG:teuthology.orchestra.run.trial041:> dpkg -s linux-image-generic 2026-02-22T22:30:17.372 INFO:teuthology.orchestra.run.trial041.stdout:Package: linux-image-generic 2026-02-22T22:30:17.372 INFO:teuthology.orchestra.run.trial041.stdout:Status: install ok installed 2026-02-22T22:30:17.372 INFO:teuthology.orchestra.run.trial041.stdout:Priority: optional 2026-02-22T22:30:17.372 INFO:teuthology.orchestra.run.trial041.stdout:Section: kernel 2026-02-22T22:30:17.372 INFO:teuthology.orchestra.run.trial041.stdout:Installed-Size: 21 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Maintainer: Ubuntu Kernel Team 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Architecture: amd64 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Source: linux-meta 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Version: 5.15.0.170.159 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Recommends: thermald 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout:Description: Generic Linux kernel image 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout: This package will always depend on the latest generic kernel image 2026-02-22T22:30:17.373 INFO:teuthology.orchestra.run.trial041.stdout: available. 2026-02-22T22:30:17.375 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T22:30:17.375 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T22:30:17.375 DEBUG:teuthology.orchestra.run.trial041:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T22:30:17.430 INFO:teuthology.orchestra.run.trial041.stdout:ttyS1 2026-02-22T22:30:17.489 DEBUG:teuthology.parallel:result is None 2026-02-22T22:30:17.489 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T22:30:17.501 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T22:30:17.501 DEBUG:teuthology.orchestra.run.trial041:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T22:30:17.534 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T22:30:17.545 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T22:30:17.559 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T22:30:17.559 DEBUG:teuthology.orchestra.run.trial041:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T22:30:17.584 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T22:30:17.595 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T22:30:17.596 DEBUG:teuthology.orchestra.run.trial041:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T22:30:17.631 INFO:teuthology.orchestra.run.trial041.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:30:17.638 INFO:teuthology.orchestra.run.trial041.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:30:17.639 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T22:30:17.651 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T22:30:17.652 DEBUG:teuthology.orchestra.run.trial041:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T22:30:17.691 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T22:30:17.707 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T22:30:17.707 DEBUG:teuthology.orchestra.run.trial041:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T22:30:17.737 DEBUG:teuthology.orchestra.run.trial041:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:30:17.786 DEBUG:teuthology.orchestra.run.trial041:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:30:17.830 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:30:17.831 DEBUG:teuthology.orchestra.run.trial041:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T22:30:17.877 DEBUG:teuthology.orchestra.run.trial041:> sudo service rsyslog restart 2026-02-22T22:30:17.936 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T22:30:17.949 INFO:teuthology.task.internal:Starting timer... 2026-02-22T22:30:17.949 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T22:30:17.967 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T22:30:17.983 DEBUG:teuthology.task.selinux:Excluding trial041: OS 'ubuntu' does not support SELinux 2026-02-22T22:30:17.984 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T22:30:17.984 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-22T22:30:17.984 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T22:30:17.984 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T22:30:17.996 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T22:30:18.004 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T22:30:18.005 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial041.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T22:32:41.049 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial041.front.sepia.ceph.com')] 2026-02-22T22:32:41.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial041.front.sepia.ceph.com' 2026-02-22T22:32:41.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial041.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:32:41.162 DEBUG:teuthology.orchestra.run.trial041:> true 2026-02-22T22:32:41.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial041.front.sepia.ceph.com' 2026-02-22T22:32:41.412 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T22:32:41.441 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T22:32:41.442 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T22:32:41.443 DEBUG:teuthology.orchestra.run.trial041:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:32:41.474 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-22T22:32:41.474 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Command line: ntpd -gq 2026-02-22T22:32:41.474 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: ---------------------------------------------------- 2026-02-22T22:32:41.474 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: ntp-4 is maintained by Network Time Foundation, 2026-02-22T22:32:41.474 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-22T22:32:41.474 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: corporation. Support and training for ntp-4 are 2026-02-22T22:32:41.474 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: available at https://www.nwtime.org/support 2026-02-22T22:32:41.475 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: ---------------------------------------------------- 2026-02-22T22:32:41.475 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: proto: precision = 0.020 usec (-25) 2026-02-22T22:32:41.475 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: basedate set to 2022-02-04 2026-02-22T22:32:41.475 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: gps base set to 2022-02-06 (week 2196) 2026-02-22T22:32:41.475 INFO:teuthology.orchestra.run.trial041.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T22:32:41.476 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T22:32:41.476 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: restrict ::: KOD does nothing without LIMITED. 2026-02-22T22:32:41.476 INFO:teuthology.orchestra.run.trial041.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-22T22:32:41.477 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Listen and drop on 0 v6wildcard [::]:123 2026-02-22T22:32:41.477 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-22T22:32:41.477 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Listen normally on 2 lo 127.0.0.1:123 2026-02-22T22:32:41.477 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Listen normally on 3 enp1s0f0 10.20.193.41:123 2026-02-22T22:32:41.477 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Listen normally on 4 lo [::1]:123 2026-02-22T22:32:41.478 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:638c%2]:123 2026-02-22T22:32:41.478 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:40 ntpd[9422]: Listening on routing socket on fd #22 for interface updates 2026-02-22T22:32:43.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:43.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:43.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:43.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:43.476 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:43.476 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:43.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:43.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:43.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:43.481 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:43.481 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:43.481 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:42 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:44.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:43 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:44.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:43 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:44.505 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:43 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:44.505 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:43 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:44.505 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:43 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:44.505 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:43 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:45.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:45.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:45.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:45.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:45.476 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:45.476 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:45.476 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:45.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:45.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:45.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:45.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:45.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:44 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:46.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:46.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:46.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:46.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:46.504 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:46.504 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:46.505 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:46.505 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:46.506 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:46.506 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:46.506 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:46.506 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:45 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:47.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:47.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:47.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:47.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:47.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:47.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:47.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:47.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:47.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:47.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:47.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:47.480 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:46 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:48.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:48.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:48.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:48.473 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:48.504 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:48.504 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:48.504 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:48.504 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:47 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:49.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:49.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:49.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:49.474 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:49.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:32:49.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:32:49.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:32:49.477 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:48 ntpd[9422]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:32:49.477 INFO:teuthology.orchestra.run.trial041.stdout:22 Feb 22:32:49 ntpd[9422]: ntpd: time set +0.600820 s 2026-02-22T22:32:49.478 INFO:teuthology.orchestra.run.trial041.stdout:ntpd: time set +0.600820s 2026-02-22T22:32:49.478 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:49 ntpd[9422]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-22T22:32:49.478 INFO:teuthology.orchestra.run.trial041.stderr:22 Feb 22:32:49 ntpd[9422]: can't open /var/log/ntpstats/loopstats.20260222: Permission denied 2026-02-22T22:32:49.531 INFO:teuthology.orchestra.run.trial041.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T22:32:49.531 INFO:teuthology.orchestra.run.trial041.stdout:============================================================================== 2026-02-22T22:32:49.531 INFO:teuthology.orchestra.run.trial041.stdout: 172-234-37-140. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:32:49.531 INFO:teuthology.orchestra.run.trial041.stdout: ntp.shastacoe.n .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:32:49.532 INFO:teuthology.orchestra.run.trial041.stdout: 23.186.168.133 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:32:49.532 INFO:teuthology.orchestra.run.trial041.stdout: ip229.ip-51-81- .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:32:49.533 INFO:teuthology.run_tasks:Running task install... 2026-02-22T22:32:49.547 DEBUG:teuthology.task.install:project ceph 2026-02-22T22:32:49.547 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T22:32:49.547 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T22:32:49.547 INFO:teuthology.task.install:Using flavor: default 2026-02-22T22:32:49.556 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T22:32:49.556 INFO:teuthology.task.install:extra packages: [] 2026-02-22T22:32:49.557 DEBUG:teuthology.orchestra.run.trial041:> sudo apt-key list | grep Ceph 2026-02-22T22:32:49.623 INFO:teuthology.orchestra.run.trial041.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-22T22:32:49.651 INFO:teuthology.orchestra.run.trial041.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-22T22:32:49.652 INFO:teuthology.orchestra.run.trial041.stdout:uid [ unknown] Ceph.com (release key) 2026-02-22T22:32:49.653 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-22T22:32:49.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:32:49.836 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default/ 2026-02-22T22:32:49.836 INFO:teuthology.task.install.deb:Package version is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:32:50.072 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:32:50.072 DEBUG:teuthology.orchestra.run.trial041:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-22T22:32:50.081 DEBUG:teuthology.orchestra.run.trial041:> sudo apt-get update 2026-02-22T22:32:50.399 INFO:teuthology.orchestra.run.trial041.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy InRelease 2026-02-22T22:32:50.460 INFO:teuthology.orchestra.run.trial041.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-22T22:32:50.512 INFO:teuthology.orchestra.run.trial041.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T22:32:50.520 INFO:teuthology.orchestra.run.trial041.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-22T22:32:50.578 INFO:teuthology.orchestra.run.trial041.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-22T22:32:50.583 INFO:teuthology.orchestra.run.trial041.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-22T22:32:50.650 INFO:teuthology.orchestra.run.trial041.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-22T22:32:50.722 INFO:teuthology.orchestra.run.trial041.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-22T22:32:50.871 INFO:teuthology.orchestra.run.trial041.stdout:Fetched 25.8 kB in 1s (41.2 kB/s) 2026-02-22T22:32:51.409 INFO:teuthology.orchestra.run.trial041.stdout:Reading package lists... 2026-02-22T22:32:51.423 DEBUG:teuthology.orchestra.run.trial041:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-689-gf90f4eae-1jammy cephadm=19.2.3-689-gf90f4eae-1jammy ceph-mds=19.2.3-689-gf90f4eae-1jammy ceph-mgr=19.2.3-689-gf90f4eae-1jammy ceph-common=19.2.3-689-gf90f4eae-1jammy ceph-fuse=19.2.3-689-gf90f4eae-1jammy ceph-test=19.2.3-689-gf90f4eae-1jammy ceph-volume=19.2.3-689-gf90f4eae-1jammy radosgw=19.2.3-689-gf90f4eae-1jammy python3-rados=19.2.3-689-gf90f4eae-1jammy python3-rgw=19.2.3-689-gf90f4eae-1jammy python3-cephfs=19.2.3-689-gf90f4eae-1jammy python3-rbd=19.2.3-689-gf90f4eae-1jammy libcephfs2=19.2.3-689-gf90f4eae-1jammy libcephfs-dev=19.2.3-689-gf90f4eae-1jammy librados2=19.2.3-689-gf90f4eae-1jammy librbd1=19.2.3-689-gf90f4eae-1jammy rbd-fuse=19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:32:51.457 INFO:teuthology.orchestra.run.trial041.stdout:Reading package lists... 2026-02-22T22:32:51.564 INFO:teuthology.orchestra.run.trial041.stdout:Building dependency tree... 2026-02-22T22:32:51.565 INFO:teuthology.orchestra.run.trial041.stdout:Reading state information... 2026-02-22T22:32:51.655 INFO:teuthology.orchestra.run.trial041.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T22:32:51.655 INFO:teuthology.orchestra.run.trial041.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: sg3-utils-udev 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout:The following additional packages will be installed: 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-22T22:32:51.656 INFO:teuthology.orchestra.run.trial041.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-22T22:32:51.657 INFO:teuthology.orchestra.run.trial041.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout:Suggested packages: 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout:Recommended packages: 2026-02-22T22:32:51.658 INFO:teuthology.orchestra.run.trial041.stdout: btrfs-tools 2026-02-22T22:32:51.690 INFO:teuthology.orchestra.run.trial041.stdout:The following NEW packages will be installed: 2026-02-22T22:32:51.690 INFO:teuthology.orchestra.run.trial041.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T22:32:51.691 INFO:teuthology.orchestra.run.trial041.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-22T22:32:51.692 INFO:teuthology.orchestra.run.trial041.stdout: xmlstarlet zip 2026-02-22T22:32:52.060 INFO:teuthology.orchestra.run.trial041.stdout:0 upgraded, 108 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T22:32:52.060 INFO:teuthology.orchestra.run.trial041.stdout:Need to get 178 MB of archives. 2026-02-22T22:32:52.060 INFO:teuthology.orchestra.run.trial041.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-22T22:32:52.060 INFO:teuthology.orchestra.run.trial041.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-689-gf90f4eae-1jammy [3597 kB] 2026-02-22T22:32:52.109 INFO:teuthology.orchestra.run.trial041.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-22T22:32:52.521 INFO:teuthology.orchestra.run.trial041.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-22T22:32:52.534 INFO:teuthology.orchestra.run.trial041.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-22T22:32:52.620 INFO:teuthology.orchestra.run.trial041.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-22T22:32:52.848 INFO:teuthology.orchestra.run.trial041.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-689-gf90f4eae-1jammy [3256 kB] 2026-02-22T22:32:52.864 INFO:teuthology.orchestra.run.trial041.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-22T22:32:52.877 INFO:teuthology.orchestra.run.trial041.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-22T22:32:52.909 INFO:teuthology.orchestra.run.trial041.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-22T22:32:52.919 INFO:teuthology.orchestra.run.trial041.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-22T22:32:52.922 INFO:teuthology.orchestra.run.trial041.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-22T22:32:52.923 INFO:teuthology.orchestra.run.trial041.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-22T22:32:52.923 INFO:teuthology.orchestra.run.trial041.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-22T22:32:52.944 INFO:teuthology.orchestra.run.trial041.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-22T22:32:52.949 INFO:teuthology.orchestra.run.trial041.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-22T22:32:52.953 INFO:teuthology.orchestra.run.trial041.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-22T22:32:53.037 INFO:teuthology.orchestra.run.trial041.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-22T22:32:53.037 INFO:teuthology.orchestra.run.trial041.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-22T22:32:53.039 INFO:teuthology.orchestra.run.trial041.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-22T22:32:53.042 INFO:teuthology.orchestra.run.trial041.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-22T22:32:53.044 INFO:teuthology.orchestra.run.trial041.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-22T22:32:53.044 INFO:teuthology.orchestra.run.trial041.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-22T22:32:53.044 INFO:teuthology.orchestra.run.trial041.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-22T22:32:53.045 INFO:teuthology.orchestra.run.trial041.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-22T22:32:53.133 INFO:teuthology.orchestra.run.trial041.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-22T22:32:53.134 INFO:teuthology.orchestra.run.trial041.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-22T22:32:53.134 INFO:teuthology.orchestra.run.trial041.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-22T22:32:53.134 INFO:teuthology.orchestra.run.trial041.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-22T22:32:53.134 INFO:teuthology.orchestra.run.trial041.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-22T22:32:53.134 INFO:teuthology.orchestra.run.trial041.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-22T22:32:53.220 INFO:teuthology.orchestra.run.trial041.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-22T22:32:53.220 INFO:teuthology.orchestra.run.trial041.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-22T22:32:53.220 INFO:teuthology.orchestra.run.trial041.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-22T22:32:53.221 INFO:teuthology.orchestra.run.trial041.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-22T22:32:53.239 INFO:teuthology.orchestra.run.trial041.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-689-gf90f4eae-1jammy [979 kB] 2026-02-22T22:32:53.308 INFO:teuthology.orchestra.run.trial041.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-22T22:32:53.309 INFO:teuthology.orchestra.run.trial041.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-22T22:32:53.309 INFO:teuthology.orchestra.run.trial041.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-22T22:32:53.310 INFO:teuthology.orchestra.run.trial041.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-22T22:32:53.310 INFO:teuthology.orchestra.run.trial041.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-22T22:32:53.316 INFO:teuthology.orchestra.run.trial041.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-22T22:32:53.360 INFO:teuthology.orchestra.run.trial041.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-689-gf90f4eae-1jammy [357 kB] 2026-02-22T22:32:53.375 INFO:teuthology.orchestra.run.trial041.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-689-gf90f4eae-1jammy [32.9 kB] 2026-02-22T22:32:53.376 INFO:teuthology.orchestra.run.trial041.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-689-gf90f4eae-1jammy [184 kB] 2026-02-22T22:32:53.397 INFO:teuthology.orchestra.run.trial041.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-22T22:32:53.397 INFO:teuthology.orchestra.run.trial041.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-22T22:32:53.397 INFO:teuthology.orchestra.run.trial041.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-22T22:32:53.398 INFO:teuthology.orchestra.run.trial041.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-22T22:32:53.425 INFO:teuthology.orchestra.run.trial041.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-689-gf90f4eae-1jammy [70.0 kB] 2026-02-22T22:32:53.428 INFO:teuthology.orchestra.run.trial041.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-689-gf90f4eae-1jammy [335 kB] 2026-02-22T22:32:53.443 INFO:teuthology.orchestra.run.trial041.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-689-gf90f4eae-1jammy [6935 kB] 2026-02-22T22:32:53.484 INFO:teuthology.orchestra.run.trial041.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-22T22:32:53.485 INFO:teuthology.orchestra.run.trial041.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-22T22:32:53.488 INFO:teuthology.orchestra.run.trial041.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-22T22:32:53.488 INFO:teuthology.orchestra.run.trial041.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-22T22:32:53.489 INFO:teuthology.orchestra.run.trial041.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-22T22:32:53.516 INFO:teuthology.orchestra.run.trial041.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-22T22:32:53.572 INFO:teuthology.orchestra.run.trial041.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-22T22:32:53.572 INFO:teuthology.orchestra.run.trial041.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-22T22:32:53.597 INFO:teuthology.orchestra.run.trial041.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-22T22:32:53.597 INFO:teuthology.orchestra.run.trial041.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-22T22:32:53.660 INFO:teuthology.orchestra.run.trial041.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-22T22:32:53.661 INFO:teuthology.orchestra.run.trial041.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-22T22:32:53.661 INFO:teuthology.orchestra.run.trial041.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-22T22:32:53.662 INFO:teuthology.orchestra.run.trial041.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-22T22:32:53.665 INFO:teuthology.orchestra.run.trial041.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-22T22:32:53.667 INFO:teuthology.orchestra.run.trial041.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-22T22:32:53.749 INFO:teuthology.orchestra.run.trial041.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-22T22:32:53.750 INFO:teuthology.orchestra.run.trial041.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-22T22:32:53.753 INFO:teuthology.orchestra.run.trial041.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-22T22:32:53.756 INFO:teuthology.orchestra.run.trial041.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-22T22:32:53.837 INFO:teuthology.orchestra.run.trial041.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-22T22:32:53.837 INFO:teuthology.orchestra.run.trial041.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-22T22:32:53.842 INFO:teuthology.orchestra.run.trial041.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-22T22:32:53.843 INFO:teuthology.orchestra.run.trial041.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-22T22:32:53.847 INFO:teuthology.orchestra.run.trial041.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-22T22:32:53.847 INFO:teuthology.orchestra.run.trial041.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-22T22:32:53.925 INFO:teuthology.orchestra.run.trial041.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-22T22:32:53.925 INFO:teuthology.orchestra.run.trial041.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-22T22:32:53.928 INFO:teuthology.orchestra.run.trial041.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-22T22:32:53.928 INFO:teuthology.orchestra.run.trial041.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-22T22:32:53.978 INFO:teuthology.orchestra.run.trial041.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-689-gf90f4eae-1jammy [112 kB] 2026-02-22T22:32:53.982 INFO:teuthology.orchestra.run.trial041.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-689-gf90f4eae-1jammy [470 kB] 2026-02-22T22:32:54.000 INFO:teuthology.orchestra.run.trial041.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-689-gf90f4eae-1jammy [26.5 MB] 2026-02-22T22:32:54.014 INFO:teuthology.orchestra.run.trial041.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-22T22:32:54.014 INFO:teuthology.orchestra.run.trial041.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-22T22:32:54.015 INFO:teuthology.orchestra.run.trial041.stdout:Get:87 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-22T22:32:54.017 INFO:teuthology.orchestra.run.trial041.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-22T22:32:54.017 INFO:teuthology.orchestra.run.trial041.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-22T22:32:54.966 INFO:teuthology.orchestra.run.trial041.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-689-gf90f4eae-1jammy [5178 kB] 2026-02-22T22:32:55.099 INFO:teuthology.orchestra.run.trial041.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-689-gf90f4eae-1jammy [248 kB] 2026-02-22T22:32:55.104 INFO:teuthology.orchestra.run.trial041.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-689-gf90f4eae-1jammy [125 kB] 2026-02-22T22:32:55.106 INFO:teuthology.orchestra.run.trial041.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-689-gf90f4eae-1jammy [1081 kB] 2026-02-22T22:32:55.141 INFO:teuthology.orchestra.run.trial041.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-689-gf90f4eae-1jammy [6239 kB] 2026-02-22T22:32:55.319 INFO:teuthology.orchestra.run.trial041.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-689-gf90f4eae-1jammy [23.0 MB] 2026-02-22T22:32:55.921 INFO:teuthology.orchestra.run.trial041.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-689-gf90f4eae-1jammy [14.2 kB] 2026-02-22T22:32:55.921 INFO:teuthology.orchestra.run.trial041.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-689-gf90f4eae-1jammy [1173 kB] 2026-02-22T22:32:55.966 INFO:teuthology.orchestra.run.trial041.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-689-gf90f4eae-1jammy [2503 kB] 2026-02-22T22:32:56.043 INFO:teuthology.orchestra.run.trial041.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-689-gf90f4eae-1jammy [798 kB] 2026-02-22T22:32:56.059 INFO:teuthology.orchestra.run.trial041.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-689-gf90f4eae-1jammy [157 kB] 2026-02-22T22:32:56.063 INFO:teuthology.orchestra.run.trial041.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-689-gf90f4eae-1jammy [2396 kB] 2026-02-22T22:32:56.145 INFO:teuthology.orchestra.run.trial041.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-689-gf90f4eae-1jammy [8625 kB] 2026-02-22T22:32:56.403 INFO:teuthology.orchestra.run.trial041.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-689-gf90f4eae-1jammy [14.3 kB] 2026-02-22T22:32:56.403 INFO:teuthology.orchestra.run.trial041.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-689-gf90f4eae-1jammy [52.1 MB] 2026-02-22T22:32:58.041 INFO:teuthology.orchestra.run.trial041.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-689-gf90f4eae-1jammy [135 kB] 2026-02-22T22:32:58.042 INFO:teuthology.orchestra.run.trial041.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-689-gf90f4eae-1jammy [41.0 kB] 2026-02-22T22:32:58.042 INFO:teuthology.orchestra.run.trial041.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-689-gf90f4eae-1jammy [13.7 MB] 2026-02-22T22:32:58.498 INFO:teuthology.orchestra.run.trial041.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-689-gf90f4eae-1jammy [92.3 kB] 2026-02-22T22:32:58.824 INFO:teuthology.orchestra.run.trial041.stdout:Fetched 178 MB in 7s (26.1 MB/s) 2026-02-22T22:32:58.840 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-22T22:32:58.998 INFO:teuthology.orchestra.run.trial041.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-22T22:32:59.000 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-22T22:32:59.002 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T22:32:59.024 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-22T22:32:59.037 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-22T22:32:59.038 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T22:32:59.052 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-22T22:32:59.063 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-22T22:32:59.064 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T22:32:59.082 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-22T22:32:59.090 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:32:59.094 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:32:59.124 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-22T22:32:59.132 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:32:59.132 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:32:59.149 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-22T22:32:59.156 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:32:59.157 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:32:59.176 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-22T22:32:59.184 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-22T22:32:59.184 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T22:32:59.200 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package librados2. 2026-02-22T22:32:59.208 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../007-librados2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.208 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.249 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libnbd0. 2026-02-22T22:32:59.257 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-22T22:32:59.257 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-22T22:32:59.272 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package librbd1. 2026-02-22T22:32:59.280 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../009-librbd1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.280 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.323 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libcephfs2. 2026-02-22T22:32:59.331 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.331 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.352 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-rados. 2026-02-22T22:32:59.360 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../011-python3-rados_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.361 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.379 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-22T22:32:59.387 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:32:59.387 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.401 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-cephfs. 2026-02-22T22:32:59.409 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.409 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.425 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-22T22:32:59.432 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:32:59.433 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.450 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-22T22:32:59.458 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-22T22:32:59.458 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T22:32:59.474 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-prettytable. 2026-02-22T22:32:59.482 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-22T22:32:59.482 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-22T22:32:59.497 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-rbd. 2026-02-22T22:32:59.505 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.505 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.522 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-22T22:32:59.530 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-22T22:32:59.530 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T22:32:59.548 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-22T22:32:59.556 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-22T22:32:59.556 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T22:32:59.573 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-22T22:32:59.581 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-22T22:32:59.581 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T22:32:59.599 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package lua5.1. 2026-02-22T22:32:59.607 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-22T22:32:59.607 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-22T22:32:59.626 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package lua-any. 2026-02-22T22:32:59.634 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-22T22:32:59.634 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-22T22:32:59.648 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package zip. 2026-02-22T22:32:59.656 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-22T22:32:59.657 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking zip (3.0-12build2) ... 2026-02-22T22:32:59.673 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package unzip. 2026-02-22T22:32:59.681 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-22T22:32:59.682 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-22T22:32:59.698 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package luarocks. 2026-02-22T22:32:59.706 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-22T22:32:59.707 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-22T22:32:59.745 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package librgw2. 2026-02-22T22:32:59.753 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../026-librgw2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.753 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.825 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-rgw. 2026-02-22T22:32:59.833 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.834 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.849 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-22T22:32:59.857 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-22T22:32:59.857 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T22:32:59.871 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libradosstriper1. 2026-02-22T22:32:59.880 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.880 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:32:59.898 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-common. 2026-02-22T22:32:59.906 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../030-ceph-common_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:32:59.907 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:00.109 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-base. 2026-02-22T22:33:00.118 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../031-ceph-base_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:00.122 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:00.187 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-22T22:33:00.195 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-22T22:33:00.196 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-22T22:33:00.211 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-cheroot. 2026-02-22T22:33:00.219 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-22T22:33:00.219 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T22:33:00.236 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-22T22:33:00.244 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-22T22:33:00.245 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-22T22:33:00.259 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-22T22:33:00.267 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-22T22:33:00.268 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-22T22:33:00.281 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-22T22:33:00.290 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-22T22:33:00.290 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-22T22:33:00.304 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-tempora. 2026-02-22T22:33:00.312 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-22T22:33:00.312 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-22T22:33:00.327 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-portend. 2026-02-22T22:33:00.335 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-22T22:33:00.336 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-22T22:33:00.350 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-22T22:33:00.358 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-22T22:33:00.359 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-22T22:33:00.373 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-22T22:33:00.382 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-22T22:33:00.382 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-22T22:33:00.405 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-natsort. 2026-02-22T22:33:00.414 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-22T22:33:00.414 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-22T22:33:00.429 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-logutils. 2026-02-22T22:33:00.437 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-22T22:33:00.438 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-22T22:33:00.452 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-mako. 2026-02-22T22:33:00.461 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-22T22:33:00.461 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T22:33:00.480 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-22T22:33:00.487 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-22T22:33:00.488 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-22T22:33:00.502 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-22T22:33:00.510 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-22T22:33:00.511 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-22T22:33:00.524 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-webob. 2026-02-22T22:33:00.532 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-22T22:33:00.533 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T22:33:00.550 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-waitress. 2026-02-22T22:33:00.558 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-22T22:33:00.560 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T22:33:00.576 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-tempita. 2026-02-22T22:33:00.584 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-22T22:33:00.584 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T22:33:00.599 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-paste. 2026-02-22T22:33:00.607 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-22T22:33:00.608 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T22:33:00.636 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-22T22:33:00.644 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-22T22:33:00.645 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T22:33:00.660 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-22T22:33:00.667 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-22T22:33:00.668 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-22T22:33:00.683 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-webtest. 2026-02-22T22:33:00.691 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-22T22:33:00.691 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-22T22:33:00.707 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-pecan. 2026-02-22T22:33:00.715 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-22T22:33:00.715 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T22:33:00.740 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-22T22:33:00.748 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-22T22:33:00.748 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T22:33:00.768 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-22T22:33:00.776 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:33:00.776 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:00.804 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-22T22:33:00.813 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:00.813 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:00.828 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mgr. 2026-02-22T22:33:00.836 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:00.836 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:00.858 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mon. 2026-02-22T22:33:00.866 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:00.867 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:00.923 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-22T22:33:00.932 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-22T22:33:00.932 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T22:33:00.948 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-osd. 2026-02-22T22:33:00.956 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:00.957 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.114 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph. 2026-02-22T22:33:01.122 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../061-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:01.123 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.137 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-fuse. 2026-02-22T22:33:01.144 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:01.145 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.169 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mds. 2026-02-22T22:33:01.177 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:01.178 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.210 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package cephadm. 2026-02-22T22:33:01.218 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../064-cephadm_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:01.218 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.234 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-22T22:33:01.242 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T22:33:01.242 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T22:33:01.265 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-22T22:33:01.273 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:33:01.275 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.293 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-22T22:33:01.302 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-22T22:33:01.302 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-22T22:33:01.318 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-routes. 2026-02-22T22:33:01.326 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-22T22:33:01.327 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T22:33:01.346 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-22T22:33:01.354 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:33:01.355 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.560 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-22T22:33:01.569 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-22T22:33:01.569 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T22:33:01.608 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-joblib. 2026-02-22T22:33:01.616 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-22T22:33:01.616 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T22:33:01.643 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-22T22:33:01.651 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-22T22:33:01.652 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-22T22:33:01.667 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-sklearn. 2026-02-22T22:33:01.675 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-22T22:33:01.675 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T22:33:01.758 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-22T22:33:01.767 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:33:01.767 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:01.931 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-cachetools. 2026-02-22T22:33:01.939 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-22T22:33:01.939 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-22T22:33:01.953 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-rsa. 2026-02-22T22:33:01.962 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-22T22:33:01.962 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-22T22:33:01.979 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-google-auth. 2026-02-22T22:33:01.988 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-22T22:33:01.988 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-22T22:33:02.005 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-22T22:33:02.014 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-22T22:33:02.014 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T22:33:02.031 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-websocket. 2026-02-22T22:33:02.039 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-22T22:33:02.039 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-22T22:33:02.057 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-22T22:33:02.066 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-22T22:33:02.066 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T22:33:02.161 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-22T22:33:02.170 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:33:02.170 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:02.184 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-22T22:33:02.192 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-22T22:33:02.199 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T22:33:02.215 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-22T22:33:02.224 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T22:33:02.224 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T22:33:02.238 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package jq. 2026-02-22T22:33:02.247 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T22:33:02.247 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-22T22:33:02.260 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package socat. 2026-02-22T22:33:02.269 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-22T22:33:02.269 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-22T22:33:02.289 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package xmlstarlet. 2026-02-22T22:33:02.297 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-22T22:33:02.297 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-22T22:33:02.335 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-test. 2026-02-22T22:33:02.343 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../087-ceph-test_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:02.343 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:02.880 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package ceph-volume. 2026-02-22T22:33:02.889 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:33:02.889 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:02.912 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-22T22:33:02.921 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:02.921 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:02.937 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-22T22:33:02.945 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-22T22:33:02.946 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T22:33:02.967 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-22T22:33:02.975 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-22T22:33:02.976 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-22T22:33:02.993 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package nvme-cli. 2026-02-22T22:33:03.001 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-22T22:33:03.002 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T22:33:03.035 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package pkg-config. 2026-02-22T22:33:03.044 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-22T22:33:03.044 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T22:33:03.060 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-22T22:33:03.069 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T22:33:03.069 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T22:33:03.099 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-22T22:33:03.107 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-22T22:33:03.107 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-22T22:33:03.122 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-pastescript. 2026-02-22T22:33:03.131 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-22T22:33:03.131 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-22T22:33:03.149 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-pluggy. 2026-02-22T22:33:03.158 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-22T22:33:03.158 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-22T22:33:03.174 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-psutil. 2026-02-22T22:33:03.183 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-22T22:33:03.183 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-22T22:33:03.201 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-py. 2026-02-22T22:33:03.210 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-22T22:33:03.210 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-22T22:33:03.231 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-pygments. 2026-02-22T22:33:03.239 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-22T22:33:03.240 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T22:33:03.281 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-22T22:33:03.289 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-22T22:33:03.290 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-22T22:33:03.305 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-toml. 2026-02-22T22:33:03.313 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-22T22:33:03.314 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-22T22:33:03.329 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-pytest. 2026-02-22T22:33:03.337 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-22T22:33:03.338 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T22:33:03.360 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package python3-simplejson. 2026-02-22T22:33:03.368 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-22T22:33:03.369 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-22T22:33:03.386 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-22T22:33:03.395 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-22T22:33:03.395 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-22T22:33:03.462 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package radosgw. 2026-02-22T22:33:03.470 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../106-radosgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:03.471 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:03.585 INFO:teuthology.orchestra.run.trial041.stdout:Selecting previously unselected package rbd-fuse. 2026-02-22T22:33:03.594 INFO:teuthology.orchestra.run.trial041.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:33:03.594 INFO:teuthology.orchestra.run.trial041.stdout:Unpacking rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:03.624 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-22T22:33:03.691 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T22:33:03.692 INFO:teuthology.orchestra.run.trial041.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T22:33:03.763 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T22:33:04.020 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-22T22:33:04.364 INFO:teuthology.orchestra.run.trial041.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-22T22:33:04.374 INFO:teuthology.orchestra.run.trial041.stdout:Setting up cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:04.417 INFO:teuthology.orchestra.run.trial041.stdout:Adding system user cephadm....done 2026-02-22T22:33:04.428 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T22:33:04.499 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-22T22:33:04.573 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T22:33:04.573 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-22T22:33:04.645 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-22T22:33:04.720 INFO:teuthology.orchestra.run.trial041.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T22:33:04.721 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-22T22:33:04.817 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T22:33:04.939 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-22T22:33:05.015 INFO:teuthology.orchestra.run.trial041.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-22T22:33:05.025 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-22T22:33:05.101 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-22T22:33:05.175 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:05.243 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T22:33:05.244 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-22T22:33:05.245 INFO:teuthology.orchestra.run.trial041.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T22:33:05.246 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T22:33:05.247 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T22:33:05.248 INFO:teuthology.orchestra.run.trial041.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-22T22:33:05.264 INFO:teuthology.orchestra.run.trial041.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-22T22:33:05.266 INFO:teuthology.orchestra.run.trial041.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-22T22:33:05.267 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T22:33:05.268 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-22T22:33:05.388 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-22T22:33:05.467 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T22:33:05.547 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-22T22:33:05.636 INFO:teuthology.orchestra.run.trial041.stdout:Setting up zip (3.0-12build2) ... 2026-02-22T22:33:05.637 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T22:33:05.886 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T22:33:05.962 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T22:33:05.963 INFO:teuthology.orchestra.run.trial041.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-22T22:33:05.964 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T22:33:06.060 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T22:33:06.182 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T22:33:06.312 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T22:33:06.393 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T22:33:06.497 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-22T22:33:06.569 INFO:teuthology.orchestra.run.trial041.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-22T22:33:06.570 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:06.651 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T22:33:07.145 INFO:teuthology.orchestra.run.trial041.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T22:33:07.168 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:33:07.172 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-22T22:33:07.249 INFO:teuthology.orchestra.run.trial041.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T22:33:07.250 INFO:teuthology.orchestra.run.trial041.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-22T22:33:07.251 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-22T22:33:07.328 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-22T22:33:07.400 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:33:07.401 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-22T22:33:07.478 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-22T22:33:07.553 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-22T22:33:07.628 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-22T22:33:07.703 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-22T22:33:07.777 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-22T22:33:07.855 INFO:teuthology.orchestra.run.trial041.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T22:33:07.856 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-22T22:33:07.940 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T22:33:07.940 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T22:33:08.017 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T22:33:08.095 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T22:33:08.181 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-22T22:33:08.257 INFO:teuthology.orchestra.run.trial041.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T22:33:08.258 INFO:teuthology.orchestra.run.trial041.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-22T22:33:08.259 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T22:33:08.260 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T22:33:08.398 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-22T22:33:08.479 INFO:teuthology.orchestra.run.trial041.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-22T22:33:08.480 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-22T22:33:08.554 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:33:08.555 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-22T22:33:08.638 INFO:teuthology.orchestra.run.trial041.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-22T22:33:08.638 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-22T22:33:08.720 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-22T22:33:08.850 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-22T22:33:08.936 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T22:33:09.052 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T22:33:09.053 INFO:teuthology.orchestra.run.trial041.stdout:Setting up librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:09.054 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:09.055 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T22:33:09.570 INFO:teuthology.orchestra.run.trial041.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-22T22:33:09.583 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:09.584 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:09.585 INFO:teuthology.orchestra.run.trial041.stdout:Setting up librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:09.586 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:09.586 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:09.661 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T22:33:09.661 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T22:33:10.034 INFO:teuthology.orchestra.run.trial041.stdout:Setting up libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.035 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.036 INFO:teuthology.orchestra.run.trial041.stdout:Setting up librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.036 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.037 INFO:teuthology.orchestra.run.trial041.stdout:Setting up rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.038 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.039 INFO:teuthology.orchestra.run.trial041.stdout:Setting up python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.040 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.069 INFO:teuthology.orchestra.run.trial041.stdout:Adding group ceph....done 2026-02-22T22:33:10.108 INFO:teuthology.orchestra.run.trial041.stdout:Adding system user ceph....done 2026-02-22T22:33:10.118 INFO:teuthology.orchestra.run.trial041.stdout:Setting system user ceph properties....done 2026-02-22T22:33:10.124 INFO:teuthology.orchestra.run.trial041.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-22T22:33:10.212 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-22T22:33:10.483 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-22T22:33:10.829 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:10.830 INFO:teuthology.orchestra.run.trial041.stdout:Setting up radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:11.070 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:33:11.070 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:33:11.377 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:11.495 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-22T22:33:11.843 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:11.903 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T22:33:11.903 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T22:33:12.231 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:12.307 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T22:33:12.307 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T22:33:12.647 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:12.720 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T22:33:12.721 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T22:33:13.050 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:13.051 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:13.061 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:13.132 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T22:33:13.133 INFO:teuthology.orchestra.run.trial041.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T22:33:13.438 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:13.448 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:13.449 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:13.459 INFO:teuthology.orchestra.run.trial041.stdout:Setting up ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:33:13.568 INFO:teuthology.orchestra.run.trial041.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-22T22:33:13.576 INFO:teuthology.orchestra.run.trial041.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-22T22:33:13.819 INFO:teuthology.orchestra.run.trial041.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-22T22:33:13.903 INFO:teuthology.orchestra.run.trial041.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-22T22:33:14.414 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:14.414 INFO:teuthology.orchestra.run.trial041.stdout:Running kernel seems to be up-to-date. 2026-02-22T22:33:14.414 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout:The processor microcode seems to be up-to-date. 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout:No services need to be restarted. 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout:No containers need to be restarted. 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout:No user sessions are running outdated binaries. 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:14.415 INFO:teuthology.orchestra.run.trial041.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-22T22:33:15.216 INFO:teuthology.orchestra.run.trial041.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-22T22:33:15.220 DEBUG:teuthology.parallel:result is None 2026-02-22T22:33:15.220 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:33:15.342 DEBUG:teuthology.orchestra.run.trial041:> dpkg-query -W -f '${Version}' ceph 2026-02-22T22:33:15.351 INFO:teuthology.orchestra.run.trial041.stdout:19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:33:15.352 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:33:15.352 INFO:teuthology.task.install:The correct ceph version 19.2.3-689-gf90f4eae-1jammy is installed. 2026-02-22T22:33:15.353 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T22:33:15.353 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:15.353 DEBUG:teuthology.orchestra.run.trial041:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T22:33:15.405 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T22:33:15.405 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:15.405 DEBUG:teuthology.orchestra.run.trial041:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T22:33:15.455 DEBUG:teuthology.orchestra.run.trial041:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T22:33:15.507 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T22:33:15.507 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:15.508 DEBUG:teuthology.orchestra.run.trial041:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T22:33:15.555 DEBUG:teuthology.orchestra.run.trial041:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T22:33:15.603 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T22:33:15.603 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:15.603 DEBUG:teuthology.orchestra.run.trial041:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T22:33:15.652 DEBUG:teuthology.orchestra.run.trial041:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T22:33:15.703 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T22:33:15.813 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T22:33:15.813 DEBUG:teuthology.orchestra.run.trial041:> sudo chmod 777 /var/log/ceph 2026-02-22T22:33:15.821 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T22:33:15.821 DEBUG:teuthology.orchestra.run.trial041:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T22:33:15.870 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T22:33:15.871 DEBUG:teuthology.orchestra.run.trial041:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T22:33:15.927 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T22:33:15.927 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-22T22:33:15.927 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64249', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64249', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 9196, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial041.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPtdrd8fIQe5gMVQO5/XY1zaMWPRdzSp39/OcpF7GlzFGahaWviSEmlO9zRuyOuagvij8NAmGcrymq6CemKwEoo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rbd/import_export.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:38', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T22:33:15.927 DEBUG:teuthology.orchestra.run.trial041:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T22:33:15.963 DEBUG:teuthology.orchestra.run.trial041:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T22:33:16.011 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:16.011 DEBUG:teuthology.orchestra.run.trial041:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T22:33:16.056 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T22:33:16.056 DEBUG:teuthology.orchestra.run.trial041:> stat /dev/vg_nvme/lv_1 2026-02-22T22:33:16.103 INFO:teuthology.orchestra.run.trial041.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T22:33:16.104 INFO:teuthology.orchestra.run.trial041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:33:16.104 INFO:teuthology.orchestra.run.trial041.stdout:Device: 5h/5d Inode: 900 Links: 1 2026-02-22T22:33:16.104 INFO:teuthology.orchestra.run.trial041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:33:16.104 INFO:teuthology.orchestra.run.trial041.stdout:Access: 2026-02-22 22:32:27.835893172 +0000 2026-02-22T22:33:16.104 INFO:teuthology.orchestra.run.trial041.stdout:Modify: 2026-02-22 22:32:27.683895756 +0000 2026-02-22T22:33:16.104 INFO:teuthology.orchestra.run.trial041.stdout:Change: 2026-02-22 22:32:27.683895756 +0000 2026-02-22T22:33:16.104 INFO:teuthology.orchestra.run.trial041.stdout: Birth: - 2026-02-22T22:33:16.104 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T22:33:16.154 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records in 2026-02-22T22:33:16.154 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records out 2026-02-22T22:33:16.155 INFO:teuthology.orchestra.run.trial041.stderr:512 bytes copied, 0.000181349 s, 2.8 MB/s 2026-02-22T22:33:16.156 DEBUG:teuthology.orchestra.run.trial041:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T22:33:16.205 DEBUG:teuthology.orchestra.run.trial041:> stat /dev/vg_nvme/lv_2 2026-02-22T22:33:16.251 INFO:teuthology.orchestra.run.trial041.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T22:33:16.251 INFO:teuthology.orchestra.run.trial041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:33:16.251 INFO:teuthology.orchestra.run.trial041.stdout:Device: 5h/5d Inode: 924 Links: 1 2026-02-22T22:33:16.252 INFO:teuthology.orchestra.run.trial041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:33:16.252 INFO:teuthology.orchestra.run.trial041.stdout:Access: 2026-02-22 22:32:28.175887394 +0000 2026-02-22T22:33:16.252 INFO:teuthology.orchestra.run.trial041.stdout:Modify: 2026-02-22 22:32:28.003890316 +0000 2026-02-22T22:33:16.252 INFO:teuthology.orchestra.run.trial041.stdout:Change: 2026-02-22 22:32:28.003890316 +0000 2026-02-22T22:33:16.252 INFO:teuthology.orchestra.run.trial041.stdout: Birth: - 2026-02-22T22:33:16.252 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T22:33:16.298 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records in 2026-02-22T22:33:16.298 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records out 2026-02-22T22:33:16.298 INFO:teuthology.orchestra.run.trial041.stderr:512 bytes copied, 0.000177321 s, 2.9 MB/s 2026-02-22T22:33:16.300 DEBUG:teuthology.orchestra.run.trial041:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T22:33:16.349 DEBUG:teuthology.orchestra.run.trial041:> stat /dev/vg_nvme/lv_3 2026-02-22T22:33:16.395 INFO:teuthology.orchestra.run.trial041.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T22:33:16.395 INFO:teuthology.orchestra.run.trial041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:33:16.396 INFO:teuthology.orchestra.run.trial041.stdout:Device: 5h/5d Inode: 963 Links: 1 2026-02-22T22:33:16.396 INFO:teuthology.orchestra.run.trial041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:33:16.396 INFO:teuthology.orchestra.run.trial041.stdout:Access: 2026-02-22 22:32:28.511881684 +0000 2026-02-22T22:33:16.396 INFO:teuthology.orchestra.run.trial041.stdout:Modify: 2026-02-22 22:32:28.331884740 +0000 2026-02-22T22:33:16.396 INFO:teuthology.orchestra.run.trial041.stdout:Change: 2026-02-22 22:32:28.331884740 +0000 2026-02-22T22:33:16.396 INFO:teuthology.orchestra.run.trial041.stdout: Birth: - 2026-02-22T22:33:16.396 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T22:33:16.446 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records in 2026-02-22T22:33:16.446 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records out 2026-02-22T22:33:16.446 INFO:teuthology.orchestra.run.trial041.stderr:512 bytes copied, 0.000174466 s, 2.9 MB/s 2026-02-22T22:33:16.447 DEBUG:teuthology.orchestra.run.trial041:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T22:33:16.493 DEBUG:teuthology.orchestra.run.trial041:> stat /dev/vg_nvme/lv_4 2026-02-22T22:33:16.539 INFO:teuthology.orchestra.run.trial041.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T22:33:16.539 INFO:teuthology.orchestra.run.trial041.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:33:16.540 INFO:teuthology.orchestra.run.trial041.stdout:Device: 5h/5d Inode: 985 Links: 1 2026-02-22T22:33:16.540 INFO:teuthology.orchestra.run.trial041.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:33:16.540 INFO:teuthology.orchestra.run.trial041.stdout:Access: 2026-02-22 22:32:28.675878896 +0000 2026-02-22T22:33:16.540 INFO:teuthology.orchestra.run.trial041.stdout:Modify: 2026-02-22 22:32:28.671878962 +0000 2026-02-22T22:33:16.540 INFO:teuthology.orchestra.run.trial041.stdout:Change: 2026-02-22 22:32:28.671878962 +0000 2026-02-22T22:33:16.540 INFO:teuthology.orchestra.run.trial041.stdout: Birth: - 2026-02-22T22:33:16.540 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T22:33:16.590 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records in 2026-02-22T22:33:16.591 INFO:teuthology.orchestra.run.trial041.stderr:1+0 records out 2026-02-22T22:33:16.591 INFO:teuthology.orchestra.run.trial041.stderr:512 bytes copied, 0.000163816 s, 3.1 MB/s 2026-02-22T22:33:16.592 DEBUG:teuthology.orchestra.run.trial041:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T22:33:16.641 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T22:33:16.641 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial041.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-22T22:33:16.641 INFO:tasks.ceph:Generating config... 2026-02-22T22:33:16.643 INFO:tasks.ceph:[client] rbd default format = 1 2026-02-22T22:33:16.643 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-22T22:33:16.643 INFO:tasks.ceph:[global] mon warn on pool no app = False 2026-02-22T22:33:16.644 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-22T22:33:16.644 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T22:33:16.644 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T22:33:16.644 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T22:33:16.644 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T22:33:16.644 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T22:33:16.644 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-22T22:33:16.644 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-22T22:33:16.644 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2026-02-22T22:33:16.644 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-22T22:33:16.644 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-22T22:33:16.645 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-22T22:33:16.646 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T22:33:16.646 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T22:33:16.699 INFO:teuthology.orchestra.run.trial041.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T22:33:16.702 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T22:33:16.762 DEBUG:teuthology.orchestra.run.trial041:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:33:16.811 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.41')] 2026-02-22T22:33:16.812 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.41', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2026-02-22T22:33:16.813 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:16.813 DEBUG:teuthology.orchestra.run.trial041:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T22:33:16.855 DEBUG:teuthology.orchestra.run.trial041:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.41 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:monmaptool: generated fsid 7b095714-3316-4e30-a59a-81c2a99e0305 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:setting min_mon_release = quincy 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:epoch 0 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:fsid 7b095714-3316-4e30-a59a-81c2a99e0305 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:last_changed 2026-02-22T22:33:16.911525+0000 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:created 2026-02-22T22:33:16.911525+0000 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:min_mon_release 17 (quincy) 2026-02-22T22:33:16.912 INFO:teuthology.orchestra.run.trial041.stdout:election_strategy: 1 2026-02-22T22:33:16.913 INFO:teuthology.orchestra.run.trial041.stdout:0: [v2:10.20.193.41:3300/0,v1:10.20.193.41:6789/0] mon.a 2026-02-22T22:33:16.913 INFO:teuthology.orchestra.run.trial041.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-22T22:33:16.914 DEBUG:teuthology.orchestra.run.trial041:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T22:33:16.959 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7b095714-3316-4e30-a59a-81c2a99e0305... 2026-02-22T22:33:16.960 DEBUG:teuthology.orchestra.run.trial041:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout:[global] 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: chdir = "" 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: auth supported = cephx 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: filestore xattr use omap = true 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: mon clock drift allowed = 1.000 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: osd crush chooseleaf type = 0 2026-02-22T22:33:17.019 INFO:teuthology.orchestra.run.trial041.stdout: auth debug = true 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: ms die on old message = true 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: ms die on bug = true 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon pg warn max object skew = 0 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: osd pool default size = 2 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon osd allow primary affinity = true 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon osd allow pg remap = true 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon warn on legacy crush tunables = false 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon warn on crush straw calc version zero = false 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon warn on no sortbitwise = false 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon warn on osd down out interval zero = false 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon warn on too few osds = false 2026-02-22T22:33:17.020 INFO:teuthology.orchestra.run.trial041.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon_allow_pool_size_one = true 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: osd default data pool replay window = 5 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon allow pool delete = true 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon cluster log file level = debug 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: debug asserts on shutdown = true 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon health detail to clog = false 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon host = 10.20.193.41 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon client directed command retry = 5 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: mon warn on pool no app = False 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: ms inject socket failures = 5000 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: fsid = 7b095714-3316-4e30-a59a-81c2a99e0305 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout:[osd] 2026-02-22T22:33:17.021 INFO:teuthology.orchestra.run.trial041.stdout: osd journal size = 100 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd scrub load threshold = 5.0 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd scrub max interval = 600 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd mclock profile = high_recovery_ops 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd mclock skip benchmark = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd recover clone overlap = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd recovery max chunk = 1048576 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd debug shutdown = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd debug op order = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd debug verify stray on activate = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd debug trim objects = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd open classes on start = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd debug pg log writeout = true 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd deep scrub update digest min age = 30 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: osd map max advance = 10 2026-02-22T22:33:17.022 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: journal zero on create = true 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: filestore ondisk finisher threads = 3 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: filestore apply finisher threads = 3 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: bdev debug aio = true 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: osd debug misdirected ops = true 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: bdev async discard = True 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: bdev enable discard = True 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: bluestore allocator = stupid 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: bluestore block size = 96636764160 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: bluestore fsck on mount = True 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: debug bluefs = 1/20 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: debug bluestore = 1/20 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: debug ms = 1 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: debug osd = 20 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: debug rocksdb = 4/10 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: mon osd full ratio = 0.9 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: mon osd nearfull ratio = 0.8 2026-02-22T22:33:17.023 INFO:teuthology.orchestra.run.trial041.stdout: osd failsafe full ratio = 0.95 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: osd objectstore = bluestore 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: osd shutdown pgref assert = True 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout:[mgr] 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug ms = 1 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug mgr = 20 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug mon = 20 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug auth = 20 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: mgr/telemetry/nag = false 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout:[mon] 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug ms = 1 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug mon = 20 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug paxos = 20 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: debug auth = 20 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: mon data avail warn = 5 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: mon mgr mkfs grace = 240 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:33:17.024 INFO:teuthology.orchestra.run.trial041.stdout: mon osd reporter subtree level = osd 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: mon osd prime pg temp = true 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: # 1m isn't quite enough 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: mon_down_mkfs_grace = 2m 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: mon_warn_on_filestore_osds = false 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout:[client] 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: rgw cache enabled = true 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: rgw enable ops log = true 2026-02-22T22:33:17.025 INFO:teuthology.orchestra.run.trial041.stdout: rgw enable usage log = true 2026-02-22T22:33:17.026 INFO:teuthology.orchestra.run.trial041.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T22:33:17.026 INFO:teuthology.orchestra.run.trial041.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T22:33:17.026 INFO:teuthology.orchestra.run.trial041.stdout: rbd default format = 1 2026-02-22T22:33:17.026 INFO:teuthology.orchestra.run.trial041.stdout:[mon.a] 2026-02-22T22:33:17.027 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T22:33:17.027 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T22:33:17.094 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T22:33:17.094 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:17.094 DEBUG:teuthology.orchestra.run.trial041:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T22:33:17.140 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:17.140 DEBUG:teuthology.orchestra.run.trial041:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T22:33:17.187 INFO:tasks.ceph:Sending monmap to node ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:33:17.187 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:17.188 DEBUG:teuthology.orchestra.run.trial041:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T22:33:17.188 DEBUG:teuthology.orchestra.run.trial041:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:33:17.240 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:17.241 DEBUG:teuthology.orchestra.run.trial041:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:33:17.288 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T22:33:17.288 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T22:33:17.288 DEBUG:teuthology.orchestra.run.trial041:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T22:33:17.353 INFO:teuthology.orchestra.run.trial041.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T22:33:17.355 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T22:33:17.356 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T22:33:17.356 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T22:33:17.416 INFO:teuthology.orchestra.run.trial041.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T22:33:17.423 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T22:33:17.423 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial041.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-22T22:33:17.423 DEBUG:teuthology.orchestra.run.trial041:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T22:33:17.471 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T22:33:17.472 INFO:tasks.ceph:role: osd.0 2026-02-22T22:33:17.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:33:17.472 DEBUG:teuthology.orchestra.run.trial041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T22:33:17.524 INFO:teuthology.orchestra.run.trial041.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:33:17.525 INFO:teuthology.orchestra.run.trial041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:33:18.116 INFO:teuthology.orchestra.run.trial041.stdout:Discarding blocks...Done. 2026-02-22T22:33:18.118 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial041.front.sepia.ceph.com -o noatime 2026-02-22T22:33:18.118 DEBUG:teuthology.orchestra.run.trial041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T22:33:18.172 DEBUG:teuthology.orchestra.run.trial041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T22:33:18.220 INFO:teuthology.orchestra.run.trial041.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:33:18.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:33:18.221 DEBUG:teuthology.orchestra.run.trial041:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T22:33:18.271 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T22:33:18.271 INFO:tasks.ceph:role: osd.1 2026-02-22T22:33:18.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:33:18.271 DEBUG:teuthology.orchestra.run.trial041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T22:33:18.320 INFO:teuthology.orchestra.run.trial041.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:33:18.321 INFO:teuthology.orchestra.run.trial041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:33:18.884 INFO:teuthology.orchestra.run.trial041.stdout:Discarding blocks...Done. 2026-02-22T22:33:18.885 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial041.front.sepia.ceph.com -o noatime 2026-02-22T22:33:18.886 DEBUG:teuthology.orchestra.run.trial041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T22:33:18.940 DEBUG:teuthology.orchestra.run.trial041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T22:33:18.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:33:18.993 INFO:teuthology.orchestra.run.trial041.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:33:18.993 DEBUG:teuthology.orchestra.run.trial041:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T22:33:19.043 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-22T22:33:19.044 INFO:tasks.ceph:role: osd.2 2026-02-22T22:33:19.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:33:19.044 DEBUG:teuthology.orchestra.run.trial041:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T22:33:19.097 INFO:teuthology.orchestra.run.trial041.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:33:19.097 INFO:teuthology.orchestra.run.trial041.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:33:19.097 INFO:teuthology.orchestra.run.trial041.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:33:19.097 INFO:teuthology.orchestra.run.trial041.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:33:19.098 INFO:teuthology.orchestra.run.trial041.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:33:19.098 INFO:teuthology.orchestra.run.trial041.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:33:19.098 INFO:teuthology.orchestra.run.trial041.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:33:19.098 INFO:teuthology.orchestra.run.trial041.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:33:19.098 INFO:teuthology.orchestra.run.trial041.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:33:19.098 INFO:teuthology.orchestra.run.trial041.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:33:19.664 INFO:teuthology.orchestra.run.trial041.stdout:Discarding blocks...Done. 2026-02-22T22:33:19.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial041.front.sepia.ceph.com -o noatime 2026-02-22T22:33:19.666 DEBUG:teuthology.orchestra.run.trial041:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T22:33:19.720 DEBUG:teuthology.orchestra.run.trial041:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T22:33:19.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:33:19.770 INFO:teuthology.orchestra.run.trial041.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:33:19.770 DEBUG:teuthology.orchestra.run.trial041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:33:19.832 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:19.831+0000 7f7effca68c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T22:33:19.833 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:19.831+0000 7f7effca68c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T22:33:19.833 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:19.831+0000 7f7effca68c0 -1 bdev(0x564c03049800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T22:33:19.833 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:19.831+0000 7f7effca68c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T22:33:23.902 DEBUG:teuthology.orchestra.run.trial041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T22:33:23.951 DEBUG:teuthology.orchestra.run.trial041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:33:24.019 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:24.015+0000 7fe3da2538c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T22:33:24.019 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:24.015+0000 7fe3da2538c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T22:33:24.019 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:24.019+0000 7fe3da2538c0 -1 bdev(0x5578ce8af800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T22:33:24.019 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:24.019+0000 7fe3da2538c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T22:33:28.074 DEBUG:teuthology.orchestra.run.trial041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T22:33:28.124 DEBUG:teuthology.orchestra.run.trial041:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:33:28.187 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:28.187+0000 7f593f9c88c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T22:33:28.188 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:28.187+0000 7f593f9c88c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T22:33:28.189 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:28.187+0000 7f593f9c88c0 -1 bdev(0x561345a49800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T22:33:28.189 INFO:teuthology.orchestra.run.trial041.stderr:2026-02-22T22:33:28.187+0000 7f593f9c88c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T22:33:32.278 DEBUG:teuthology.orchestra.run.trial041:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T22:33:32.328 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T22:33:32.328 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:32.328 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T22:33:32.379 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:32.379 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T22:33:32.431 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:32.431 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T22:33:32.479 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:32.479 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T22:33:32.527 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:32.527 DEBUG:teuthology.orchestra.run.trial041:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T22:33:32.572 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T22:33:32.572 DEBUG:teuthology.orchestra.run.trial041:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout:[mgr.x] 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout: key = AQAthJtpXw0RFRAAoHMVddPNs2vM1zQ+ffgm0g== 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout:[osd.0] 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout: key = AQAvhJtpk/OhMRAAt3L4EvCYxs8QWEAj+QiO0g== 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout:[osd.1] 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout: key = AQA0hJtpLWIoARAAZ8bPTrtxM8JrOHaBng7uTQ== 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout:[osd.2] 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout: key = AQA4hJtpUL4xCxAAt8sRRtuuPO2iAWunlj2LCg== 2026-02-22T22:33:32.622 INFO:teuthology.orchestra.run.trial041.stdout:[client.0] 2026-02-22T22:33:32.623 INFO:teuthology.orchestra.run.trial041.stdout: key = AQAthJtpwfPOGBAAloRE3sn3hqaMcvwmEees0A== 2026-02-22T22:33:32.624 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:33:32.689 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:33:32.752 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:33:32.818 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:33:32.880 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T22:33:32.945 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T22:33:32.945 DEBUG:teuthology.orchestra.run.trial041:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T22:33:32.995 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T22:33:33.060 DEBUG:teuthology.orchestra.run.trial041:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T22:33:33.111 DEBUG:teuthology.orchestra.run.trial041:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:33:33.159 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T22:33:33.159 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T22:33:33.160 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T22:33:33.200 INFO:tasks.ceph.mon.a:Started 2026-02-22T22:33:33.201 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T22:33:33.201 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T22:33:33.201 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T22:33:33.203 INFO:tasks.ceph.mgr.x:Started 2026-02-22T22:33:33.203 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T22:33:33.203 DEBUG:teuthology.orchestra.run.trial041:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T22:33:33.303 INFO:teuthology.orchestra.run.trial041.stderr:adjusted tunables profile to default 2026-02-22T22:33:33.313 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T22:33:33.313 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T22:33:33.314 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:33.314 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T22:33:33.323 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:33.324 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T22:33:33.341 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.339+0000 7f00697fa280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T22:33:33.349 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:33:33.350 DEBUG:teuthology.orchestra.run.trial041:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T22:33:33.368 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.367+0000 7f00697fa280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T22:33:33.376 DEBUG:teuthology.orchestra.run.trial041:> sudo ceph --cluster ceph osd new ab10ba97-b129-481c-a62f-bf11066693c4 0 2026-02-22T22:33:33.405 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.403+0000 7f00697fa280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T22:33:33.494 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.491+0000 7f00697fa280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T22:33:33.499 INFO:teuthology.orchestra.run.trial041.stdout:0 2026-02-22T22:33:33.508 DEBUG:teuthology.orchestra.run.trial041:> sudo ceph --cluster ceph osd new bc41bc1c-4ba7-4c04-9f70-887dd9cb360c 1 2026-02-22T22:33:33.577 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.575+0000 7f00697fa280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:33:33.601 INFO:teuthology.orchestra.run.trial041.stdout:1 2026-02-22T22:33:33.611 DEBUG:teuthology.orchestra.run.trial041:> sudo ceph --cluster ceph osd new 17d9e4e4-8538-4412-9443-8df11c3aa95b 2 2026-02-22T22:33:33.615 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.611+0000 7f00697fa280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T22:33:33.692 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.691+0000 7f00697fa280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T22:33:33.706 INFO:teuthology.orchestra.run.trial041.stdout:2 2026-02-22T22:33:33.715 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T22:33:33.716 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T22:33:33.761 INFO:tasks.ceph.osd.0:Started 2026-02-22T22:33:33.761 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T22:33:33.761 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T22:33:33.763 INFO:tasks.ceph.osd.1:Started 2026-02-22T22:33:33.763 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T22:33:33.764 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T22:33:33.766 INFO:tasks.ceph.osd.2:Started 2026-02-22T22:33:33.766 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:33:33.859 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:33.859 INFO:teuthology.orchestra.run.trial041.stdout:{"epoch":5,"fsid":"7b095714-3316-4e30-a59a-81c2a99e0305","created":"2026-02-22T22:33:33.263282+0000","modified":"2026-02-22T22:33:33.705548+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:33:33.705548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ab10ba97-b129-481c-a62f-bf11066693c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc41bc1c-4ba7-4c04-9f70-887dd9cb360c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"17d9e4e4-8538-4412-9443-8df11c3aa95b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:33:33.869 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T22:33:33.870 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T22:33:33.872 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:33.871+0000 7f00697fa280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T22:33:34.171 DEBUG:teuthology.orchestra.run.trial041:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:33:34.176 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.175+0000 7f00697fa280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T22:33:34.262 INFO:teuthology.misc.health.trial041.stdout: 2026-02-22T22:33:34.262 INFO:teuthology.misc.health.trial041.stdout:{"epoch":5,"fsid":"7b095714-3316-4e30-a59a-81c2a99e0305","created":"2026-02-22T22:33:33.263282+0000","modified":"2026-02-22T22:33:33.705548+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:33:33.705548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ab10ba97-b129-481c-a62f-bf11066693c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc41bc1c-4ba7-4c04-9f70-887dd9cb360c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"17d9e4e4-8538-4412-9443-8df11c3aa95b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:33:34.270 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-22T22:33:34.271 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.267+0000 7f00697fa280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T22:33:34.298 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.295+0000 7f00697fa280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T22:33:34.329 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.327+0000 7f00697fa280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T22:33:34.372 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.371+0000 7f00697fa280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T22:33:34.470 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.467+0000 7f00697fa280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:33:34.658 INFO:tasks.ceph.mgr.x.trial041.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-22T22:33:34.828 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.827+0000 7f00697fa280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T22:33:34.859 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.855+0000 7f00697fa280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T22:33:34.950 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.947+0000 7f00697fa280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T22:33:34.974 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.971+0000 7f00697fa280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T22:33:35.000 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:34.999+0000 7f00697fa280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T22:33:35.027 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:35.023+0000 7f00697fa280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T22:33:35.146 INFO:tasks.ceph.mgr.x.trial041.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T22:33:35.146 INFO:tasks.ceph.mgr.x.trial041.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T22:33:35.146 INFO:tasks.ceph.mgr.x.trial041.stderr: from numpy import show_config as show_numpy_config 2026-02-22T22:33:35.153 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:35.151+0000 7f00697fa280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T22:33:35.179 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:35.175+0000 7f00697fa280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T22:33:35.217 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:35.215+0000 7f00697fa280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T22:33:35.812 INFO:tasks.ceph.osd.0.trial041.stderr:2026-02-22T22:33:35.811+0000 7f2e321e08c0 -1 Falling back to public interface 2026-02-22T22:33:35.813 INFO:tasks.ceph.osd.1.trial041.stderr:2026-02-22T22:33:35.811+0000 7fc92c0428c0 -1 Falling back to public interface 2026-02-22T22:33:35.868 INFO:tasks.ceph.osd.2.trial041.stderr:2026-02-22T22:33:35.867+0000 7f9d3a93d8c0 -1 Falling back to public interface 2026-02-22T22:33:36.243 INFO:tasks.ceph.mgr.x.trial041.stderr:2026-02-22T22:33:36.243+0000 7eff88049640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-22T22:33:40.572 DEBUG:teuthology.orchestra.run.trial041:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:33:40.707 INFO:tasks.ceph.osd.0.trial041.stderr:2026-02-22T22:33:40.703+0000 7f2e321e08c0 -1 osd.0 0 log_to_monitors true 2026-02-22T22:33:40.719 INFO:teuthology.misc.health.trial041.stdout: 2026-02-22T22:33:40.719 INFO:teuthology.misc.health.trial041.stdout:{"epoch":5,"fsid":"7b095714-3316-4e30-a59a-81c2a99e0305","created":"2026-02-22T22:33:33.263282+0000","modified":"2026-02-22T22:33:33.705548+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:33:33.705548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ab10ba97-b129-481c-a62f-bf11066693c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc41bc1c-4ba7-4c04-9f70-887dd9cb360c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"17d9e4e4-8538-4412-9443-8df11c3aa95b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:33:40.728 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-22T22:33:40.759 INFO:tasks.ceph.osd.1.trial041.stderr:2026-02-22T22:33:40.755+0000 7fc92c0428c0 -1 osd.1 0 log_to_monitors true 2026-02-22T22:33:40.832 INFO:tasks.ceph.osd.2.trial041.stderr:2026-02-22T22:33:40.831+0000 7f9d3a93d8c0 -1 osd.2 0 log_to_monitors true 2026-02-22T22:33:41.765 INFO:tasks.ceph.osd.0.trial041.stderr:2026-02-22T22:33:41.763+0000 7f2e2e167640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T22:33:41.784 INFO:tasks.ceph.osd.0.trial041.stderr:2026-02-22T22:33:41.783+0000 7f2e25fab640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:33:42.767 INFO:tasks.ceph.osd.1.trial041.stderr:2026-02-22T22:33:42.763+0000 7fc927fc9640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T22:33:42.769 INFO:tasks.ceph.osd.2.trial041.stderr:2026-02-22T22:33:42.767+0000 7f9d368c4640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T22:33:42.780 INFO:tasks.ceph.osd.1.trial041.stderr:2026-02-22T22:33:42.779+0000 7fc91fe0d640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:33:42.808 INFO:tasks.ceph.osd.2.trial041.stderr:2026-02-22T22:33:42.807+0000 7f9d2e708640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:33:47.031 DEBUG:teuthology.orchestra.run.trial041:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:33:47.173 INFO:teuthology.misc.health.trial041.stdout: 2026-02-22T22:33:47.173 INFO:teuthology.misc.health.trial041.stdout:{"epoch":11,"fsid":"7b095714-3316-4e30-a59a-81c2a99e0305","created":"2026-02-22T22:33:33.263282+0000","modified":"2026-02-22T22:33:46.770521+0000","last_up_change":"2026-02-22T22:33:43.765247+0000","last_in_change":"2026-02-22T22:33:33.705548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:33:45.273396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab10ba97-b129-481c-a62f-bf11066693c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6802","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6803","nonce":4084981383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6805","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6806","nonce":4084981383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6811","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6813","nonce":4084981383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6808","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6810","nonce":4084981383}]},"public_addr":"10.20.193.41:6803/4084981383","cluster_addr":"10.20.193.41:6806/4084981383","heartbeat_back_addr":"10.20.193.41:6813/4084981383","heartbeat_front_addr":"10.20.193.41:6810/4084981383","state":["exists","up"]},{"osd":1,"uuid":"bc41bc1c-4ba7-4c04-9f70-887dd9cb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6804","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6807","nonce":577187467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6809","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6812","nonce":577187467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6816","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6817","nonce":577187467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6814","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6815","nonce":577187467}]},"public_addr":"10.20.193.41:6807/577187467","cluster_addr":"10.20.193.41:6812/577187467","heartbeat_back_addr":"10.20.193.41:6817/577187467","heartbeat_front_addr":"10.20.193.41:6815/577187467","state":["exists","up"]},{"osd":2,"uuid":"17d9e4e4-8538-4412-9443-8df11c3aa95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6818","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6819","nonce":2868293051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6820","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6821","nonce":2868293051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6824","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6825","nonce":2868293051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6822","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6823","nonce":2868293051}]},"public_addr":"10.20.193.41:6819/2868293051","cluster_addr":"10.20.193.41:6821/2868293051","heartbeat_back_addr":"10.20.193.41:6825/2868293051","heartbeat_front_addr":"10.20.193.41:6823/2868293051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:33:47.182 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-22T22:33:47.182 INFO:tasks.ceph:Creating RBD pool 2026-02-22T22:33:47.182 DEBUG:teuthology.orchestra.run.trial041:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T22:33:47.774 INFO:teuthology.orchestra.run.trial041.stderr:pool 'rbd' created 2026-02-22T22:33:47.786 DEBUG:teuthology.orchestra.run.trial041:> rbd --cluster ceph pool init rbd 2026-02-22T22:33:50.795 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T22:33:50.795 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T22:33:50.796 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T22:33:50.796 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T22:33:50.796 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T22:33:50.962 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:50.973 INFO:teuthology.orchestra.run.trial041.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6800","nonce":3899839374},{"type":"v1","addr":"10.20.193.41:6801","nonce":3899839374}]},"active_addr":"10.20.193.41:6801/3899839374","active_change":"2026-02-22T22:33:35.236576+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.41:0","nonce":3912159583}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.41:0","nonce":2747622587}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.41:0","nonce":770286070}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.41:0","nonce":1542991478}]}]} 2026-02-22T22:33:50.975 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T22:33:50.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T22:33:50.975 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:33:51.127 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:51.128 INFO:teuthology.orchestra.run.trial041.stdout:{"epoch":15,"fsid":"7b095714-3316-4e30-a59a-81c2a99e0305","created":"2026-02-22T22:33:33.263282+0000","modified":"2026-02-22T22:33:50.783630+0000","last_up_change":"2026-02-22T22:33:43.765247+0000","last_in_change":"2026-02-22T22:33:33.705548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:33:45.273396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:33:47.331082+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab10ba97-b129-481c-a62f-bf11066693c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6802","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6803","nonce":4084981383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6805","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6806","nonce":4084981383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6811","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6813","nonce":4084981383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6808","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6810","nonce":4084981383}]},"public_addr":"10.20.193.41:6803/4084981383","cluster_addr":"10.20.193.41:6806/4084981383","heartbeat_back_addr":"10.20.193.41:6813/4084981383","heartbeat_front_addr":"10.20.193.41:6810/4084981383","state":["exists","up"]},{"osd":1,"uuid":"bc41bc1c-4ba7-4c04-9f70-887dd9cb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6804","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6807","nonce":577187467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6809","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6812","nonce":577187467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6816","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6817","nonce":577187467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6814","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6815","nonce":577187467}]},"public_addr":"10.20.193.41:6807/577187467","cluster_addr":"10.20.193.41:6812/577187467","heartbeat_back_addr":"10.20.193.41:6817/577187467","heartbeat_front_addr":"10.20.193.41:6815/577187467","state":["exists","up"]},{"osd":2,"uuid":"17d9e4e4-8538-4412-9443-8df11c3aa95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6818","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6819","nonce":2868293051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6820","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6821","nonce":2868293051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6824","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6825","nonce":2868293051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6822","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6823","nonce":2868293051}]},"public_addr":"10.20.193.41:6819/2868293051","cluster_addr":"10.20.193.41:6821/2868293051","heartbeat_back_addr":"10.20.193.41:6825/2868293051","heartbeat_front_addr":"10.20.193.41:6823/2868293051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:33:51.139 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T22:33:51.139 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:33:51.282 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:51.282 INFO:teuthology.orchestra.run.trial041.stdout:{"epoch":15,"fsid":"7b095714-3316-4e30-a59a-81c2a99e0305","created":"2026-02-22T22:33:33.263282+0000","modified":"2026-02-22T22:33:50.783630+0000","last_up_change":"2026-02-22T22:33:43.765247+0000","last_in_change":"2026-02-22T22:33:33.705548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:33:45.273396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:33:47.331082+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab10ba97-b129-481c-a62f-bf11066693c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6802","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6803","nonce":4084981383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6805","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6806","nonce":4084981383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6811","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6813","nonce":4084981383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6808","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6810","nonce":4084981383}]},"public_addr":"10.20.193.41:6803/4084981383","cluster_addr":"10.20.193.41:6806/4084981383","heartbeat_back_addr":"10.20.193.41:6813/4084981383","heartbeat_front_addr":"10.20.193.41:6810/4084981383","state":["exists","up"]},{"osd":1,"uuid":"bc41bc1c-4ba7-4c04-9f70-887dd9cb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6804","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6807","nonce":577187467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6809","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6812","nonce":577187467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6816","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6817","nonce":577187467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6814","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6815","nonce":577187467}]},"public_addr":"10.20.193.41:6807/577187467","cluster_addr":"10.20.193.41:6812/577187467","heartbeat_back_addr":"10.20.193.41:6817/577187467","heartbeat_front_addr":"10.20.193.41:6815/577187467","state":["exists","up"]},{"osd":2,"uuid":"17d9e4e4-8538-4412-9443-8df11c3aa95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6818","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6819","nonce":2868293051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6820","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6821","nonce":2868293051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6824","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6825","nonce":2868293051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6822","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6823","nonce":2868293051}]},"public_addr":"10.20.193.41:6819/2868293051","cluster_addr":"10.20.193.41:6821/2868293051","heartbeat_back_addr":"10.20.193.41:6825/2868293051","heartbeat_front_addr":"10.20.193.41:6823/2868293051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:33:51.292 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T22:33:51.292 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T22:33:51.292 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T22:33:51.373 INFO:teuthology.orchestra.run.trial041.stdout:34359738372 2026-02-22T22:33:51.374 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T22:33:51.376 INFO:teuthology.orchestra.run.trial041.stdout:38654705668 2026-02-22T22:33:51.376 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T22:33:51.377 INFO:teuthology.orchestra.run.trial041.stdout:38654705668 2026-02-22T22:33:51.378 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T22:33:51.559 INFO:teuthology.orchestra.run.trial041.stdout:38654705666 2026-02-22T22:33:51.563 INFO:teuthology.orchestra.run.trial041.stdout:38654705666 2026-02-22T22:33:51.567 INFO:teuthology.orchestra.run.trial041.stdout:34359738371 2026-02-22T22:33:51.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.2 2026-02-22T22:33:51.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.1 2026-02-22T22:33:51.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2026-02-22T22:33:52.571 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T22:33:52.575 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T22:33:52.579 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T22:33:52.718 INFO:teuthology.orchestra.run.trial041.stdout:38654705667 2026-02-22T22:33:52.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2026-02-22T22:33:52.760 INFO:teuthology.orchestra.run.trial041.stdout:34359738371 2026-02-22T22:33:52.763 INFO:teuthology.orchestra.run.trial041.stdout:38654705667 2026-02-22T22:33:52.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2026-02-22T22:33:52.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2026-02-22T22:33:53.730 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T22:33:53.773 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T22:33:53.775 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T22:33:53.883 INFO:teuthology.orchestra.run.trial041.stdout:38654705668 2026-02-22T22:33:53.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2026-02-22T22:33:53.896 DEBUG:teuthology.parallel:result is None 2026-02-22T22:33:53.921 INFO:teuthology.orchestra.run.trial041.stdout:34359738372 2026-02-22T22:33:53.923 INFO:teuthology.orchestra.run.trial041.stdout:38654705668 2026-02-22T22:33:53.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2026-02-22T22:33:53.933 DEBUG:teuthology.parallel:result is None 2026-02-22T22:33:53.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2026-02-22T22:33:53.934 DEBUG:teuthology.parallel:result is None 2026-02-22T22:33:53.934 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T22:33:53.935 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:33:54.117 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:54.117 INFO:teuthology.orchestra.run.trial041.stderr:dumped all 2026-02-22T22:33:54.126 INFO:teuthology.orchestra.run.trial041.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-22T22:33:53.241215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82948,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032572,"statfs":{"total":289910292480,"available":289825353728,"internally_reserved":0,"allocated":1581056,"data_stored":1290543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.457519"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790766+0000","last_change":"2026-02-22T22:33:50.790935+0000","last_active":"2026-02-22T22:33:50.790766+0000","last_peered":"2026-02-22T22:33:50.790766+0000","last_clean":"2026-02-22T22:33:50.790766+0000","last_became_active":"2026-02-22T22:33:48.782300+0000","last_became_peered":"2026-02-22T22:33:48.782300+0000","last_unstale":"2026-02-22T22:33:50.790766+0000","last_undegraded":"2026-02-22T22:33:50.790766+0000","last_fullsized":"2026-02-22T22:33:50.790766+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:05:04.056501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053992899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790579+0000","last_change":"2026-02-22T22:33:50.790731+0000","last_active":"2026-02-22T22:33:50.790579+0000","last_peered":"2026-02-22T22:33:50.790579+0000","last_clean":"2026-02-22T22:33:50.790579+0000","last_became_active":"2026-02-22T22:33:48.782112+0000","last_became_peered":"2026-02-22T22:33:48.782112+0000","last_unstale":"2026-02-22T22:33:50.790579+0000","last_undegraded":"2026-02-22T22:33:50.790579+0000","last_fullsized":"2026-02-22T22:33:50.790579+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:14:41.488726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033764100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790984+0000","last_change":"2026-02-22T22:33:50.791134+0000","last_active":"2026-02-22T22:33:50.790984+0000","last_peered":"2026-02-22T22:33:50.790984+0000","last_clean":"2026-02-22T22:33:50.790984+0000","last_became_active":"2026-02-22T22:33:48.781389+0000","last_became_peered":"2026-02-22T22:33:48.781389+0000","last_unstale":"2026-02-22T22:33:50.790984+0000","last_undegraded":"2026-02-22T22:33:50.790984+0000","last_fullsized":"2026-02-22T22:33:50.790984+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:24:48.189475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076235500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790735+0000","last_change":"2026-02-22T22:33:50.790940+0000","last_active":"2026-02-22T22:33:50.790735+0000","last_peered":"2026-02-22T22:33:50.790735+0000","last_clean":"2026-02-22T22:33:50.790735+0000","last_became_active":"2026-02-22T22:33:48.781449+0000","last_became_peered":"2026-02-22T22:33:48.781449+0000","last_unstale":"2026-02-22T22:33:50.790735+0000","last_undegraded":"2026-02-22T22:33:50.790735+0000","last_fullsized":"2026-02-22T22:33:50.790735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:13:03.904116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054985799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.789091+0000","last_change":"2026-02-22T22:33:50.789091+0000","last_active":"2026-02-22T22:33:50.789091+0000","last_peered":"2026-02-22T22:33:50.789091+0000","last_clean":"2026-02-22T22:33:50.789091+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:33:50.789091+0000","last_undegraded":"2026-02-22T22:33:50.789091+0000","last_fullsized":"2026-02-22T22:33:50.789091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:59:22.461409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081904000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.786679+0000","last_change":"2026-02-22T22:33:50.786819+0000","last_active":"2026-02-22T22:33:50.786679+0000","last_peered":"2026-02-22T22:33:50.786679+0000","last_clean":"2026-02-22T22:33:50.786679+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:33:50.786679+0000","last_undegraded":"2026-02-22T22:33:50.786679+0000","last_fullsized":"2026-02-22T22:33:50.786679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:09:39.643554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028241799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.786650+0000","last_change":"2026-02-22T22:33:50.786829+0000","last_active":"2026-02-22T22:33:50.786650+0000","last_peered":"2026-02-22T22:33:50.786650+0000","last_clean":"2026-02-22T22:33:50.786650+0000","last_became_active":"2026-02-22T22:33:48.781534+0000","last_became_peered":"2026-02-22T22:33:48.781534+0000","last_unstale":"2026-02-22T22:33:50.786650+0000","last_undegraded":"2026-02-22T22:33:50.786650+0000","last_fullsized":"2026-02-22T22:33:50.786650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:51.063509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029879899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790542+0000","last_change":"2026-02-22T22:33:50.790704+0000","last_active":"2026-02-22T22:33:50.790542+0000","last_peered":"2026-02-22T22:33:50.790542+0000","last_clean":"2026-02-22T22:33:50.790542+0000","last_became_active":"2026-02-22T22:33:48.781180+0000","last_became_peered":"2026-02-22T22:33:48.781180+0000","last_unstale":"2026-02-22T22:33:50.790542+0000","last_undegraded":"2026-02-22T22:33:50.790542+0000","last_fullsized":"2026-02-22T22:33:50.790542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:28.203780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034393299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":108,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790358+0000","last_change":"2026-02-22T22:33:47.700223+0000","last_active":"2026-02-22T22:33:50.790358+0000","last_peered":"2026-02-22T22:33:50.790358+0000","last_clean":"2026-02-22T22:33:50.790358+0000","last_became_active":"2026-02-22T22:33:47.699393+0000","last_became_peered":"2026-02-22T22:33:47.699393+0000","last_unstale":"2026-02-22T22:33:50.790358+0000","last_undegraded":"2026-02-22T22:33:50.790358+0000","last_fullsized":"2026-02-22T22:33:50.790358+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_clean_scrub_stamp":"2026-02-22T22:33:45.768464+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:34.086878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":131072,"data_stored":37780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":729088,"data_stored":628167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":720896,"data_stored":624596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:33:54.127 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:33:54.265 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:54.266 INFO:teuthology.orchestra.run.trial041.stderr:dumped all 2026-02-22T22:33:54.275 INFO:teuthology.orchestra.run.trial041.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-22T22:33:53.241215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82948,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032572,"statfs":{"total":289910292480,"available":289825353728,"internally_reserved":0,"allocated":1581056,"data_stored":1290543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.457519"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790766+0000","last_change":"2026-02-22T22:33:50.790935+0000","last_active":"2026-02-22T22:33:50.790766+0000","last_peered":"2026-02-22T22:33:50.790766+0000","last_clean":"2026-02-22T22:33:50.790766+0000","last_became_active":"2026-02-22T22:33:48.782300+0000","last_became_peered":"2026-02-22T22:33:48.782300+0000","last_unstale":"2026-02-22T22:33:50.790766+0000","last_undegraded":"2026-02-22T22:33:50.790766+0000","last_fullsized":"2026-02-22T22:33:50.790766+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:05:04.056501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053992899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790579+0000","last_change":"2026-02-22T22:33:50.790731+0000","last_active":"2026-02-22T22:33:50.790579+0000","last_peered":"2026-02-22T22:33:50.790579+0000","last_clean":"2026-02-22T22:33:50.790579+0000","last_became_active":"2026-02-22T22:33:48.782112+0000","last_became_peered":"2026-02-22T22:33:48.782112+0000","last_unstale":"2026-02-22T22:33:50.790579+0000","last_undegraded":"2026-02-22T22:33:50.790579+0000","last_fullsized":"2026-02-22T22:33:50.790579+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:14:41.488726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033764100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790984+0000","last_change":"2026-02-22T22:33:50.791134+0000","last_active":"2026-02-22T22:33:50.790984+0000","last_peered":"2026-02-22T22:33:50.790984+0000","last_clean":"2026-02-22T22:33:50.790984+0000","last_became_active":"2026-02-22T22:33:48.781389+0000","last_became_peered":"2026-02-22T22:33:48.781389+0000","last_unstale":"2026-02-22T22:33:50.790984+0000","last_undegraded":"2026-02-22T22:33:50.790984+0000","last_fullsized":"2026-02-22T22:33:50.790984+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:24:48.189475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076235500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790735+0000","last_change":"2026-02-22T22:33:50.790940+0000","last_active":"2026-02-22T22:33:50.790735+0000","last_peered":"2026-02-22T22:33:50.790735+0000","last_clean":"2026-02-22T22:33:50.790735+0000","last_became_active":"2026-02-22T22:33:48.781449+0000","last_became_peered":"2026-02-22T22:33:48.781449+0000","last_unstale":"2026-02-22T22:33:50.790735+0000","last_undegraded":"2026-02-22T22:33:50.790735+0000","last_fullsized":"2026-02-22T22:33:50.790735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:13:03.904116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054985799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.789091+0000","last_change":"2026-02-22T22:33:50.789091+0000","last_active":"2026-02-22T22:33:50.789091+0000","last_peered":"2026-02-22T22:33:50.789091+0000","last_clean":"2026-02-22T22:33:50.789091+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:33:50.789091+0000","last_undegraded":"2026-02-22T22:33:50.789091+0000","last_fullsized":"2026-02-22T22:33:50.789091+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:59:22.461409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081904000000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.786679+0000","last_change":"2026-02-22T22:33:50.786819+0000","last_active":"2026-02-22T22:33:50.786679+0000","last_peered":"2026-02-22T22:33:50.786679+0000","last_clean":"2026-02-22T22:33:50.786679+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:33:50.786679+0000","last_undegraded":"2026-02-22T22:33:50.786679+0000","last_fullsized":"2026-02-22T22:33:50.786679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:09:39.643554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028241799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.786650+0000","last_change":"2026-02-22T22:33:50.786829+0000","last_active":"2026-02-22T22:33:50.786650+0000","last_peered":"2026-02-22T22:33:50.786650+0000","last_clean":"2026-02-22T22:33:50.786650+0000","last_became_active":"2026-02-22T22:33:48.781534+0000","last_became_peered":"2026-02-22T22:33:48.781534+0000","last_unstale":"2026-02-22T22:33:50.786650+0000","last_undegraded":"2026-02-22T22:33:50.786650+0000","last_fullsized":"2026-02-22T22:33:50.786650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:58:51.063509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029879899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790542+0000","last_change":"2026-02-22T22:33:50.790704+0000","last_active":"2026-02-22T22:33:50.790542+0000","last_peered":"2026-02-22T22:33:50.790542+0000","last_clean":"2026-02-22T22:33:50.790542+0000","last_became_active":"2026-02-22T22:33:48.781180+0000","last_became_peered":"2026-02-22T22:33:48.781180+0000","last_unstale":"2026-02-22T22:33:50.790542+0000","last_undegraded":"2026-02-22T22:33:50.790542+0000","last_fullsized":"2026-02-22T22:33:50.790542+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:02:28.203780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034393299999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"12'72","reported_seq":108,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-22T22:33:50.790358+0000","last_change":"2026-02-22T22:33:47.700223+0000","last_active":"2026-02-22T22:33:50.790358+0000","last_peered":"2026-02-22T22:33:50.790358+0000","last_clean":"2026-02-22T22:33:50.790358+0000","last_became_active":"2026-02-22T22:33:47.699393+0000","last_became_peered":"2026-02-22T22:33:47.699393+0000","last_unstale":"2026-02-22T22:33:50.790358+0000","last_undegraded":"2026-02-22T22:33:50.790358+0000","last_fullsized":"2026-02-22T22:33:50.790358+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_clean_scrub_stamp":"2026-02-22T22:33:45.768464+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:34.086878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":131072,"data_stored":37780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":729088,"data_stored":628167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":720896,"data_stored":624596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:33:54.276 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T22:33:54.276 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T22:33:54.276 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T22:33:54.276 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T22:33:54.441 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:33:54.441 INFO:teuthology.orchestra.run.trial041.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T22:33:54.453 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T22:33:54.453 INFO:teuthology.run_tasks:Running task workunit... 2026-02-22T22:33:54.480 INFO:tasks.workunit:Pulling workunits from ref f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:33:54.480 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-22T22:33:54.480 DEBUG:teuthology.orchestra.run.trial041:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-22T22:33:54.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:33:54.485 INFO:teuthology.orchestra.run.trial041.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-22T22:33:54.486 DEBUG:teuthology.orchestra.run.trial041:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T22:33:54.531 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-22T22:33:54.531 DEBUG:teuthology.orchestra.run.trial041:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-22T22:33:54.574 INFO:tasks.workunit:timeout=3h 2026-02-22T22:33:54.575 INFO:tasks.workunit:cleanup=True 2026-02-22T22:33:54.575 DEBUG:teuthology.orchestra.run.trial041:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:33:54.626 INFO:tasks.workunit.client.0.trial041.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-22T22:34:17.466 INFO:tasks.workunit.client.0.trial041.stderr:Note: switching to 'f90f4eaebb28b619cf76e80cbbe997656da69579'. 2026-02-22T22:34:17.466 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:17.466 INFO:tasks.workunit.client.0.trial041.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr:state without impacting any branches by switching back to a branch. 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr: git switch -c 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr:Or undo this operation with: 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:17.467 INFO:tasks.workunit.client.0.trial041.stderr: git switch - 2026-02-22T22:34:17.468 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:17.468 INFO:tasks.workunit.client.0.trial041.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-22T22:34:17.468 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:17.468 INFO:tasks.workunit.client.0.trial041.stderr:HEAD is now at f90f4eaebb2 Merge branch 'wip-74712-squid' of https://github.com/idryomov/ceph into wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:34:17.476 DEBUG:teuthology.orchestra.run.trial041:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-22T22:34:17.523 INFO:tasks.workunit.client.0.trial041.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-22T22:34:17.524 INFO:tasks.workunit.client.0.trial041.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T22:34:17.524 INFO:tasks.workunit.client.0.trial041.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-22T22:34:17.620 INFO:tasks.workunit.client.0.trial041.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-22T22:34:17.653 INFO:tasks.workunit.client.0.trial041.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-22T22:34:17.679 INFO:tasks.workunit.client.0.trial041.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-22T22:34:17.680 INFO:tasks.workunit.client.0.trial041.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T22:34:17.681 INFO:tasks.workunit.client.0.trial041.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-22T22:34:17.702 INFO:tasks.workunit.client.0.trial041.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-22T22:34:17.706 DEBUG:teuthology.orchestra.run.trial041:> set -ex 2026-02-22T22:34:17.706 DEBUG:teuthology.orchestra.run.trial041:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-22T22:34:17.750 INFO:tasks.workunit:Running workunits matching rbd/import_export.sh on client.0... 2026-02-22T22:34:17.751 INFO:tasks.workunit:Running workunit rbd/import_export.sh... 2026-02-22T22:34:17.751 DEBUG:teuthology.orchestra.run.trial041:workunit test rbd/import_export.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f90f4eaebb28b619cf76e80cbbe997656da69579 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/import_export.sh 2026-02-22T22:34:17.797 INFO:tasks.workunit.client.0.trial041.stderr:+ export RBD_FORCE_ALLOW_V1=1 2026-02-22T22:34:17.798 INFO:tasks.workunit.client.0.trial041.stderr:+ TMPDIR=/tmp/rbd_import_export_19636 2026-02-22T22:34:17.798 INFO:tasks.workunit.client.0.trial041.stderr:+ rm -rf /tmp/rbd_import_export_19636 2026-02-22T22:34:17.798 INFO:tasks.workunit.client.0.trial041.stderr:+ mkdir /tmp/rbd_import_export_19636 2026-02-22T22:34:17.799 INFO:tasks.workunit.client.0.trial041.stderr:+ trap rm -rf /tmp/rbd_import_export_19636 INT TERM EXIT 2026-02-22T22:34:17.799 INFO:tasks.workunit.client.0.trial041.stderr:+ mkdir foo.19636 2026-02-22T22:34:17.799 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import foo.19636 foo.dir 2026-02-22T22:34:17.816 INFO:tasks.workunit.client.0.trial041.stderr:rbd: cannot import a directory 2026-02-22T22:34:17.816 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 0% complete...failed. 2026-02-22T22:34:17.816 INFO:tasks.workunit.client.0.trial041.stderr:rbd: import failed: (21) Is a directory 2026-02-22T22:34:17.818 INFO:tasks.workunit.client.0.trial041.stderr:+ true 2026-02-22T22:34:17.818 INFO:tasks.workunit.client.0.trial041.stderr:+ rmdir foo.19636 2026-02-22T22:34:17.819 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/bin/sh of=/tmp/rbd_import_export_19636/img bs=1k count=1 seek=10 2026-02-22T22:34:17.820 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records in 2026-02-22T22:34:17.820 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records out 2026-02-22T22:34:17.820 INFO:tasks.workunit.client.0.trial041.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 2.8503e-05 s, 35.9 MB/s 2026-02-22T22:34:17.821 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/bin/dd of=/tmp/rbd_import_export_19636/img bs=1k count=10 seek=100 2026-02-22T22:34:17.821 INFO:tasks.workunit.client.0.trial041.stderr:10+0 records in 2026-02-22T22:34:17.821 INFO:tasks.workunit.client.0.trial041.stderr:10+0 records out 2026-02-22T22:34:17.821 INFO:tasks.workunit.client.0.trial041.stderr:10240 bytes (10 kB, 10 KiB) copied, 4.5595e-05 s, 225 MB/s 2026-02-22T22:34:17.821 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/bin/rm of=/tmp/rbd_import_export_19636/img bs=1k count=100 seek=1000 2026-02-22T22:34:17.822 INFO:tasks.workunit.client.0.trial041.stderr:58+1 records in 2026-02-22T22:34:17.822 INFO:tasks.workunit.client.0.trial041.stderr:58+1 records out 2026-02-22T22:34:17.822 INFO:tasks.workunit.client.0.trial041.stderr:59912 bytes (60 kB, 59 KiB) copied, 0.000290313 s, 206 MB/s 2026-02-22T22:34:17.822 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/bin/ls of=/tmp/rbd_import_export_19636/img bs=1k seek=10000 2026-02-22T22:34:17.822 INFO:tasks.workunit.client.0.trial041.stderr:134+1 records in 2026-02-22T22:34:17.823 INFO:tasks.workunit.client.0.trial041.stderr:134+1 records out 2026-02-22T22:34:17.823 INFO:tasks.workunit.client.0.trial041.stderr:138216 bytes (138 kB, 135 KiB) copied, 0.000478114 s, 289 MB/s 2026-02-22T22:34:17.823 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/bin/ln of=/tmp/rbd_import_export_19636/img bs=1k seek=100000 2026-02-22T22:34:17.823 INFO:tasks.workunit.client.0.trial041.stderr:58+1 records in 2026-02-22T22:34:17.823 INFO:tasks.workunit.client.0.trial041.stderr:58+1 records out 2026-02-22T22:34:17.823 INFO:tasks.workunit.client.0.trial041.stderr:59912 bytes (60 kB, 59 KiB) copied, 0.000172843 s, 347 MB/s 2026-02-22T22:34:17.824 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/bin/grep of=/tmp/rbd_import_export_19636/img bs=1k seek=1000000 2026-02-22T22:34:17.824 INFO:tasks.workunit.client.0.trial041.stderr:178+1 records in 2026-02-22T22:34:17.824 INFO:tasks.workunit.client.0.trial041.stderr:178+1 records out 2026-02-22T22:34:17.824 INFO:tasks.workunit.client.0.trial041.stderr:182728 bytes (183 kB, 178 KiB) copied, 0.000443949 s, 412 MB/s 2026-02-22T22:34:17.824 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm testimg 2026-02-22T22:34:17.848 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 0% complete...failed. 2026-02-22T22:34:17.848 INFO:tasks.workunit.client.0.trial041.stderr:rbd: delete error: (2) No such file or directory 2026-02-22T22:34:17.851 INFO:tasks.workunit.client.0.trial041.stderr:+ true 2026-02-22T22:34:17.851 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import /tmp/rbd_import_export_19636/img testimg 2026-02-22T22:34:17.868 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:17.866+0000 7f19ba905080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:19.678 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 1% complete... Importing image: 2% complete... Importing image: 3% complete... Importing image: 4% complete... Importing image: 5% complete... Importing image: 6% complete... Importing image: 7% complete... Importing image: 8% complete... Importing image: 9% complete... Importing image: 10% complete... Importing image: 11% complete... Importing image: 12% complete... Importing image: 13% complete... Importing image: 14% complete... Importing image: 15% complete... Importing image: 16% complete... Importing image: 17% complete... Importing image: 18% complete... Importing image: 19% complete... Importing image: 20% complete... Importing image: 21% complete... Importing image: 22% complete... Importing image: 23% complete... Importing image: 24% complete... Importing image: 25% complete... Importing image: 26% complete... Importing image: 27% complete... Importing image: 28% complete... Importing image: 29% complete... Importing image: 30% complete... Importing image: 31% complete... Importing image: 32% complete... Importing image: 33% complete... Importing image: 34% complete... Importing image: 35% complete... Importing image: 36% complete... Importing image: 37% complete... Importing image: 38% complete... Importing image: 39% complete... Importing image: 40% complete... Importing image: 41% complete... Importing image: 42% complete... Importing image: 43% complete... Importing image: 44% complete... Importing image: 45% complete... Importing image: 46% complete... Importing image: 47% complete... Importing image: 48% complete... Importing image: 49% complete... Importing image: 50% complete... Importing image: 51% complete... Importing image: 52% complete... Importing image: 53% complete... Importing image: 54% complete... Importing image: 55% complete... Importing image: 56% complete... Importing image: 57% complete... Importing image: 58% complete... Importing image: 59% complete... Importing image: 60% complete... Importing image: 61% complete... Importing image: 62% complete... Importing image: 63% complete... Importing image: 64% complete... Importing image: 65% complete... Importing image: 66% complete... Importing image: 67% complete... Importing image: 68% complete... Importing image: 69% complete... Importing image: 70% complete... Importing image: 71% complete... Importing image: 72% complete... Importing image: 73% complete... Importing image: 74% complete... Importing image: 75% complete... Importing image: 76% complete... Importing image: 77% complete... Importing image: 78% complete... Importing image: 79% complete... Importing image: 80% complete... Importing image: 81% complete... Importing image: 82% complete... Importing image: 83% complete... Importing image: 84% complete... Importing image: 85% complete... Importing image: 86% complete... Importing image: 87% complete... Importing image: 88% complete... Importing image: 89% complete... Importing image: 90% complete... Importing image: 91% complete... Importing image: 92% complete... Importing image: 93% complete... Importing image: 94% complete... Importing image: 95% complete... Importing image: 96% complete... Importing image: 97% complete... Importing image: 98% complete... Importing image: 99% complete... Importing image: 100% complete...done. 2026-02-22T22:34:19.682 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export testimg /tmp/rbd_import_export_19636/img2 2026-02-22T22:34:19.766 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete...2026-02-22T22:34:19.762+0000 7f8e91079640 0 -- 10.20.193.41:0/3917151108 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x7f8e6800f680 msgr2=0x7f8e6800faf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:19.777 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete...2026-02-22T22:34:19.774+0000 7f8e91079640 0 -- 10.20.193.41:0/3917151108 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x7f8e7003e460 msgr2=0x7f8e70040870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:19.820 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:19.828 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export testimg - 2026-02-22T22:34:20.135 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete...2026-02-22T22:34:20.134+0000 7f5bd321e640 0 -- 10.20.193.41:0/3372215945 >> [v2:10.20.193.41:6802/4084981383,v1:10.20.193.41:6803/4084981383] conn(0x7f5bac014310 msgr2=0x7f5bac0176c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:20.190 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete...2026-02-22T22:34:20.186+0000 7f5bd321e640 0 -- 10.20.193.41:0/3372215945 >> [v2:10.20.193.41:6802/4084981383,v1:10.20.193.41:6803/4084981383] conn(0x7f5bb403e460 msgr2=0x7f5bb4040870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:20.514 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:20.518 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm testimg 2026-02-22T22:34:20.555 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete...2026-02-22T22:34:20.550+0000 7f1efffff640 0 -- 10.20.193.41:0/576072216 >> [v2:10.20.193.41:6818/2868293051,v1:10.20.193.41:6819/2868293051] conn(0x5580aa514150 msgr2=0x5580aa516540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:20.557 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete...2026-02-22T22:34:20.554+0000 7f1efffff640 0 -- 10.20.193.41:0/576072216 >> [v2:10.20.193.41:6818/2868293051,v1:10.20.193.41:6819/2868293051] conn(0x7f1ee003e460 msgr2=0x7f1ee0040870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:20.574 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2026-02-22T22:34:20.577 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp /tmp/rbd_import_export_19636/img /tmp/rbd_import_export_19636/img2 2026-02-22T22:34:21.041 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp /tmp/rbd_import_export_19636/img /tmp/rbd_import_export_19636/img3 2026-02-22T22:34:21.398 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img2 /tmp/rbd_import_export_19636/img3 2026-02-22T22:34:21.590 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import - testimg 2026-02-22T22:34:21.619 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:21.618+0000 7efcd7f39080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:21.791 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:21.796 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export testimg /tmp/rbd_import_export_19636/img2 2026-02-22T22:34:21.894 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete...2026-02-22T22:34:21.890+0000 7f700e82f640 0 -- 10.20.193.41:0/2092953895 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x7f6fe80115a0 msgr2=0x7f6fe8013990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2026-02-22T22:34:21.909 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete...2026-02-22T22:34:21.906+0000 7f700e82f640 0 -- 10.20.193.41:0/2092953895 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x7f6ff003e460 msgr2=0x7f6ff0040870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:21.970 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:21.976 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export testimg - 2026-02-22T22:34:22.265 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete...2026-02-22T22:34:22.262+0000 7fbd2d8b6640 0 -- 10.20.193.41:0/609268959 >> [v2:10.20.193.41:6802/4084981383,v1:10.20.193.41:6803/4084981383] conn(0x7fbd100129b0 msgr2=0x7fbd10014da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:22.321 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete...2026-02-22T22:34:22.318+0000 7fbd2e0b7640 0 -- 10.20.193.41:0/609268959 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x7fbd04005410 msgr2=0x7fbd040078b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:22.652 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:22.657 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm testimg 2026-02-22T22:34:22.692 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete...2026-02-22T22:34:22.690+0000 7f055a9fd640 0 -- 10.20.193.41:0/4147462504 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x561bb335f020 msgr2=0x561bb33771f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2026-02-22T22:34:22.695 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete...2026-02-22T22:34:22.694+0000 7f055a9fd640 0 -- 10.20.193.41:0/4147462504 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x7f053803e460 msgr2=0x7f0538040870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:22.711 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2026-02-22T22:34:22.714 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp /tmp/rbd_import_export_19636/img /tmp/rbd_import_export_19636/img2 2026-02-22T22:34:23.173 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp /tmp/rbd_import_export_19636/img /tmp/rbd_import_export_19636/img3 2026-02-22T22:34:23.530 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img /tmp/rbd_import_export_19636/img2 /tmp/rbd_import_export_19636/img3 2026-02-22T22:34:23.778 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd help export 2026-02-22T22:34:23.778 INFO:tasks.workunit.client.0.trial041.stderr:+ grep -q export-format 2026-02-22T22:34:23.801 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/bin/dd of=/tmp/rbd_import_export_19636/img bs=1k count=10 seek=100 2026-02-22T22:34:23.802 INFO:tasks.workunit.client.0.trial041.stderr:10+0 records in 2026-02-22T22:34:23.802 INFO:tasks.workunit.client.0.trial041.stderr:10+0 records out 2026-02-22T22:34:23.802 INFO:tasks.workunit.client.0.trial041.stderr:10240 bytes (10 kB, 10 KiB) copied, 9.0879e-05 s, 113 MB/s 2026-02-22T22:34:23.803 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import /tmp/rbd_import_export_19636/img testimg 2026-02-22T22:34:24.031 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:24.030+0000 7fab8f28e080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:24.041 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:24.045 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap create testimg@snap 2026-02-22T22:34:24.267 INFO:tasks.workunit.client.0.trial041.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2026-02-22T22:34:24.272 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd image-meta set testimg key1 value1 2026-02-22T22:34:24.298 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd image-meta list testimg 2026-02-22T22:34:24.334 INFO:tasks.workunit.client.0.trial041.stderr:+ IMAGEMETA_BEFORE=There is 1 metadatum on this image: 2026-02-22T22:34:24.334 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:24.334 INFO:tasks.workunit.client.0.trial041.stderr:Key Value 2026-02-22T22:34:24.334 INFO:tasks.workunit.client.0.trial041.stderr:key1 value1 2026-02-22T22:34:24.334 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:24.357 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:24.360 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_19636/img_v2 testimg_import 2026-02-22T22:34:25.275 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 50% complete... Importing image: 100% complete... Importing image: 100% complete...done. 2026-02-22T22:34:25.279 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import 2026-02-22T22:34:25.302 INFO:tasks.workunit.client.0.trial041.stdout:rbd image 'testimg_import': 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: size 110 KiB in 1 objects 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: order 22 (4 MiB objects) 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: snapshot_count: 1 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: id: 1095efb9e4c0 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: block_name_prefix: rbd_data.1095efb9e4c0 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: format: 2 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: features: 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: op_features: 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: flags: 2026-02-22T22:34:25.303 INFO:tasks.workunit.client.0.trial041.stdout: create_timestamp: Sun Feb 22 22:34:24 2026 2026-02-22T22:34:25.304 INFO:tasks.workunit.client.0.trial041.stdout: access_timestamp: Sun Feb 22 22:34:24 2026 2026-02-22T22:34:25.304 INFO:tasks.workunit.client.0.trial041.stdout: modify_timestamp: Sun Feb 22 22:34:24 2026 2026-02-22T22:34:25.305 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import@snap 2026-02-22T22:34:25.334 INFO:tasks.workunit.client.0.trial041.stdout:rbd image 'testimg_import': 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: size 110 KiB in 1 objects 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: order 22 (4 MiB objects) 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: snapshot_count: 1 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: id: 1095efb9e4c0 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: block_name_prefix: rbd_data.1095efb9e4c0 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: format: 2 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: features: 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: op_features: 2026-02-22T22:34:25.335 INFO:tasks.workunit.client.0.trial041.stdout: flags: 2026-02-22T22:34:25.336 INFO:tasks.workunit.client.0.trial041.stdout: create_timestamp: Sun Feb 22 22:34:24 2026 2026-02-22T22:34:25.336 INFO:tasks.workunit.client.0.trial041.stdout: access_timestamp: Sun Feb 22 22:34:24 2026 2026-02-22T22:34:25.336 INFO:tasks.workunit.client.0.trial041.stdout: modify_timestamp: Sun Feb 22 22:34:24 2026 2026-02-22T22:34:25.336 INFO:tasks.workunit.client.0.trial041.stdout: protected: False 2026-02-22T22:34:25.338 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd image-meta list testimg_import 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr:+ IMAGEMETA_AFTER=There is 1 metadatum on this image: 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr:Key Value 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr:key1 value1 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr:+ [ There is 1 metadatum on this image: 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr:Key Value 2026-02-22T22:34:25.374 INFO:tasks.workunit.client.0.trial041.stderr:key1 value1 = There is 1 metadatum on this image: 2026-02-22T22:34:25.375 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:25.375 INFO:tasks.workunit.client.0.trial041.stderr:Key Value 2026-02-22T22:34:25.375 INFO:tasks.workunit.client.0.trial041.stderr:key1 value1 ] 2026-02-22T22:34:25.375 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export testimg_import /tmp/rbd_import_export_19636/img_import 2026-02-22T22:34:25.405 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete...done. 2026-02-22T22:34:25.409 INFO:tasks.workunit.client.0.trial041.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_19636/img /tmp/rbd_import_export_19636/img_import 2026-02-22T22:34:25.409 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp -l /tmp/rbd_import_export_19636/img /tmp/rbd_import_export_19636/img_import 2026-02-22T22:34:25.410 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/img --format %b 2026-02-22T22:34:25.411 INFO:tasks.workunit.client.0.trial041.stderr:+ origsize=24 2026-02-22T22:34:25.411 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/img_import --format %b 2026-02-22T22:34:25.412 INFO:tasks.workunit.client.0.trial041.stderr:+ exportsize=224 2026-02-22T22:34:25.412 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=200 2026-02-22T22:34:25.412 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=200 2026-02-22T22:34:25.412 INFO:tasks.workunit.client.0.trial041.stderr:+ test 200 -ge 0 -a 200 -lt 4096 2026-02-22T22:34:25.412 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export testimg@snap /tmp/rbd_import_export_19636/img_snap 2026-02-22T22:34:25.435 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete...done. 2026-02-22T22:34:25.437 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export testimg_import@snap /tmp/rbd_import_export_19636/img_snap_import 2026-02-22T22:34:25.467 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete...done. 2026-02-22T22:34:25.471 INFO:tasks.workunit.client.0.trial041.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_19636/img_snap /tmp/rbd_import_export_19636/img_snap_import 2026-02-22T22:34:25.471 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp -l /tmp/rbd_import_export_19636/img_snap /tmp/rbd_import_export_19636/img_snap_import 2026-02-22T22:34:25.472 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/img_snap --format %b 2026-02-22T22:34:25.473 INFO:tasks.workunit.client.0.trial041.stderr:+ origsize=224 2026-02-22T22:34:25.473 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/img_snap_import --format %b 2026-02-22T22:34:25.474 INFO:tasks.workunit.client.0.trial041.stderr:+ exportsize=224 2026-02-22T22:34:25.475 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:25.475 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:25.475 INFO:tasks.workunit.client.0.trial041.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2026-02-22T22:34:25.475 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:25.475 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img_import 2026-02-22T22:34:25.476 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img_snap 2026-02-22T22:34:25.476 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img_snap_import 2026-02-22T22:34:25.477 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap rm testimg_import@snap 2026-02-22T22:34:26.273 INFO:tasks.workunit.client.0.trial041.stderr: Removing snap: 100% complete...done. 2026-02-22T22:34:26.278 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg_import 2026-02-22T22:34:26.324 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:26.328 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap rm testimg@snap 2026-02-22T22:34:27.277 INFO:tasks.workunit.client.0.trial041.stderr: Removing snap: 100% complete...done. 2026-02-22T22:34:27.282 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm testimg 2026-02-22T22:34:27.307 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:27.309 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --order 20 /tmp/rbd_import_export_19636/img testimg 2026-02-22T22:34:27.335 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:27.334+0000 7f7b60d72080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:27.342 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:27.343 INFO:tasks.workunit.client.0.trial041.stderr:rbd: --order is deprecated, use --object-size 2026-02-22T22:34:27.345 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:27.372 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:27.376 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_19636/img_v2 testimg_import 2026-02-22T22:34:27.418 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete... Importing image: 100% complete...done. 2026-02-22T22:34:27.423 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import 2026-02-22T22:34:27.423 INFO:tasks.workunit.client.0.trial041.stderr:+ grep order 2026-02-22T22:34:27.423 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $2} 2026-02-22T22:34:27.423 INFO:tasks.workunit.client.0.trial041.stderr:+ grep 20 2026-02-22T22:34:27.454 INFO:tasks.workunit.client.0.trial041.stdout:20 2026-02-22T22:34:27.454 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:27.455 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg_import 2026-02-22T22:34:27.510 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:27.513 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg 2026-02-22T22:34:27.543 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:27.547 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --image-feature layering /tmp/rbd_import_export_19636/img testimg 2026-02-22T22:34:27.585 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:27.589 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg 2026-02-22T22:34:27.590 INFO:tasks.workunit.client.0.trial041.stderr:+ grep features 2026-02-22T22:34:27.615 INFO:tasks.workunit.client.0.trial041.stderr:+ FEATURES_BEFORE= features: layering 2026-02-22T22:34:27.616 INFO:tasks.workunit.client.0.trial041.stderr: op_features: 2026-02-22T22:34:27.616 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:27.643 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:27.645 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_19636/img_v2 testimg_import 2026-02-22T22:34:27.687 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete... Importing image: 100% complete...done. 2026-02-22T22:34:27.691 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import 2026-02-22T22:34:27.692 INFO:tasks.workunit.client.0.trial041.stderr:+ grep features 2026-02-22T22:34:27.717 INFO:tasks.workunit.client.0.trial041.stderr:+ FEATURES_AFTER= features: layering 2026-02-22T22:34:27.718 INFO:tasks.workunit.client.0.trial041.stderr: op_features: 2026-02-22T22:34:27.718 INFO:tasks.workunit.client.0.trial041.stderr:+ [ features: layering 2026-02-22T22:34:27.718 INFO:tasks.workunit.client.0.trial041.stderr: op_features: != features: layering 2026-02-22T22:34:27.718 INFO:tasks.workunit.client.0.trial041.stderr: op_features: ] 2026-02-22T22:34:27.718 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:27.718 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg_import 2026-02-22T22:34:27.770 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:27.774 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg 2026-02-22T22:34:27.823 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:27.827 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --stripe-count 1000 --stripe-unit 4096 /tmp/rbd_import_export_19636/img testimg 2026-02-22T22:34:27.867 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:27.870 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:27.902 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:27.905 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_19636/img_v2 testimg_import 2026-02-22T22:34:27.952 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete... Importing image: 100% complete...done. 2026-02-22T22:34:27.955 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import 2026-02-22T22:34:27.955 INFO:tasks.workunit.client.0.trial041.stderr:+ grep stripe unit 2026-02-22T22:34:27.956 INFO:tasks.workunit.client.0.trial041.stderr:+ grep -Ei (4 KiB|4096) 2026-02-22T22:34:27.979 INFO:tasks.workunit.client.0.trial041.stdout: stripe unit: 4 KiB 2026-02-22T22:34:27.980 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import 2026-02-22T22:34:27.980 INFO:tasks.workunit.client.0.trial041.stderr:+ grep stripe count 2026-02-22T22:34:27.980 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $3} 2026-02-22T22:34:27.981 INFO:tasks.workunit.client.0.trial041.stderr:+ grep 1000 2026-02-22T22:34:28.008 INFO:tasks.workunit.client.0.trial041.stdout:1000 2026-02-22T22:34:28.008 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/img_v2 2026-02-22T22:34:28.008 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg_import 2026-02-22T22:34:28.068 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 3% complete... Removing image: 7% complete... Removing image: 10% complete... Removing image: 14% complete... Removing image: 17% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 32% complete... Removing image: 35% complete... Removing image: 39% complete... Removing image: 42% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 57% complete... Removing image: 60% complete... Removing image: 64% complete... Removing image: 67% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 82% complete... Removing image: 85% complete... Removing image: 89% complete... Removing image: 92% complete... Removing image: 96% complete...2026-02-22T22:34:28.066+0000 7fe7bfce7640 0 -- 10.20.193.41:0/3178284310 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x562531664020 msgr2=0x56253167c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:28.074 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:28.078 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg 2026-02-22T22:34:28.133 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 3% complete... Removing image: 7% complete... Removing image: 10% complete... Removing image: 14% complete... Removing image: 17% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 32% complete... Removing image: 35% complete... Removing image: 39% complete... Removing image: 42% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 57% complete... Removing image: 60% complete... Removing image: 64% complete... Removing image: 67% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 82% complete... Removing image: 85% complete... Removing image: 89% complete... Removing image: 92% complete... Removing image: 96% complete...2026-02-22T22:34:28.130+0000 7f6c8beb9640 0 -- 10.20.193.41:0/2174280968 >> [v2:10.20.193.41:6804/577187467,v1:10.20.193.41:6807/577187467] conn(0x5616d0237340 msgr2=0x5616d024efc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:28.139 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:28.144 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --image-format=2 /tmp/rbd_import_export_19636/img testimg 2026-02-22T22:34:28.179 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:28.183 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap create testimg@snap1 2026-02-22T22:34:28.250 INFO:tasks.workunit.client.0.trial041.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2026-02-22T22:34:28.257 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap create testimg@snap2 2026-02-22T22:34:29.282 INFO:tasks.workunit.client.0.trial041.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2026-02-22T22:34:29.289 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap protect testimg@snap2 2026-02-22T22:34:29.319 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export --export-format 2 testimg /tmp/rbd_import_export_19636/snap_protect 2026-02-22T22:34:29.351 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 33% complete... Exporting image: 100% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:29.355 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --export-format 2 /tmp/rbd_import_export_19636/snap_protect testimg_import 2026-02-22T22:34:31.293 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 33% complete... Importing image: 66% complete... Importing image: 100% complete...2026-02-22T22:34:31.290+0000 7f125ffff640 0 -- 10.20.193.41:0/3466785775 >> [v2:10.20.193.41:6818/2868293051,v1:10.20.193.41:6819/2868293051] conn(0x7f124c006880 msgr2=0x7f124c006d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2026-02-22T22:34:31.295 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:31.300 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import@snap1 2026-02-22T22:34:31.300 INFO:tasks.workunit.client.0.trial041.stderr:+ grep protected: False 2026-02-22T22:34:31.326 INFO:tasks.workunit.client.0.trial041.stdout: protected: False 2026-02-22T22:34:31.327 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info testimg_import@snap2 2026-02-22T22:34:31.327 INFO:tasks.workunit.client.0.trial041.stderr:+ grep protected: True 2026-02-22T22:34:31.358 INFO:tasks.workunit.client.0.trial041.stdout: protected: True 2026-02-22T22:34:31.358 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/snap_protect 2026-02-22T22:34:31.358 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap unprotect testimg@snap2 2026-02-22T22:34:31.391 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap unprotect testimg_import@snap2 2026-02-22T22:34:31.428 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap purge testimg 2026-02-22T22:34:33.247 INFO:tasks.workunit.client.0.trial041.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2026-02-22T22:34:33.256 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd snap purge testimg_import 2026-02-22T22:34:35.289 INFO:tasks.workunit.client.0.trial041.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2026-02-22T22:34:35.296 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg 2026-02-22T22:34:35.355 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:35.354+0000 7fa563fff640 0 -- 10.20.193.41:0/287195025 >> [v2:10.20.193.41:6818/2868293051,v1:10.20.193.41:6819/2868293051] conn(0x7fa540008d30 msgr2=0x7fa54000b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:35.360 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:35.364 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd remove testimg_import 2026-02-22T22:34:35.426 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:35.422+0000 7fe3f7fff640 0 -- 10.20.193.41:0/3866443765 >> [v2:10.20.193.41:6818/2868293051,v1:10.20.193.41:6819/2868293051] conn(0x7fe3d4008d30 msgr2=0x7fe3d400b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2026-02-22T22:34:35.431 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:35.436 INFO:tasks.workunit.client.0.trial041.stderr:+ tiered=0 2026-02-22T22:34:35.436 INFO:tasks.workunit.client.0.trial041.stderr:+ ceph osd dump 2026-02-22T22:34:35.436 INFO:tasks.workunit.client.0.trial041.stderr:+ grep ^pool 2026-02-22T22:34:35.436 INFO:tasks.workunit.client.0.trial041.stderr:+ grep 'rbd' 2026-02-22T22:34:35.436 INFO:tasks.workunit.client.0.trial041.stderr:+ grep tier 2026-02-22T22:34:35.634 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/dev/urandom bs=1M seek=1 count=1 of=/tmp/rbd_import_export_19636/sparse1 2026-02-22T22:34:35.638 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records in 2026-02-22T22:34:35.638 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records out 2026-02-22T22:34:35.638 INFO:tasks.workunit.client.0.trial041.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00342688 s, 306 MB/s 2026-02-22T22:34:35.638 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/dev/urandom bs=1M count=1 of=/tmp/rbd_import_export_19636/sparse2 2026-02-22T22:34:35.642 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records in 2026-02-22T22:34:35.642 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records out 2026-02-22T22:34:35.642 INFO:tasks.workunit.client.0.trial041.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00411072 s, 255 MB/s 2026-02-22T22:34:35.642 INFO:tasks.workunit.client.0.trial041.stderr:+ truncate /tmp/rbd_import_export_19636/sparse2 -s 2M 2026-02-22T22:34:35.644 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse1 2026-02-22T22:34:35.676 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 0% complete...failed. 2026-02-22T22:34:35.676 INFO:tasks.workunit.client.0.trial041.stderr:rbd: delete error: (2) No such file or directory 2026-02-22T22:34:35.679 INFO:tasks.workunit.client.0.trial041.stderr:+ true 2026-02-22T22:34:35.680 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --order 20 /tmp/rbd_import_export_19636/sparse1 2026-02-22T22:34:35.706 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:35.702+0000 7f044bf47080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:35.718 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 50% complete... Importing image: 100% complete...done. 2026-02-22T22:34:35.718 INFO:tasks.workunit.client.0.trial041.stderr:rbd: --order is deprecated, use --object-size 2026-02-22T22:34:35.722 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd ls -l 2026-02-22T22:34:35.722 INFO:tasks.workunit.client.0.trial041.stderr:+ grep sparse1 2026-02-22T22:34:35.722 INFO:tasks.workunit.client.0.trial041.stderr:+ grep -Ei (2 MiB|2048k) 2026-02-22T22:34:35.754 INFO:tasks.workunit.client.0.trial041.stdout:sparse1 2 MiB 1 2026-02-22T22:34:35.756 INFO:tasks.workunit.client.0.trial041.stderr:+ objects sparse1 2026-02-22T22:34:35.756 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse1 2026-02-22T22:34:35.756 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse1 2026-02-22T22:34:35.756 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:35.756 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:35.779 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.1121.14fce74e 2026-02-22T22:34:35.781 INFO:tasks.workunit.client.0.trial041.stderr:+ grep rb.0.1121.14fce74e 2026-02-22T22:34:35.781 INFO:tasks.workunit.client.0.trial041.stderr:+ get_image_data_pool sparse1 2026-02-22T22:34:35.781 INFO:tasks.workunit.client.0.trial041.stderr:+ + image=sparse1 2026-02-22T22:34:35.781 INFO:tasks.workunit.client.0.trial041.stderr:sed -e s/rb.0.1121.14fce74e\.// -e s/^0*\([0-9a-f]\)/\1/ 2026-02-22T22:34:35.781 INFO:tasks.workunit.client.0.trial041.stderr:+ sort -u 2026-02-22T22:34:35.781 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse1 2026-02-22T22:34:35.781 INFO:tasks.workunit.client.0.trial041.stderr:+ grep data_pool: 2026-02-22T22:34:35.782 INFO:tasks.workunit.client.0.trial041.stderr:+ awk -F: { print $NF } 2026-02-22T22:34:35.804 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:35.804 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:35.804 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:35.804 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:35.804 INFO:tasks.workunit.client.0.trial041.stderr:+ rados ls -p rbd 2026-02-22T22:34:35.827 INFO:tasks.workunit.client.0.trial041.stderr:+ objects=1 2026-02-22T22:34:35.827 INFO:tasks.workunit.client.0.trial041.stderr:+ echo 1 2026-02-22T22:34:35.827 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 -eq 1 -o 1 = 1 ] 2026-02-22T22:34:35.827 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export sparse1 /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:35.851 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:35.854 INFO:tasks.workunit.client.0.trial041.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_19636/sparse1 /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:35.854 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp -l /tmp/rbd_import_export_19636/sparse1 /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:35.856 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse1 --format %b 2026-02-22T22:34:35.857 INFO:tasks.workunit.client.0.trial041.stderr:+ origsize=2048 2026-02-22T22:34:35.857 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse1.out --format %b 2026-02-22T22:34:35.858 INFO:tasks.workunit.client.0.trial041.stderr:+ exportsize=2048 2026-02-22T22:34:35.858 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:35.858 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:35.858 INFO:tasks.workunit.client.0.trial041.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2026-02-22T22:34:35.858 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:35.859 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse1 2026-02-22T22:34:35.891 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 50% complete... Removing image: 100% complete...done. 2026-02-22T22:34:35.894 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse2 2026-02-22T22:34:35.927 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 0% complete...failed. 2026-02-22T22:34:35.927 INFO:tasks.workunit.client.0.trial041.stderr:rbd: delete error: (2) No such file or directory 2026-02-22T22:34:35.930 INFO:tasks.workunit.client.0.trial041.stderr:+ true 2026-02-22T22:34:35.930 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --order 20 /tmp/rbd_import_export_19636/sparse2 2026-02-22T22:34:35.955 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:35.954+0000 7f263819f080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:35.965 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 50% complete... Importing image: 100% complete...done. 2026-02-22T22:34:35.966 INFO:tasks.workunit.client.0.trial041.stderr:rbd: --order is deprecated, use --object-size 2026-02-22T22:34:35.970 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd ls -l 2026-02-22T22:34:35.970 INFO:tasks.workunit.client.0.trial041.stderr:+ grep sparse2 2026-02-22T22:34:35.970 INFO:tasks.workunit.client.0.trial041.stderr:+ grep -Ei (2 MiB|2048k) 2026-02-22T22:34:36.001 INFO:tasks.workunit.client.0.trial041.stdout:sparse2 2 MiB 1 2026-02-22T22:34:36.002 INFO:tasks.workunit.client.0.trial041.stderr:+ objects sparse2 2026-02-22T22:34:36.003 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse2 2026-02-22T22:34:36.003 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse2 2026-02-22T22:34:36.003 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:36.003 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:36.024 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.113a.53299938 2026-02-22T22:34:36.026 INFO:tasks.workunit.client.0.trial041.stderr:+ grep rb.0.113a.53299938 2026-02-22T22:34:36.026 INFO:tasks.workunit.client.0.trial041.stderr:+ + sed -e s/rb.0.113a.53299938\.// -e s/^0*\([0-9a-f]\)/\1/ 2026-02-22T22:34:36.026 INFO:tasks.workunit.client.0.trial041.stderr:get_image_data_pool sparse2 2026-02-22T22:34:36.026 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse2 2026-02-22T22:34:36.027 INFO:tasks.workunit.client.0.trial041.stderr:+ sort -u 2026-02-22T22:34:36.027 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse2 2026-02-22T22:34:36.027 INFO:tasks.workunit.client.0.trial041.stderr:+ + grepawk data_pool: -F: 2026-02-22T22:34:36.027 INFO:tasks.workunit.client.0.trial041.stderr: { print $NF } 2026-02-22T22:34:36.052 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:36.053 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:36.053 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:36.053 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:36.053 INFO:tasks.workunit.client.0.trial041.stderr:+ rados ls -p rbd 2026-02-22T22:34:36.075 INFO:tasks.workunit.client.0.trial041.stderr:+ objects=0 2026-02-22T22:34:36.075 INFO:tasks.workunit.client.0.trial041.stderr:+ echo 0 2026-02-22T22:34:36.076 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 -eq 1 -o 0 = 0 ] 2026-02-22T22:34:36.076 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export sparse2 /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.100 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 50% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:36.103 INFO:tasks.workunit.client.0.trial041.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_19636/sparse2 /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.103 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp -l /tmp/rbd_import_export_19636/sparse2 /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.104 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse2 --format %b 2026-02-22T22:34:36.106 INFO:tasks.workunit.client.0.trial041.stderr:+ origsize=2048 2026-02-22T22:34:36.106 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse2.out --format %b 2026-02-22T22:34:36.107 INFO:tasks.workunit.client.0.trial041.stderr:+ exportsize=2048 2026-02-22T22:34:36.107 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:36.107 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:36.107 INFO:tasks.workunit.client.0.trial041.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2026-02-22T22:34:36.107 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.108 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse2 2026-02-22T22:34:36.141 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 50% complete... Removing image: 100% complete...done. 2026-02-22T22:34:36.144 INFO:tasks.workunit.client.0.trial041.stderr:+ truncate /tmp/rbd_import_export_19636/sparse1 -s 10M 2026-02-22T22:34:36.145 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --order 20 - sparse1 2026-02-22T22:34:36.169 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:36.166+0000 7f96d06d2080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:36.192 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:36.193 INFO:tasks.workunit.client.0.trial041.stderr:rbd: --order is deprecated, use --object-size 2026-02-22T22:34:36.197 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd ls -l 2026-02-22T22:34:36.197 INFO:tasks.workunit.client.0.trial041.stderr:+ grep sparse1 2026-02-22T22:34:36.197 INFO:tasks.workunit.client.0.trial041.stderr:+ grep -Ei (10 MiB|10240k) 2026-02-22T22:34:36.228 INFO:tasks.workunit.client.0.trial041.stdout:sparse1 10 MiB 1 2026-02-22T22:34:36.229 INFO:tasks.workunit.client.0.trial041.stderr:+ objects sparse1 2026-02-22T22:34:36.229 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse1 2026-02-22T22:34:36.229 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse1 2026-02-22T22:34:36.229 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:36.229 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:36.252 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.1150.1fbfe8e0 2026-02-22T22:34:36.254 INFO:tasks.workunit.client.0.trial041.stderr:+ grep rb.0.1150.1fbfe8e0 2026-02-22T22:34:36.255 INFO:tasks.workunit.client.0.trial041.stderr:+ sed -e s/rb.0.1150.1fbfe8e0\.// -e s/^0*\([0-9a-f]\)/\1/ 2026-02-22T22:34:36.255 INFO:tasks.workunit.client.0.trial041.stderr:+ get_image_data_pool sparse1 2026-02-22T22:34:36.255 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse1 2026-02-22T22:34:36.255 INFO:tasks.workunit.client.0.trial041.stderr:+ sort -u 2026-02-22T22:34:36.255 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse1 2026-02-22T22:34:36.255 INFO:tasks.workunit.client.0.trial041.stderr:+ grep data_pool: 2026-02-22T22:34:36.255 INFO:tasks.workunit.client.0.trial041.stderr:+ awk -F: { print $NF } 2026-02-22T22:34:36.275 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:36.276 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:36.276 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:36.276 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:36.276 INFO:tasks.workunit.client.0.trial041.stderr:+ rados ls -p rbd 2026-02-22T22:34:36.302 INFO:tasks.workunit.client.0.trial041.stderr:+ objects=1 2026-02-22T22:34:36.302 INFO:tasks.workunit.client.0.trial041.stderr:+ echo 1 2026-02-22T22:34:36.302 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 -eq 1 -o 1 = 1 ] 2026-02-22T22:34:36.302 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export sparse1 /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:36.326 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 10% complete... Exporting image: 20% complete... Exporting image: 30% complete... Exporting image: 40% complete... Exporting image: 50% complete... Exporting image: 60% complete... Exporting image: 70% complete... Exporting image: 80% complete... Exporting image: 90% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:36.330 INFO:tasks.workunit.client.0.trial041.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_19636/sparse1 /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:36.330 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp -l /tmp/rbd_import_export_19636/sparse1 /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:36.339 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse1 --format %b 2026-02-22T22:34:36.340 INFO:tasks.workunit.client.0.trial041.stderr:+ origsize=2048 2026-02-22T22:34:36.340 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse1.out --format %b 2026-02-22T22:34:36.341 INFO:tasks.workunit.client.0.trial041.stderr:+ exportsize=2048 2026-02-22T22:34:36.341 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:36.341 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:36.341 INFO:tasks.workunit.client.0.trial041.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2026-02-22T22:34:36.342 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/sparse1.out 2026-02-22T22:34:36.343 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse1 2026-02-22T22:34:36.375 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 10% complete... Removing image: 20% complete... Removing image: 30% complete... Removing image: 40% complete... Removing image: 50% complete... Removing image: 60% complete... Removing image: 70% complete... Removing image: 80% complete... Removing image: 90% complete... Removing image: 100% complete...done. 2026-02-22T22:34:36.377 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/dev/urandom bs=2M count=1 of=/tmp/rbd_import_export_19636/sparse2 oflag=append conv=notrunc 2026-02-22T22:34:36.387 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records in 2026-02-22T22:34:36.387 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records out 2026-02-22T22:34:36.388 INFO:tasks.workunit.client.0.trial041.stderr:2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.00928275 s, 226 MB/s 2026-02-22T22:34:36.388 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --order 20 - sparse2 2026-02-22T22:34:36.414 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:36.410+0000 7f847e74c080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:36.433 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:36.433 INFO:tasks.workunit.client.0.trial041.stderr:rbd: --order is deprecated, use --object-size 2026-02-22T22:34:36.437 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd ls -l 2026-02-22T22:34:36.437 INFO:tasks.workunit.client.0.trial041.stderr:+ grep sparse2 2026-02-22T22:34:36.437 INFO:tasks.workunit.client.0.trial041.stderr:+ grep -Ei (4 MiB|4096k) 2026-02-22T22:34:36.463 INFO:tasks.workunit.client.0.trial041.stdout:sparse2 4 MiB 1 2026-02-22T22:34:36.465 INFO:tasks.workunit.client.0.trial041.stderr:+ objects sparse2 2026-02-22T22:34:36.465 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse2 2026-02-22T22:34:36.465 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse2 2026-02-22T22:34:36.465 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:36.465 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:36.488 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.1166.3fa62aca 2026-02-22T22:34:36.489 INFO:tasks.workunit.client.0.trial041.stderr:+ grep rb.0.1166.3fa62aca 2026-02-22T22:34:36.489 INFO:tasks.workunit.client.0.trial041.stderr:+ sed -e s/rb.0.1166.3fa62aca\.// -e+ s/^0*\([0-9a-f]\)/\1/ 2026-02-22T22:34:36.489 INFO:tasks.workunit.client.0.trial041.stderr:get_image_data_pool sparse2 2026-02-22T22:34:36.490 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse2 2026-02-22T22:34:36.490 INFO:tasks.workunit.client.0.trial041.stderr:+ sort -u 2026-02-22T22:34:36.490 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse2 2026-02-22T22:34:36.490 INFO:tasks.workunit.client.0.trial041.stderr:+ grep data_pool: 2026-02-22T22:34:36.490 INFO:tasks.workunit.client.0.trial041.stderr:+ awk -F: { print $NF } 2026-02-22T22:34:36.512 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:36.512 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:36.512 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:36.512 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:36.512 INFO:tasks.workunit.client.0.trial041.stderr:+ rados ls -p rbd 2026-02-22T22:34:36.534 INFO:tasks.workunit.client.0.trial041.stderr:+ objects=0 2026-02-22T22:34:36.535 INFO:tasks.workunit.client.0.trial041.stderr:2 2026-02-22T22:34:36.535 INFO:tasks.workunit.client.0.trial041.stderr:3 2026-02-22T22:34:36.535 INFO:tasks.workunit.client.0.trial041.stderr:+ echo 0 2 3 2026-02-22T22:34:36.535 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 -eq 1 -o 0 2 3 = 0 2 3 ] 2026-02-22T22:34:36.535 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export sparse2 /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.567 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 25% complete... Exporting image: 50% complete... Exporting image: 75% complete... Exporting image: 100% complete...done. 2026-02-22T22:34:36.571 INFO:tasks.workunit.client.0.trial041.stderr:+ compare_files_and_ondisk_sizes /tmp/rbd_import_export_19636/sparse2 /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.571 INFO:tasks.workunit.client.0.trial041.stderr:+ cmp -l /tmp/rbd_import_export_19636/sparse2 /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.575 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse2 --format %b 2026-02-22T22:34:36.576 INFO:tasks.workunit.client.0.trial041.stderr:+ origsize=6144 2026-02-22T22:34:36.576 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse2.out --format %b 2026-02-22T22:34:36.577 INFO:tasks.workunit.client.0.trial041.stderr:+ exportsize=6144 2026-02-22T22:34:36.577 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:36.578 INFO:tasks.workunit.client.0.trial041.stderr:+ difference=0 2026-02-22T22:34:36.578 INFO:tasks.workunit.client.0.trial041.stderr:+ test 0 -ge 0 -a 0 -lt 4096 2026-02-22T22:34:36.578 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/sparse2.out 2026-02-22T22:34:36.579 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse2 2026-02-22T22:34:36.612 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 25% complete... Removing image: 50% complete... Removing image: 75% complete... Removing image: 100% complete...done. 2026-02-22T22:34:36.616 INFO:tasks.workunit.client.0.trial041.stderr:+ echo partially-sparse file imports to partially-sparse image 2026-02-22T22:34:36.616 INFO:tasks.workunit.client.0.trial041.stdout:partially-sparse file imports to partially-sparse image 2026-02-22T22:34:36.616 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import --order 20 /tmp/rbd_import_export_19636/sparse1 sparse 2026-02-22T22:34:36.641 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:36.638+0000 7fd024005080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:36.651 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 10% complete... Importing image: 20% complete... Importing image: 30% complete... Importing image: 40% complete... Importing image: 50% complete... Importing image: 60% complete... Importing image: 70% complete... Importing image: 80% complete... Importing image: 90% complete... Importing image: 100% complete...done. 2026-02-22T22:34:36.652 INFO:tasks.workunit.client.0.trial041.stderr:rbd: --order is deprecated, use --object-size 2026-02-22T22:34:36.655 INFO:tasks.workunit.client.0.trial041.stderr:+ objects sparse 2026-02-22T22:34:36.655 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse 2026-02-22T22:34:36.655 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:36.655 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:36.656 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:36.677 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.117c.cc1016f 2026-02-22T22:34:36.678 INFO:tasks.workunit.client.0.trial041.stderr:+ grep rb.0.117c.cc1016f 2026-02-22T22:34:36.679 INFO:tasks.workunit.client.0.trial041.stderr:+ get_image_data_pool sparse 2026-02-22T22:34:36.679 INFO:tasks.workunit.client.0.trial041.stderr:+ + image=sparse 2026-02-22T22:34:36.679 INFO:tasks.workunit.client.0.trial041.stderr:sed -e s/rb.0.117c.cc1016f\.// -e s/^0*\([0-9a-f]\)/\1/ 2026-02-22T22:34:36.679 INFO:tasks.workunit.client.0.trial041.stderr:+ sort -u 2026-02-22T22:34:36.679 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:36.679 INFO:tasks.workunit.client.0.trial041.stderr:+ + grep data_pool: 2026-02-22T22:34:36.679 INFO:tasks.workunit.client.0.trial041.stderr:awk -F: { print $NF } 2026-02-22T22:34:36.702 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:36.702 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:36.702 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:36.703 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:36.703 INFO:tasks.workunit.client.0.trial041.stderr:+ rados ls -p rbd 2026-02-22T22:34:36.723 INFO:tasks.workunit.client.0.trial041.stderr:+ objects=1 2026-02-22T22:34:36.723 INFO:tasks.workunit.client.0.trial041.stderr:+ echo 1 2026-02-22T22:34:36.723 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 -eq 1 -o 1 = 1 ] 2026-02-22T22:34:36.723 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse 2026-02-22T22:34:36.751 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 10% complete... Removing image: 20% complete... Removing image: 30% complete... Removing image: 40% complete... Removing image: 50% complete... Removing image: 60% complete... Removing image: 70% complete... Removing image: 80% complete... Removing image: 90% complete... Removing image: 100% complete...done. 2026-02-22T22:34:36.753 INFO:tasks.workunit.client.0.trial041.stderr:+ echo zeros import through stdin to sparse image 2026-02-22T22:34:36.753 INFO:tasks.workunit.client.0.trial041.stdout:zeros import through stdin to sparse image 2026-02-22T22:34:36.754 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/dev/zero bs=1M count=4 2026-02-22T22:34:36.754 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd import - sparse 2026-02-22T22:34:36.772 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:36.770+0000 7f42b4291080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:36.779 INFO:tasks.workunit.client.0.trial041.stderr:4+0 records in 2026-02-22T22:34:36.780 INFO:tasks.workunit.client.0.trial041.stderr:4+0 records out 2026-02-22T22:34:36.780 INFO:tasks.workunit.client.0.trial041.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0256807 s, 163 MB/s 2026-02-22T22:34:36.784 INFO:tasks.workunit.client.0.trial041.stderr: Importing image: 100% complete...done. 2026-02-22T22:34:36.787 INFO:tasks.workunit.client.0.trial041.stderr:+ objects sparse 2026-02-22T22:34:36.788 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse 2026-02-22T22:34:36.788 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:36.788 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:36.788 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:36.811 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.118c.14e17e33 2026-02-22T22:34:36.812 INFO:tasks.workunit.client.0.trial041.stderr:+ grep rb.0.118c.14e17e33 2026-02-22T22:34:36.813 INFO:tasks.workunit.client.0.trial041.stderr:+ + get_image_data_pool sparse 2026-02-22T22:34:36.813 INFO:tasks.workunit.client.0.trial041.stderr:+ sed -e s/rb.0.118c.14e17e33\.// -eimage=sparse s/^0*\([0-9a-f]\)/\1/ 2026-02-22T22:34:36.813 INFO:tasks.workunit.client.0.trial041.stderr: 2026-02-22T22:34:36.813 INFO:tasks.workunit.client.0.trial041.stderr:+ sort -u 2026-02-22T22:34:36.813 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:36.813 INFO:tasks.workunit.client.0.trial041.stderr:+ grep data_pool: 2026-02-22T22:34:36.813 INFO:tasks.workunit.client.0.trial041.stderr:+ awk -F: { print $NF } 2026-02-22T22:34:36.836 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:36.836 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:36.837 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:36.837 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:36.837 INFO:tasks.workunit.client.0.trial041.stderr:+ rados ls -p rbd 2026-02-22T22:34:36.866 INFO:tasks.workunit.client.0.trial041.stderr:+ objects= 2026-02-22T22:34:36.866 INFO:tasks.workunit.client.0.trial041.stderr:+ echo 2026-02-22T22:34:36.866 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 -eq 1 -o = ] 2026-02-22T22:34:36.866 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse 2026-02-22T22:34:36.889 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:36.891 INFO:tasks.workunit.client.0.trial041.stderr:+ echo zeros export to sparse file 2026-02-22T22:34:36.892 INFO:tasks.workunit.client.0.trial041.stdout:zeros export to sparse file 2026-02-22T22:34:36.892 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd create sparse --size 4 2026-02-22T22:34:36.915 INFO:tasks.workunit.client.0.trial041.stderr:2026-02-22T22:34:36.914+0000 7fbd67434080 -1 librbd: Forced V1 image creation. 2026-02-22T22:34:36.921 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:36.922 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:36.922 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:36.946 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.119c.2df6d648 2026-02-22T22:34:36.946 INFO:tasks.workunit.client.0.trial041.stderr:+ dd if=/dev/zero bs=4M count=1 2026-02-22T22:34:36.946 INFO:tasks.workunit.client.0.trial041.stderr:+ get_image_data_pool sparse 2026-02-22T22:34:36.946 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse 2026-02-22T22:34:36.946 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:36.946 INFO:tasks.workunit.client.0.trial041.stderr:+ grep data_pool: 2026-02-22T22:34:36.947 INFO:tasks.workunit.client.0.trial041.stderr:+ awk -F: { print $NF } 2026-02-22T22:34:36.968 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:36.968 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:36.968 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:36.968 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:36.968 INFO:tasks.workunit.client.0.trial041.stderr:+ rados -p rbd put rb.0.119c.2df6d648.000000000000 - 2026-02-22T22:34:36.988 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records in 2026-02-22T22:34:36.989 INFO:tasks.workunit.client.0.trial041.stderr:1+0 records out 2026-02-22T22:34:36.989 INFO:tasks.workunit.client.0.trial041.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0428323 s, 97.9 MB/s 2026-02-22T22:34:37.004 INFO:tasks.workunit.client.0.trial041.stderr:+ objects sparse 2026-02-22T22:34:37.004 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse 2026-02-22T22:34:37.004 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:37.004 INFO:tasks.workunit.client.0.trial041.stderr:+ grep block_name_prefix 2026-02-22T22:34:37.004 INFO:tasks.workunit.client.0.trial041.stderr:+ awk {print $NF;} 2026-02-22T22:34:37.028 INFO:tasks.workunit.client.0.trial041.stderr:+ prefix=rb.0.119c.2df6d648 2026-02-22T22:34:37.029 INFO:tasks.workunit.client.0.trial041.stderr:+ grep rb.0.119c.2df6d648 2026-02-22T22:34:37.029 INFO:tasks.workunit.client.0.trial041.stderr:+ + get_image_data_poolsed sparse -e 2026-02-22T22:34:37.030 INFO:tasks.workunit.client.0.trial041.stderr: s/rb.0.119c.2df6d648\.// -e s/^0*\([0-9a-f]\)/\1/ 2026-02-22T22:34:37.030 INFO:tasks.workunit.client.0.trial041.stderr:+ image=sparse 2026-02-22T22:34:37.030 INFO:tasks.workunit.client.0.trial041.stderr:+ sort -u 2026-02-22T22:34:37.030 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd info sparse 2026-02-22T22:34:37.030 INFO:tasks.workunit.client.0.trial041.stderr:+ grep data_pool: 2026-02-22T22:34:37.030 INFO:tasks.workunit.client.0.trial041.stderr:+ awk -F: { print $NF } 2026-02-22T22:34:37.061 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool= 2026-02-22T22:34:37.061 INFO:tasks.workunit.client.0.trial041.stderr:+ [ -z ] 2026-02-22T22:34:37.061 INFO:tasks.workunit.client.0.trial041.stderr:+ data_pool=rbd 2026-02-22T22:34:37.061 INFO:tasks.workunit.client.0.trial041.stderr:+ echo rbd 2026-02-22T22:34:37.061 INFO:tasks.workunit.client.0.trial041.stderr:+ rados ls -p rbd 2026-02-22T22:34:37.090 INFO:tasks.workunit.client.0.trial041.stderr:+ objects=0 2026-02-22T22:34:37.090 INFO:tasks.workunit.client.0.trial041.stderr:+ echo 0 2026-02-22T22:34:37.090 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 -eq 1 -o 0 = 0 ] 2026-02-22T22:34:37.090 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/sparse 2026-02-22T22:34:37.091 INFO:tasks.workunit.client.0.trial041.stderr:rm: cannot remove '/tmp/rbd_import_export_19636/sparse': No such file or directory 2026-02-22T22:34:37.091 INFO:tasks.workunit.client.0.trial041.stderr:+ true 2026-02-22T22:34:37.091 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd export sparse /tmp/rbd_import_export_19636/sparse 2026-02-22T22:34:37.123 INFO:tasks.workunit.client.0.trial041.stderr: Exporting image: 100% complete...done. 2026-02-22T22:34:37.128 INFO:tasks.workunit.client.0.trial041.stderr:+ stat /tmp/rbd_import_export_19636/sparse --format=%b 2026-02-22T22:34:37.129 INFO:tasks.workunit.client.0.trial041.stderr:+ [ 0 = 0 ] 2026-02-22T22:34:37.129 INFO:tasks.workunit.client.0.trial041.stderr:+ rbd rm sparse 2026-02-22T22:34:37.155 INFO:tasks.workunit.client.0.trial041.stderr: Removing image: 100% complete...done. 2026-02-22T22:34:37.158 INFO:tasks.workunit.client.0.trial041.stderr:+ rm /tmp/rbd_import_export_19636/sparse /tmp/rbd_import_export_19636/sparse1 /tmp/rbd_import_export_19636/sparse2 /tmp/rbd_import_export_19636/sparse3 2026-02-22T22:34:37.160 INFO:tasks.workunit.client.0.trial041.stderr:rm: cannot remove '/tmp/rbd_import_export_19636/sparse3': No such file or directory 2026-02-22T22:34:37.160 INFO:tasks.workunit.client.0.trial041.stderr:+ true 2026-02-22T22:34:37.160 INFO:tasks.workunit.client.0.trial041.stderr:+ echo OK 2026-02-22T22:34:37.161 INFO:tasks.workunit.client.0.trial041.stdout:OK 2026-02-22T22:34:37.162 INFO:tasks.workunit.client.0.trial041.stderr:+ rm -rf /tmp/rbd_import_export_19636 2026-02-22T22:34:37.162 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-22T22:34:37.162 DEBUG:teuthology.orchestra.run.trial041:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-22T22:34:37.215 INFO:tasks.workunit:Stopping ['rbd/import_export.sh'] on client.0... 2026-02-22T22:34:37.215 DEBUG:teuthology.orchestra.run.trial041:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-22T22:34:37.525 DEBUG:teuthology.parallel:result is None 2026-02-22T22:34:37.526 DEBUG:teuthology.orchestra.run.trial041:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T22:34:37.535 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T22:34:37.535 DEBUG:teuthology.orchestra.run.trial041:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-22T22:34:37.581 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-22T22:34:37.581 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T22:34:37.593 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T22:34:37.593 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:34:37.774 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:34:37.775 INFO:teuthology.orchestra.run.trial041.stderr:dumped all 2026-02-22T22:34:37.785 INFO:teuthology.orchestra.run.trial041.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2026-02-22T22:34:37.246930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":815777,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2451,"num_read_kb":3835,"num_write":414,"num_write_kb":2794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87064,"kb_used_data":1968,"kb_used_omap":4,"kb_used_meta":84987,"kb_avail":283028456,"statfs":{"total":289910292480,"available":289821138944,"internally_reserved":0,"allocated":2015232,"data_stored":1479280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":87027029},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-70,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":495,"num_read_kb":404,"num_write":49,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.962852"},"pg_stats":[{"pgid":"2.7","version":"22'113","reported_seq":379,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.289109+0000","last_change":"2026-02-22T22:34:34.289309+0000","last_active":"2026-02-22T22:34:34.289109+0000","last_peered":"2026-02-22T22:34:34.289109+0000","last_clean":"2026-02-22T22:34:34.289109+0000","last_became_active":"2026-02-22T22:33:48.782300+0000","last_became_peered":"2026-02-22T22:33:48.782300+0000","last_unstale":"2026-02-22T22:34:34.289109+0000","last_undegraded":"2026-02-22T22:34:34.289109+0000","last_fullsized":"2026-02-22T22:34:34.289109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:22.712191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085121000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":770,"num_write":27,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.6","version":"29'88","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288892+0000","last_change":"2026-02-22T22:34:34.288892+0000","last_active":"2026-02-22T22:34:34.288892+0000","last_peered":"2026-02-22T22:34:34.288892+0000","last_clean":"2026-02-22T22:34:34.288892+0000","last_became_active":"2026-02-22T22:33:48.782112+0000","last_became_peered":"2026-02-22T22:33:48.782112+0000","last_unstale":"2026-02-22T22:34:34.288892+0000","last_undegraded":"2026-02-22T22:34:34.288892+0000","last_fullsized":"2026-02-22T22:34:34.288892+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:28:49.793276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047699199999999998,"stat_sum":{"num_bytes":112691,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":44,"num_write":27,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.5","version":"22'126","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288963+0000","last_change":"2026-02-22T22:34:34.289209+0000","last_active":"2026-02-22T22:34:34.288963+0000","last_peered":"2026-02-22T22:34:34.288963+0000","last_clean":"2026-02-22T22:34:34.288963+0000","last_became_active":"2026-02-22T22:33:48.781389+0000","last_became_peered":"2026-02-22T22:33:48.781389+0000","last_unstale":"2026-02-22T22:34:34.288963+0000","last_undegraded":"2026-02-22T22:34:34.288963+0000","last_fullsized":"2026-02-22T22:34:34.288963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:39.868810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077389600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":1035,"num_write":46,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.4","version":"24'98","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288808+0000","last_change":"2026-02-22T22:34:34.289048+0000","last_active":"2026-02-22T22:34:34.288808+0000","last_peered":"2026-02-22T22:34:34.288808+0000","last_clean":"2026-02-22T22:34:34.288808+0000","last_became_active":"2026-02-22T22:33:48.781449+0000","last_became_peered":"2026-02-22T22:33:48.781449+0000","last_unstale":"2026-02-22T22:34:34.288808+0000","last_undegraded":"2026-02-22T22:34:34.288808+0000","last_fullsized":"2026-02-22T22:34:34.288808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:06:16.763363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061510899999999997,"stat_sum":{"num_bytes":112648,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":63,"num_write":31,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.2","version":"22'77","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-22T22:34:33.281960+0000","last_change":"2026-02-22T22:34:33.282087+0000","last_active":"2026-02-22T22:34:33.281960+0000","last_peered":"2026-02-22T22:34:33.281960+0000","last_clean":"2026-02-22T22:34:33.281960+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:33.281960+0000","last_undegraded":"2026-02-22T22:34:33.281960+0000","last_fullsized":"2026-02-22T22:34:33.281960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:56:58.392374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040348400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":216,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.1","version":"29'150","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293918+0000","last_change":"2026-02-22T22:34:34.286728+0000","last_active":"2026-02-22T22:34:34.293918+0000","last_peered":"2026-02-22T22:34:34.293918+0000","last_clean":"2026-02-22T22:34:34.293918+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:34.293918+0000","last_undegraded":"2026-02-22T22:34:34.293918+0000","last_fullsized":"2026-02-22T22:34:34.293918+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:22.324084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040515700000000001,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":127,"num_write":63,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.0","version":"29'145","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293408+0000","last_change":"2026-02-22T22:34:34.287077+0000","last_active":"2026-02-22T22:34:34.293408+0000","last_peered":"2026-02-22T22:34:34.293408+0000","last_clean":"2026-02-22T22:34:34.293408+0000","last_became_active":"2026-02-22T22:33:48.781534+0000","last_became_peered":"2026-02-22T22:33:48.781534+0000","last_unstale":"2026-02-22T22:34:34.293408+0000","last_undegraded":"2026-02-22T22:34:34.293408+0000","last_fullsized":"2026-02-22T22:34:34.293408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:31:16.832152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075563200000000001,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":992,"num_write":80,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.3","version":"27'95","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288597+0000","last_change":"2026-02-22T22:34:34.288764+0000","last_active":"2026-02-22T22:34:34.288597+0000","last_peered":"2026-02-22T22:34:34.288597+0000","last_clean":"2026-02-22T22:34:34.288597+0000","last_became_active":"2026-02-22T22:33:48.781180+0000","last_became_peered":"2026-02-22T22:33:48.781180+0000","last_unstale":"2026-02-22T22:34:34.288597+0000","last_undegraded":"2026-02-22T22:34:34.288597+0000","last_fullsized":"2026-02-22T22:34:34.288597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:22.642781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039420699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":533,"num_write":31,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"1.0","version":"12'72","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288302+0000","last_change":"2026-02-22T22:33:47.700223+0000","last_active":"2026-02-22T22:34:34.288302+0000","last_peered":"2026-02-22T22:34:34.288302+0000","last_clean":"2026-02-22T22:34:34.288302+0000","last_became_active":"2026-02-22T22:33:47.699393+0000","last_became_peered":"2026-02-22T22:33:47.699393+0000","last_unstale":"2026-02-22T22:34:34.288302+0000","last_undegraded":"2026-02-22T22:34:34.288302+0000","last_fullsized":"2026-02-22T22:34:34.288302+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_clean_scrub_stamp":"2026-02-22T22:33:45.768464+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:34.086878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":225409,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2385,"num_read_kb":3780,"num_write":313,"num_write_kb":1166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":41218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":892,"ondisk_log_size":892,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":253952,"data_stored":87013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705677,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":888832,"data_stored":697939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":872448,"data_stored":694328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":20558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":20609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:34:37.785 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:34:37.929 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:34:37.930 INFO:teuthology.orchestra.run.trial041.stderr:dumped all 2026-02-22T22:34:37.940 INFO:teuthology.orchestra.run.trial041.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2026-02-22T22:34:37.246930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":815777,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2451,"num_read_kb":3835,"num_write":414,"num_write_kb":2794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87064,"kb_used_data":1968,"kb_used_omap":4,"kb_used_meta":84987,"kb_avail":283028456,"statfs":{"total":289910292480,"available":289821138944,"internally_reserved":0,"allocated":2015232,"data_stored":1479280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":87027029},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-70,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":495,"num_read_kb":404,"num_write":49,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.962852"},"pg_stats":[{"pgid":"2.7","version":"22'113","reported_seq":379,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.289109+0000","last_change":"2026-02-22T22:34:34.289309+0000","last_active":"2026-02-22T22:34:34.289109+0000","last_peered":"2026-02-22T22:34:34.289109+0000","last_clean":"2026-02-22T22:34:34.289109+0000","last_became_active":"2026-02-22T22:33:48.782300+0000","last_became_peered":"2026-02-22T22:33:48.782300+0000","last_unstale":"2026-02-22T22:34:34.289109+0000","last_undegraded":"2026-02-22T22:34:34.289109+0000","last_fullsized":"2026-02-22T22:34:34.289109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:22.712191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085121000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":770,"num_write":27,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.6","version":"29'88","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288892+0000","last_change":"2026-02-22T22:34:34.288892+0000","last_active":"2026-02-22T22:34:34.288892+0000","last_peered":"2026-02-22T22:34:34.288892+0000","last_clean":"2026-02-22T22:34:34.288892+0000","last_became_active":"2026-02-22T22:33:48.782112+0000","last_became_peered":"2026-02-22T22:33:48.782112+0000","last_unstale":"2026-02-22T22:34:34.288892+0000","last_undegraded":"2026-02-22T22:34:34.288892+0000","last_fullsized":"2026-02-22T22:34:34.288892+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:28:49.793276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047699199999999998,"stat_sum":{"num_bytes":112691,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":44,"num_write":27,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.5","version":"22'126","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288963+0000","last_change":"2026-02-22T22:34:34.289209+0000","last_active":"2026-02-22T22:34:34.288963+0000","last_peered":"2026-02-22T22:34:34.288963+0000","last_clean":"2026-02-22T22:34:34.288963+0000","last_became_active":"2026-02-22T22:33:48.781389+0000","last_became_peered":"2026-02-22T22:33:48.781389+0000","last_unstale":"2026-02-22T22:34:34.288963+0000","last_undegraded":"2026-02-22T22:34:34.288963+0000","last_fullsized":"2026-02-22T22:34:34.288963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:39.868810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077389600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":1035,"num_write":46,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.4","version":"24'98","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288808+0000","last_change":"2026-02-22T22:34:34.289048+0000","last_active":"2026-02-22T22:34:34.288808+0000","last_peered":"2026-02-22T22:34:34.288808+0000","last_clean":"2026-02-22T22:34:34.288808+0000","last_became_active":"2026-02-22T22:33:48.781449+0000","last_became_peered":"2026-02-22T22:33:48.781449+0000","last_unstale":"2026-02-22T22:34:34.288808+0000","last_undegraded":"2026-02-22T22:34:34.288808+0000","last_fullsized":"2026-02-22T22:34:34.288808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:06:16.763363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061510899999999997,"stat_sum":{"num_bytes":112648,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":63,"num_write":31,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.2","version":"22'77","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-22T22:34:33.281960+0000","last_change":"2026-02-22T22:34:33.282087+0000","last_active":"2026-02-22T22:34:33.281960+0000","last_peered":"2026-02-22T22:34:33.281960+0000","last_clean":"2026-02-22T22:34:33.281960+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:33.281960+0000","last_undegraded":"2026-02-22T22:34:33.281960+0000","last_fullsized":"2026-02-22T22:34:33.281960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:56:58.392374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040348400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":216,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.1","version":"29'150","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293918+0000","last_change":"2026-02-22T22:34:34.286728+0000","last_active":"2026-02-22T22:34:34.293918+0000","last_peered":"2026-02-22T22:34:34.293918+0000","last_clean":"2026-02-22T22:34:34.293918+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:34.293918+0000","last_undegraded":"2026-02-22T22:34:34.293918+0000","last_fullsized":"2026-02-22T22:34:34.293918+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:22.324084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040515700000000001,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":127,"num_write":63,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.0","version":"29'145","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293408+0000","last_change":"2026-02-22T22:34:34.287077+0000","last_active":"2026-02-22T22:34:34.293408+0000","last_peered":"2026-02-22T22:34:34.293408+0000","last_clean":"2026-02-22T22:34:34.293408+0000","last_became_active":"2026-02-22T22:33:48.781534+0000","last_became_peered":"2026-02-22T22:33:48.781534+0000","last_unstale":"2026-02-22T22:34:34.293408+0000","last_undegraded":"2026-02-22T22:34:34.293408+0000","last_fullsized":"2026-02-22T22:34:34.293408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:31:16.832152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075563200000000001,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":992,"num_write":80,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.3","version":"27'95","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288597+0000","last_change":"2026-02-22T22:34:34.288764+0000","last_active":"2026-02-22T22:34:34.288597+0000","last_peered":"2026-02-22T22:34:34.288597+0000","last_clean":"2026-02-22T22:34:34.288597+0000","last_became_active":"2026-02-22T22:33:48.781180+0000","last_became_peered":"2026-02-22T22:33:48.781180+0000","last_unstale":"2026-02-22T22:34:34.288597+0000","last_undegraded":"2026-02-22T22:34:34.288597+0000","last_fullsized":"2026-02-22T22:34:34.288597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:22.642781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039420699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":533,"num_write":31,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"1.0","version":"12'72","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288302+0000","last_change":"2026-02-22T22:33:47.700223+0000","last_active":"2026-02-22T22:34:34.288302+0000","last_peered":"2026-02-22T22:34:34.288302+0000","last_clean":"2026-02-22T22:34:34.288302+0000","last_became_active":"2026-02-22T22:33:47.699393+0000","last_became_peered":"2026-02-22T22:33:47.699393+0000","last_unstale":"2026-02-22T22:34:34.288302+0000","last_undegraded":"2026-02-22T22:34:34.288302+0000","last_fullsized":"2026-02-22T22:34:34.288302+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_clean_scrub_stamp":"2026-02-22T22:33:45.768464+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:34.086878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":225409,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2385,"num_read_kb":3780,"num_write":313,"num_write_kb":1166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":41218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":892,"ondisk_log_size":892,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":253952,"data_stored":87013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705677,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":888832,"data_stored":697939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":872448,"data_stored":694328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":20558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":20609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:34:37.942 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T22:34:37.942 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:34:38.086 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:34:38.087 INFO:teuthology.orchestra.run.trial041.stderr:dumped all 2026-02-22T22:34:38.097 INFO:teuthology.orchestra.run.trial041.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2026-02-22T22:34:37.246930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":815777,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2451,"num_read_kb":3835,"num_write":414,"num_write_kb":2794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87064,"kb_used_data":1968,"kb_used_omap":4,"kb_used_meta":84987,"kb_avail":283028456,"statfs":{"total":289910292480,"available":289821138944,"internally_reserved":0,"allocated":2015232,"data_stored":1479280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":87027029},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-70,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":495,"num_read_kb":404,"num_write":49,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.962852"},"pg_stats":[{"pgid":"2.7","version":"22'113","reported_seq":379,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.289109+0000","last_change":"2026-02-22T22:34:34.289309+0000","last_active":"2026-02-22T22:34:34.289109+0000","last_peered":"2026-02-22T22:34:34.289109+0000","last_clean":"2026-02-22T22:34:34.289109+0000","last_became_active":"2026-02-22T22:33:48.782300+0000","last_became_peered":"2026-02-22T22:33:48.782300+0000","last_unstale":"2026-02-22T22:34:34.289109+0000","last_undegraded":"2026-02-22T22:34:34.289109+0000","last_fullsized":"2026-02-22T22:34:34.289109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:22.712191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085121000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":770,"num_write":27,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.6","version":"29'88","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288892+0000","last_change":"2026-02-22T22:34:34.288892+0000","last_active":"2026-02-22T22:34:34.288892+0000","last_peered":"2026-02-22T22:34:34.288892+0000","last_clean":"2026-02-22T22:34:34.288892+0000","last_became_active":"2026-02-22T22:33:48.782112+0000","last_became_peered":"2026-02-22T22:33:48.782112+0000","last_unstale":"2026-02-22T22:34:34.288892+0000","last_undegraded":"2026-02-22T22:34:34.288892+0000","last_fullsized":"2026-02-22T22:34:34.288892+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:28:49.793276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047699199999999998,"stat_sum":{"num_bytes":112691,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":44,"num_write":27,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.5","version":"22'126","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288963+0000","last_change":"2026-02-22T22:34:34.289209+0000","last_active":"2026-02-22T22:34:34.288963+0000","last_peered":"2026-02-22T22:34:34.288963+0000","last_clean":"2026-02-22T22:34:34.288963+0000","last_became_active":"2026-02-22T22:33:48.781389+0000","last_became_peered":"2026-02-22T22:33:48.781389+0000","last_unstale":"2026-02-22T22:34:34.288963+0000","last_undegraded":"2026-02-22T22:34:34.288963+0000","last_fullsized":"2026-02-22T22:34:34.288963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:39.868810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077389600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":1035,"num_write":46,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.4","version":"24'98","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288808+0000","last_change":"2026-02-22T22:34:34.289048+0000","last_active":"2026-02-22T22:34:34.288808+0000","last_peered":"2026-02-22T22:34:34.288808+0000","last_clean":"2026-02-22T22:34:34.288808+0000","last_became_active":"2026-02-22T22:33:48.781449+0000","last_became_peered":"2026-02-22T22:33:48.781449+0000","last_unstale":"2026-02-22T22:34:34.288808+0000","last_undegraded":"2026-02-22T22:34:34.288808+0000","last_fullsized":"2026-02-22T22:34:34.288808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:06:16.763363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061510899999999997,"stat_sum":{"num_bytes":112648,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":63,"num_write":31,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.2","version":"22'77","reported_seq":242,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-22T22:34:33.281960+0000","last_change":"2026-02-22T22:34:33.282087+0000","last_active":"2026-02-22T22:34:33.281960+0000","last_peered":"2026-02-22T22:34:33.281960+0000","last_clean":"2026-02-22T22:34:33.281960+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:33.281960+0000","last_undegraded":"2026-02-22T22:34:33.281960+0000","last_fullsized":"2026-02-22T22:34:33.281960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:56:58.392374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040348400000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":216,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"2"}]},{"pgid":"2.1","version":"29'150","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293918+0000","last_change":"2026-02-22T22:34:34.286728+0000","last_active":"2026-02-22T22:34:34.293918+0000","last_peered":"2026-02-22T22:34:34.293918+0000","last_clean":"2026-02-22T22:34:34.293918+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:34.293918+0000","last_undegraded":"2026-02-22T22:34:34.293918+0000","last_fullsized":"2026-02-22T22:34:34.293918+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:22.324084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040515700000000001,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":127,"num_write":63,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.0","version":"29'145","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293408+0000","last_change":"2026-02-22T22:34:34.287077+0000","last_active":"2026-02-22T22:34:34.293408+0000","last_peered":"2026-02-22T22:34:34.293408+0000","last_clean":"2026-02-22T22:34:34.293408+0000","last_became_active":"2026-02-22T22:33:48.781534+0000","last_became_peered":"2026-02-22T22:33:48.781534+0000","last_unstale":"2026-02-22T22:34:34.293408+0000","last_undegraded":"2026-02-22T22:34:34.293408+0000","last_fullsized":"2026-02-22T22:34:34.293408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:31:16.832152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075563200000000001,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":992,"num_write":80,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.3","version":"27'95","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288597+0000","last_change":"2026-02-22T22:34:34.288764+0000","last_active":"2026-02-22T22:34:34.288597+0000","last_peered":"2026-02-22T22:34:34.288597+0000","last_clean":"2026-02-22T22:34:34.288597+0000","last_became_active":"2026-02-22T22:33:48.781180+0000","last_became_peered":"2026-02-22T22:33:48.781180+0000","last_unstale":"2026-02-22T22:34:34.288597+0000","last_undegraded":"2026-02-22T22:34:34.288597+0000","last_fullsized":"2026-02-22T22:34:34.288597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:22.642781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039420699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":533,"num_write":31,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"1.0","version":"12'72","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288302+0000","last_change":"2026-02-22T22:33:47.700223+0000","last_active":"2026-02-22T22:34:34.288302+0000","last_peered":"2026-02-22T22:34:34.288302+0000","last_clean":"2026-02-22T22:34:34.288302+0000","last_became_active":"2026-02-22T22:33:47.699393+0000","last_became_peered":"2026-02-22T22:33:47.699393+0000","last_unstale":"2026-02-22T22:34:34.288302+0000","last_undegraded":"2026-02-22T22:34:34.288302+0000","last_fullsized":"2026-02-22T22:34:34.288302+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_clean_scrub_stamp":"2026-02-22T22:33:45.768464+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:34.086878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":225409,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2385,"num_read_kb":3780,"num_write":313,"num_write_kb":1166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":41218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":892,"ondisk_log_size":892,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":253952,"data_stored":87013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705677,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":888832,"data_stored":697939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":872448,"data_stored":694328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":20558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":20609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:34:38.100 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:34:38.248 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:34:38.248 INFO:teuthology.orchestra.run.trial041.stdout:{"epoch":31,"fsid":"7b095714-3316-4e30-a59a-81c2a99e0305","created":"2026-02-22T22:33:33.263282+0000","modified":"2026-02-22T22:34:38.244781+0000","last_up_change":"2026-02-22T22:33:43.765247+0000","last_in_change":"2026-02-22T22:33:33.705548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:33:45.273396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:33:47.331082+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":30,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ab10ba97-b129-481c-a62f-bf11066693c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6802","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6803","nonce":4084981383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6805","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6806","nonce":4084981383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6811","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6813","nonce":4084981383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6808","nonce":4084981383},{"type":"v1","addr":"10.20.193.41:6810","nonce":4084981383}]},"public_addr":"10.20.193.41:6803/4084981383","cluster_addr":"10.20.193.41:6806/4084981383","heartbeat_back_addr":"10.20.193.41:6813/4084981383","heartbeat_front_addr":"10.20.193.41:6810/4084981383","state":["exists","up"]},{"osd":1,"uuid":"bc41bc1c-4ba7-4c04-9f70-887dd9cb360c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6804","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6807","nonce":577187467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6809","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6812","nonce":577187467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6816","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6817","nonce":577187467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6814","nonce":577187467},{"type":"v1","addr":"10.20.193.41:6815","nonce":577187467}]},"public_addr":"10.20.193.41:6807/577187467","cluster_addr":"10.20.193.41:6812/577187467","heartbeat_back_addr":"10.20.193.41:6817/577187467","heartbeat_front_addr":"10.20.193.41:6815/577187467","state":["exists","up"]},{"osd":2,"uuid":"17d9e4e4-8538-4412-9443-8df11c3aa95b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6818","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6819","nonce":2868293051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6820","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6821","nonce":2868293051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6824","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6825","nonce":2868293051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.41:6822","nonce":2868293051},{"type":"v1","addr":"10.20.193.41:6823","nonce":2868293051}]},"public_addr":"10.20.193.41:6819/2868293051","cluster_addr":"10.20.193.41:6821/2868293051","heartbeat_back_addr":"10.20.193.41:6825/2868293051","heartbeat_front_addr":"10.20.193.41:6823/2868293051","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":8,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":6,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:34:39.260 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T22:34:39.261 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:34:39.336 INFO:teuthology.orchestra.run.trial041.stdout:{ 2026-02-22T22:34:39.336 INFO:teuthology.orchestra.run.trial041.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:34:39.336 INFO:teuthology.orchestra.run.trial041.stdout:} 2026-02-22T22:34:39.345 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T22:34:39.496 INFO:teuthology.orchestra.run.trial041.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T22:34:39.509 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T22:34:39.509 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:34:39.583 INFO:teuthology.orchestra.run.trial041.stdout:{ 2026-02-22T22:34:39.584 INFO:teuthology.orchestra.run.trial041.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:34:39.584 INFO:teuthology.orchestra.run.trial041.stdout:} 2026-02-22T22:34:39.596 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T22:34:39.747 INFO:teuthology.orchestra.run.trial041.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T22:34:39.759 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T22:34:39.759 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:34:39.841 INFO:teuthology.orchestra.run.trial041.stdout:{ 2026-02-22T22:34:39.841 INFO:teuthology.orchestra.run.trial041.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:34:39.841 INFO:teuthology.orchestra.run.trial041.stdout:} 2026-02-22T22:34:39.853 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T22:34:40.009 INFO:teuthology.orchestra.run.trial041.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T22:34:40.020 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:34:40.161 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:34:40.161 INFO:teuthology.orchestra.run.trial041.stderr:dumped all 2026-02-22T22:34:40.173 INFO:teuthology.orchestra.run.trial041.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2026-02-22T22:34:39.247187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":815777,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":2460,"num_read_kb":3844,"num_write":414,"num_write_kb":2794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87040,"kb_used_data":1952,"kb_used_omap":4,"kb_used_meta":84987,"kb_avail":283028480,"statfs":{"total":289910292480,"available":289821163520,"internally_reserved":0,"allocated":1998848,"data_stored":1465869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":87027029},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-70,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":504,"num_read_kb":413,"num_write":49,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000668"},"pg_stats":[{"pgid":"2.7","version":"22'113","reported_seq":379,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.289109+0000","last_change":"2026-02-22T22:34:34.289309+0000","last_active":"2026-02-22T22:34:34.289109+0000","last_peered":"2026-02-22T22:34:34.289109+0000","last_clean":"2026-02-22T22:34:34.289109+0000","last_became_active":"2026-02-22T22:33:48.782300+0000","last_became_peered":"2026-02-22T22:33:48.782300+0000","last_unstale":"2026-02-22T22:34:34.289109+0000","last_undegraded":"2026-02-22T22:34:34.289109+0000","last_fullsized":"2026-02-22T22:34:34.289109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:47:22.712191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085121000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":770,"num_write":27,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.6","version":"29'88","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288892+0000","last_change":"2026-02-22T22:34:34.288892+0000","last_active":"2026-02-22T22:34:34.288892+0000","last_peered":"2026-02-22T22:34:34.288892+0000","last_clean":"2026-02-22T22:34:34.288892+0000","last_became_active":"2026-02-22T22:33:48.782112+0000","last_became_peered":"2026-02-22T22:33:48.782112+0000","last_unstale":"2026-02-22T22:34:34.288892+0000","last_undegraded":"2026-02-22T22:34:34.288892+0000","last_fullsized":"2026-02-22T22:34:34.288892+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:28:49.793276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047699199999999998,"stat_sum":{"num_bytes":112691,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":44,"num_write":27,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.5","version":"22'126","reported_seq":308,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288963+0000","last_change":"2026-02-22T22:34:34.289209+0000","last_active":"2026-02-22T22:34:34.288963+0000","last_peered":"2026-02-22T22:34:34.288963+0000","last_clean":"2026-02-22T22:34:34.288963+0000","last_became_active":"2026-02-22T22:33:48.781389+0000","last_became_peered":"2026-02-22T22:33:48.781389+0000","last_unstale":"2026-02-22T22:34:34.288963+0000","last_undegraded":"2026-02-22T22:34:34.288963+0000","last_fullsized":"2026-02-22T22:34:34.288963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:41:39.868810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077389600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":1035,"num_write":46,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.4","version":"24'98","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288808+0000","last_change":"2026-02-22T22:34:34.289048+0000","last_active":"2026-02-22T22:34:34.288808+0000","last_peered":"2026-02-22T22:34:34.288808+0000","last_clean":"2026-02-22T22:34:34.288808+0000","last_became_active":"2026-02-22T22:33:48.781449+0000","last_became_peered":"2026-02-22T22:33:48.781449+0000","last_unstale":"2026-02-22T22:34:34.288808+0000","last_undegraded":"2026-02-22T22:34:34.288808+0000","last_fullsized":"2026-02-22T22:34:34.288808+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:06:16.763363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061510899999999997,"stat_sum":{"num_bytes":112648,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":63,"num_write":31,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.2","version":"30'78","reported_seq":268,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-22T22:34:38.246960+0000","last_change":"2026-02-22T22:34:35.292366+0000","last_active":"2026-02-22T22:34:38.246960+0000","last_peered":"2026-02-22T22:34:38.246960+0000","last_clean":"2026-02-22T22:34:38.246960+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:38.246960+0000","last_undegraded":"2026-02-22T22:34:38.246960+0000","last_fullsized":"2026-02-22T22:34:38.246960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:32:40.519673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000239037,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":225,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"8","length":"2"}]},{"pgid":"2.1","version":"29'150","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293918+0000","last_change":"2026-02-22T22:34:34.286728+0000","last_active":"2026-02-22T22:34:34.293918+0000","last_peered":"2026-02-22T22:34:34.293918+0000","last_clean":"2026-02-22T22:34:34.293918+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:34.293918+0000","last_undegraded":"2026-02-22T22:34:34.293918+0000","last_fullsized":"2026-02-22T22:34:34.293918+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:46:22.324084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040515700000000001,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":127,"num_write":63,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.0","version":"29'145","reported_seq":566,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.293408+0000","last_change":"2026-02-22T22:34:34.287077+0000","last_active":"2026-02-22T22:34:34.293408+0000","last_peered":"2026-02-22T22:34:34.293408+0000","last_clean":"2026-02-22T22:34:34.293408+0000","last_became_active":"2026-02-22T22:33:48.781534+0000","last_became_peered":"2026-02-22T22:33:48.781534+0000","last_unstale":"2026-02-22T22:34:34.293408+0000","last_undegraded":"2026-02-22T22:34:34.293408+0000","last_fullsized":"2026-02-22T22:34:34.293408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:31:16.832152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075563200000000001,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1005,"num_read_kb":992,"num_write":80,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"2.3","version":"27'95","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288597+0000","last_change":"2026-02-22T22:34:34.288764+0000","last_active":"2026-02-22T22:34:34.288597+0000","last_peered":"2026-02-22T22:34:34.288597+0000","last_clean":"2026-02-22T22:34:34.288597+0000","last_became_active":"2026-02-22T22:33:48.781180+0000","last_became_peered":"2026-02-22T22:33:48.781180+0000","last_unstale":"2026-02-22T22:34:34.288597+0000","last_undegraded":"2026-02-22T22:34:34.288597+0000","last_fullsized":"2026-02-22T22:34:34.288597+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:47.772842+0000","last_clean_scrub_stamp":"2026-02-22T22:33:47.772842+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:36:22.642781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039420699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":533,"num_write":31,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"3"}]},{"pgid":"1.0","version":"12'72","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-22T22:34:34.288302+0000","last_change":"2026-02-22T22:33:47.700223+0000","last_active":"2026-02-22T22:34:34.288302+0000","last_peered":"2026-02-22T22:34:34.288302+0000","last_clean":"2026-02-22T22:34:34.288302+0000","last_became_active":"2026-02-22T22:33:47.699393+0000","last_became_peered":"2026-02-22T22:33:47.699393+0000","last_unstale":"2026-02-22T22:34:34.288302+0000","last_undegraded":"2026-02-22T22:34:34.288302+0000","last_fullsized":"2026-02-22T22:34:34.288302+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:33:45.768464+0000","last_clean_scrub_stamp":"2026-02-22T22:33:45.768464+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:02:34.086878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":225409,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2394,"num_read_kb":3789,"num_write":313,"num_write_kb":1166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":20687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":893,"ondisk_log_size":893,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":253952,"data_stored":87013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705677,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":888832,"data_stored":697939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738382,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":856064,"data_stored":680917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":27,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":20609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:34:40.179 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.179 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.180 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.180 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.180 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.180 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.181 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.181 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-22T22:33:47.772842+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=47, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.181 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T22:33:45.768464+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=33, tm_sec=45, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=34, tm_sec=38, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:34:40.181 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T22:35:00.182 DEBUG:teuthology.orchestra.run.trial041:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:35:00.336 INFO:teuthology.orchestra.run.trial041.stdout: 2026-02-22T22:35:00.336 INFO:teuthology.orchestra.run.trial041.stderr:dumped all 2026-02-22T22:35:00.348 INFO:teuthology.orchestra.run.trial041.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2026-02-22T22:34:59.249124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590395,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2959,"num_read_kb":14444,"num_write":532,"num_write_kb":14111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1160,"ondisk_log_size":1160,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87044,"kb_used_data":1992,"kb_used_omap":4,"kb_used_meta":84987,"kb_avail":283028476,"statfs":{"total":289910292480,"available":289821159424,"internally_reserved":0,"allocated":2039808,"data_stored":1481468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":87027029},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.000784"},"pg_stats":[{"pgid":"2.7","version":"30'121","reported_seq":410,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.257653+0000","last_change":"2026-02-22T22:34:45.507684+0000","last_active":"2026-02-22T22:34:52.257653+0000","last_peered":"2026-02-22T22:34:52.257653+0000","last_clean":"2026-02-22T22:34:52.257653+0000","last_became_active":"2026-02-22T22:33:48.782300+0000","last_became_peered":"2026-02-22T22:33:48.782300+0000","last_unstale":"2026-02-22T22:34:52.257653+0000","last_undegraded":"2026-02-22T22:34:52.257653+0000","last_fullsized":"2026-02-22T22:34:52.257653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'121","last_scrub_stamp":"2026-02-22T22:34:45.507611+0000","last_deep_scrub":"30'121","last_deep_scrub_stamp":"2026-02-22T22:34:45.507611+0000","last_clean_scrub_stamp":"2026-02-22T22:34:45.507611+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:19:41.515173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049806099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":1794,"num_write":29,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"30'112","reported_seq":268,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.257659+0000","last_change":"2026-02-22T22:34:44.513893+0000","last_active":"2026-02-22T22:34:52.257659+0000","last_peered":"2026-02-22T22:34:52.257659+0000","last_clean":"2026-02-22T22:34:52.257659+0000","last_became_active":"2026-02-22T22:33:48.782112+0000","last_became_peered":"2026-02-22T22:33:48.782112+0000","last_unstale":"2026-02-22T22:34:52.257659+0000","last_undegraded":"2026-02-22T22:34:52.257659+0000","last_fullsized":"2026-02-22T22:34:52.257659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'112","last_scrub_stamp":"2026-02-22T22:34:44.513761+0000","last_deep_scrub":"30'112","last_deep_scrub_stamp":"2026-02-22T22:34:44.513761+0000","last_clean_scrub_stamp":"2026-02-22T22:34:44.513761+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:24:12.178280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062418599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":1088,"num_write":43,"num_write_kb":1066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"30'149","reported_seq":423,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.257611+0000","last_change":"2026-02-22T22:34:42.558112+0000","last_active":"2026-02-22T22:34:52.257611+0000","last_peered":"2026-02-22T22:34:52.257611+0000","last_clean":"2026-02-22T22:34:52.257611+0000","last_became_active":"2026-02-22T22:33:48.781389+0000","last_became_peered":"2026-02-22T22:33:48.781389+0000","last_unstale":"2026-02-22T22:34:52.257611+0000","last_undegraded":"2026-02-22T22:34:52.257611+0000","last_fullsized":"2026-02-22T22:34:52.257611+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'149","last_scrub_stamp":"2026-02-22T22:34:42.558039+0000","last_deep_scrub":"30'149","last_deep_scrub_stamp":"2026-02-22T22:34:42.558039+0000","last_clean_scrub_stamp":"2026-02-22T22:34:42.558039+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:39:08.057566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033610900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":2095,"num_write":56,"num_write_kb":1457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"30'144","reported_seq":365,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.257624+0000","last_change":"2026-02-22T22:34:43.538128+0000","last_active":"2026-02-22T22:34:52.257624+0000","last_peered":"2026-02-22T22:34:52.257624+0000","last_clean":"2026-02-22T22:34:52.257624+0000","last_became_active":"2026-02-22T22:33:48.781449+0000","last_became_peered":"2026-02-22T22:33:48.781449+0000","last_unstale":"2026-02-22T22:34:52.257624+0000","last_undegraded":"2026-02-22T22:34:52.257624+0000","last_fullsized":"2026-02-22T22:34:52.257624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'144","last_scrub_stamp":"2026-02-22T22:34:43.537810+0000","last_deep_scrub":"30'144","last_deep_scrub_stamp":"2026-02-22T22:34:43.537810+0000","last_clean_scrub_stamp":"2026-02-22T22:34:43.537810+0000","objects_scrubbed":1,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T09:46:38.095362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026258100000000001,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":165,"num_read_kb":1151,"num_write":64,"num_write_kb":2106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"31'79","reported_seq":282,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.265764+0000","last_change":"2026-02-22T22:34:39.766180+0000","last_active":"2026-02-22T22:34:52.265764+0000","last_peered":"2026-02-22T22:34:52.265764+0000","last_clean":"2026-02-22T22:34:52.265764+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:52.265764+0000","last_undegraded":"2026-02-22T22:34:52.265764+0000","last_fullsized":"2026-02-22T22:34:52.265764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'79","last_scrub_stamp":"2026-02-22T22:34:39.766097+0000","last_deep_scrub":"31'79","last_deep_scrub_stamp":"2026-02-22T22:34:39.766097+0000","last_clean_scrub_stamp":"2026-02-22T22:34:39.766097+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:35:42.392819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000239037,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":225,"num_write":8,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"30'180","reported_seq":530,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.265950+0000","last_change":"2026-02-22T22:34:40.813545+0000","last_active":"2026-02-22T22:34:52.265950+0000","last_peered":"2026-02-22T22:34:52.265950+0000","last_clean":"2026-02-22T22:34:52.265950+0000","last_became_active":"2026-02-22T22:33:48.781521+0000","last_became_peered":"2026-02-22T22:33:48.781521+0000","last_unstale":"2026-02-22T22:34:52.265950+0000","last_undegraded":"2026-02-22T22:34:52.265950+0000","last_fullsized":"2026-02-22T22:34:52.265950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'180","last_scrub_stamp":"2026-02-22T22:34:40.813458+0000","last_deep_scrub":"30'180","last_deep_scrub_stamp":"2026-02-22T22:34:40.813458+0000","last_clean_scrub_stamp":"2026-02-22T22:34:40.813458+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:34:22.022082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024424700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":295,"num_read_kb":1187,"num_write":79,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"30'191","reported_seq":729,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.265926+0000","last_change":"2026-02-22T22:34:41.853483+0000","last_active":"2026-02-22T22:34:52.265926+0000","last_peered":"2026-02-22T22:34:52.265926+0000","last_clean":"2026-02-22T22:34:52.265926+0000","last_became_active":"2026-02-22T22:33:48.781534+0000","last_became_peered":"2026-02-22T22:33:48.781534+0000","last_unstale":"2026-02-22T22:34:52.265926+0000","last_undegraded":"2026-02-22T22:34:52.265926+0000","last_fullsized":"2026-02-22T22:34:52.265926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'191","last_scrub_stamp":"2026-02-22T22:34:41.853406+0000","last_deep_scrub":"30'191","last_deep_scrub_stamp":"2026-02-22T22:34:41.853406+0000","last_clean_scrub_stamp":"2026-02-22T22:34:41.853406+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:20:56.664903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068919800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1206,"num_read_kb":5267,"num_write":111,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"30'110","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.257584+0000","last_change":"2026-02-22T22:34:41.596980+0000","last_active":"2026-02-22T22:34:52.257584+0000","last_peered":"2026-02-22T22:34:52.257584+0000","last_clean":"2026-02-22T22:34:52.257584+0000","last_became_active":"2026-02-22T22:33:48.781180+0000","last_became_peered":"2026-02-22T22:33:48.781180+0000","last_unstale":"2026-02-22T22:34:52.257584+0000","last_undegraded":"2026-02-22T22:34:52.257584+0000","last_fullsized":"2026-02-22T22:34:52.257584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'110","last_scrub_stamp":"2026-02-22T22:34:41.596890+0000","last_deep_scrub":"30'110","last_deep_scrub_stamp":"2026-02-22T22:34:41.596890+0000","last_clean_scrub_stamp":"2026-02-22T22:34:41.596890+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:09:17.366845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046794499999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":226,"num_read_kb":1582,"num_write":41,"num_write_kb":1230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"31'74","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-22T22:34:52.257528+0000","last_change":"2026-02-22T22:34:40.561964+0000","last_active":"2026-02-22T22:34:52.257528+0000","last_peered":"2026-02-22T22:34:52.257528+0000","last_clean":"2026-02-22T22:34:52.257528+0000","last_became_active":"2026-02-22T22:33:47.699393+0000","last_became_peered":"2026-02-22T22:33:47.699393+0000","last_unstale":"2026-02-22T22:34:52.257528+0000","last_undegraded":"2026-02-22T22:34:52.257528+0000","last_fullsized":"2026-02-22T22:34:52.257528+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'74","last_scrub_stamp":"2026-02-22T22:34:40.561832+0000","last_deep_scrub":"31'74","last_deep_scrub_stamp":"2026-02-22T22:34:40.561832+0000","last_clean_scrub_stamp":"2026-02-22T22:34:40.561832+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:37:52.836562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":27,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2893,"num_read_kb":14389,"num_write":431,"num_write_kb":12483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1086,"ondisk_log_size":1086,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705681,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":278528,"data_stored":100226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705681,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":880640,"data_stored":690621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":880640,"data_stored":690621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":27,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":27,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:35:00.351 DEBUG:teuthology.orchestra.run.trial041:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T22:35:00.508 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T22:35:00.509 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T22:35:00.509 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T22:35:00.509 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:35:00.585 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T22:35:00.586 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T22:35:00.586 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:35:00.654 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T22:35:00.655 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T22:35:00.655 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:35:00.722 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T22:35:00.722 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T22:35:00.723 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T22:35:00.723 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:35:00.749 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T22:35:00.749 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T22:35:00.749 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T22:35:00.749 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:35:00.803 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T22:35:00.803 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T22:35:00.804 DEBUG:teuthology.orchestra.run.trial041:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2026-02-22T22:35:00.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:35:00.856 DEBUG:teuthology.orchestra.run.trial041:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T22:35:00.915 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:35:00.915 DEBUG:teuthology.orchestra.run.trial041:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T22:35:00.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:35:00.976 DEBUG:teuthology.orchestra.run.trial041:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T22:35:01.031 INFO:tasks.ceph:Archiving mon data... 2026-02-22T22:35:01.033 DEBUG:teuthology.misc:Transferring archived files from trial041:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64249/data/mon.a.tgz 2026-02-22T22:35:01.033 DEBUG:teuthology.orchestra.run.trial041:> mktemp 2026-02-22T22:35:01.081 INFO:teuthology.orchestra.run.trial041.stdout:/tmp/tmp.VFgakJ6k9T 2026-02-22T22:35:01.082 DEBUG:teuthology.orchestra.run.trial041:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VFgakJ6k9T 2026-02-22T22:35:01.148 DEBUG:teuthology.orchestra.run.trial041:> sudo chmod 0666 /tmp/tmp.VFgakJ6k9T 2026-02-22T22:35:01.246 DEBUG:teuthology.orchestra.remote:trial041:/tmp/tmp.VFgakJ6k9T is 161KB 2026-02-22T22:35:01.253 DEBUG:teuthology.orchestra.run.trial041:> rm -fr /tmp/tmp.VFgakJ6k9T 2026-02-22T22:35:01.257 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T22:35:01.257 DEBUG:teuthology.orchestra.run.trial041:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T22:35:01.350 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T22:35:01.350 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T22:35:01.352 DEBUG:teuthology.misc:Transferring archived files from trial041:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64249/remote/trial041/crash 2026-02-22T22:35:01.353 DEBUG:teuthology.orchestra.run.trial041:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T22:35:01.401 INFO:tasks.ceph:Compressing logs... 2026-02-22T22:35:01.402 DEBUG:teuthology.orchestra.run.trial041:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:35:01.454 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21559.log 2026-02-22T22:35:01.457 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19429.log 2026-02-22T22:35:01.457 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21559.log.gz 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19726.log 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19429.log.gz 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20106.log 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21871.log 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20417.log 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr: 58.1% -- replaced with /var/log/ceph/ceph-client.admin.19726.log.gz 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20106.log.gz 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21871.log.gz 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20292.log 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20395.log 2026-02-22T22:35:01.458 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20417.log: /var/log/ceph/ceph-client.admin.20292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20417.log.gz 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20292.log.gz 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22334.log 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20395.log.gz 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20811.log 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22014.log 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22334.log: /var/log/ceph/ceph-client.admin.20811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22334.log.gz 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20811.log.gz 2026-02-22T22:35:01.459 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21263.log 2026-02-22T22:35:01.475 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21944.log 2026-02-22T22:35:01.475 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22014.log.gz 2026-02-22T22:35:01.475 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19143.log 2026-02-22T22:35:01.475 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21263.log.gz 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21944.log.gz 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20479.log 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16273.log 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19143.log.gz 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21191.log 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20479.log.gz 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.16273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22280.log 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16273.log.gz 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21351.log 2026-02-22T22:35:01.476 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21191.log.gz 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22280.log.gz 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20988.log 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19829.log 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21351.log.gz 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20988.log.gz 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19876.log 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20187.log 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr: 55.3% -- replaced with /var/log/ceph/ceph-client.admin.19829.log.gz 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19876.log.gz 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20607.log 2026-02-22T22:35:01.477 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20126.log 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20187.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.20187.log.gz 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19936.log 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20607.log.gz 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20126.log.gz 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21717.log 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19936.log.gz 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21625.log 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19202.log 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.21717.log.gz 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21583.log 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21625.log.gz 2026-02-22T22:35:01.478 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19202.log.gz 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21124.log 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22150.log 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21583.log: /var/log/ceph/ceph-client.admin.21124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21583.log.gz 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.21124.log.gz 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19916.log 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21874.log 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22150.log.gz 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20079.log 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19916.log.gz 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22098.log 2026-02-22T22:35:01.479 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21874.log.gz 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20079.log.gz 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19896.log 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19507.log 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22098.log.gz 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19436.log 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19896.log.gz 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19507.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.19507.log.gz --verbose 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr: -- /var/log/ceph/ceph-client.admin.21284.log 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19436.log.gz 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20374.log 2026-02-22T22:35:01.480 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19956.log 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.21284.log.gz 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21464.log 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20374.log.gz 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19956.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19956.log.gz 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22306.log 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21464.log.gz 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20207.log 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21921.log 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22306.log.gz 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21511.log 2026-02-22T22:35:01.481 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20207.log.gz 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20851.log 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21921.log.gz 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19037.log 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21511.log.gz 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20851.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.20851.log.gz 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21059.log 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19664.log 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19037.log.gz 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19559.log 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21059.log.gz 2026-02-22T22:35:01.482 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19664.log.gz 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20036.log 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16214.log 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19559.log.gz 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20036.log.gz 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.16214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19082.log 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16214.log.gz 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21848.log 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19996.log 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19082.log.gz 2026-02-22T22:35:01.483 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21848.log.gz 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20354.log 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20541.log 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19996.log.gz 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21810.log 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20354.log.gz 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22072.log 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20541.log.gz 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21696.log 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21810.log.gz 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22072.log.gz 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21103.log 2026-02-22T22:35:01.484 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21696.log.gz 2026-02-22T22:35:01.485 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19976.log 2026-02-22T22:35:01.502 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21168.log 2026-02-22T22:35:01.502 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21103.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21357.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19976.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21168.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.21168.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.19117.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19279.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21357.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21768.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19117.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19279.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20831.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20687.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21768.log: /var/log/ceph/ceph-client.admin.20831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21768.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20831.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.12473.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20687.log.gz 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20923.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20459.log 2026-02-22T22:35:01.503 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph.tmp-client.admin.12473.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.12473.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20923.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20728.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20459.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20707.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20728.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19809.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19852.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.20707.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19201.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.19809.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19852.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20147.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20519.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19201.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20893.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20147.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20519.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22254.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21011.log 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20893.log: /var/log/ceph/ceph-client.admin.22254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20893.log.gz 2026-02-22T22:35:01.504 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22254.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19640.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20312.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21011.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19640.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22228.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20791.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20312.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22228.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20791.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21654.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19856.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21654.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr: 87.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21739.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20944.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.19856.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21739.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21739.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20944.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.20944.log.gz 2026-02-22T22:35:01.505 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19351.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16190.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.19351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19351.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20667.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21488.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.16190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16190.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20667.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21423.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20771.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21488.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21423.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20771.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19789.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19533.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr: 83.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19437.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr: 55.8% -- replaced with /var/log/ceph/ceph-client.admin.19789.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19533.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19169.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21444.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19437.log.gz 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21197.log 2026-02-22T22:35:01.506 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19169.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16238.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.21444.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21197.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21762.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.16238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20059.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16238.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22358.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21762.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20059.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.20059.log.gz -5 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr: --verbose -- /var/log/ceph/ceph-client.admin.20647.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19769.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22358.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20647.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19746.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20872.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.19769.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19746.log: 57.8% -- replaced with /var/log/ceph/ceph-client.admin.19746.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21517.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20016.log 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20872.log: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.20872.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21517.log.gz 2026-02-22T22:35:01.507 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21993.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20438.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20016.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20749.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21993.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19281.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20438.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20749.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20333.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19281.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20271.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21239.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20333.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21830.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20271.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21239.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20586.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18308.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.21830.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19012.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.20586.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5/var/log/ceph/ceph-client.admin.18308.log: --verbose -- /var/log/ceph/ceph-client.admin.22176.log 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18308.log.gz 2026-02-22T22:35:01.508 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22046.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19012.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22176.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21304.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22046.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22202.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21304.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21304.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21648.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22202.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21399.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20964.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21648.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21950.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21399.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20167.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20964.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21950.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21144.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20499.log 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20167.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21144.log.gz 2026-02-22T22:35:01.509 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21603.log 2026-02-22T22:35:01.512 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19358.log 2026-02-22T22:35:01.512 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20499.log.gz 2026-02-22T22:35:01.512 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21603.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.21603.log.gz 2026-02-22T22:35:01.512 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21083.log 2026-02-22T22:35:01.512 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19203.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19358.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21083.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19203.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.20627.log -- replaced with /var/log/ceph/ceph-client.admin.19203.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21328.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20627.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20247.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16342.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21328.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19685.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20247.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.16342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20227.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16342.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19706.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.19685.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20227.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19359.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21017.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 58.0% -- replaced with /var/log/ceph/ceph-client.admin.19706.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19280.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19359.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.21017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20565.log 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21017.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.19280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19280.log.gz 2026-02-22T22:35:01.513 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16097.log 2026-02-22T22:35:01.514 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.20565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22124.log 2026-02-22T22:35:01.514 INFO:teuthology.orchestra.run.trial041.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.20565.log.gz 2026-02-22T22:35:01.514 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.16097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16097.log.gz 2026-02-22T22:35:01.514 INFO:teuthology.orchestra.run.trial041.stderr:/var/log/ceph/ceph-client.admin.22124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22124.log.gz 2026-02-22T22:35:01.514 INFO:teuthology.orchestra.run.trial041.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T22:35:01.563 INFO:teuthology.orchestra.run.trial041.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T22:35:01.602 INFO:teuthology.orchestra.run.trial041.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T22:35:01.696 INFO:teuthology.orchestra.run.trial041.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T22:35:01.697 INFO:teuthology.orchestra.run.trial041.stderr: 2026-02-22T22:35:01.697 INFO:teuthology.orchestra.run.trial041.stderr:real 0m0.250s 2026-02-22T22:35:01.698 INFO:teuthology.orchestra.run.trial041.stderr:user 0m0.502s 2026-02-22T22:35:01.698 INFO:teuthology.orchestra.run.trial041.stderr:sys 0m0.065s 2026-02-22T22:35:01.698 INFO:tasks.ceph:Archiving logs... 2026-02-22T22:35:01.699 DEBUG:teuthology.misc:Transferring archived files from trial041:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64249/remote/trial041/log 2026-02-22T22:35:01.700 DEBUG:teuthology.orchestra.run.trial041:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T22:35:01.880 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T22:35:01.887 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T22:35:01.887 DEBUG:teuthology.orchestra.run.trial041:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T22:35:01.975 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T22:35:01.987 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T22:35:01.987 DEBUG:teuthology.orchestra.run.trial041:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:35:02.010 INFO:teuthology.orchestra.run.trial041.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T22:35:02.010 INFO:teuthology.orchestra.run.trial041.stdout:============================================================================== 2026-02-22T22:35:02.011 INFO:teuthology.orchestra.run.trial041.stdout: 172-234-37-140. 82.35.162.146 2 u 1 64 7 7.655 -14.027 1.725 2026-02-22T22:35:02.011 INFO:teuthology.orchestra.run.trial041.stdout: ntp.shastacoe.n 66.244.0.68 2 u 66 64 3 81.347 +1.554 1.800 2026-02-22T22:35:02.011 INFO:teuthology.orchestra.run.trial041.stdout: 23.186.168.133 132.163.97.4 2 u 65 64 3 88.328 -11.457 1.671 2026-02-22T22:35:02.011 INFO:teuthology.orchestra.run.trial041.stdout: ip229.ip-51-81- 206.108.0.131 2 u 63 64 3 79.073 -2.353 0.420 2026-02-22T22:35:02.011 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T22:35:02.026 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T22:35:02.026 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T22:35:02.040 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T22:35:02.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T22:35:02.067 INFO:teuthology.task.internal:Duration was 284.117754 seconds 2026-02-22T22:35:02.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T22:35:02.080 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T22:35:02.080 DEBUG:teuthology.orchestra.run.trial041:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T22:35:02.104 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T22:35:02.104 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial041.front.sepia.ceph.com 2026-02-22T22:35:02.104 DEBUG:teuthology.orchestra.run.trial041:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T22:35:02.152 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T22:35:02.153 DEBUG:teuthology.orchestra.run.trial041:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:35:02.415 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T22:35:02.416 DEBUG:teuthology.orchestra.run.trial041:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:35:02.425 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:35:02.426 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:35:02.426 INFO:teuthology.orchestra.run.trial041.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T22:35:02.426 INFO:teuthology.orchestra.run.trial041.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:35:02.426 INFO:teuthology.orchestra.run.trial041.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T22:35:02.492 INFO:teuthology.orchestra.run.trial041.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T22:35:02.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T22:35:02.511 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T22:35:02.511 DEBUG:teuthology.orchestra.run.trial041:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T22:35:02.546 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T22:35:02.561 DEBUG:teuthology.orchestra.run.trial041:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:35:02.597 INFO:teuthology.orchestra.run.trial041.stdout:kernel.core_pattern = core 2026-02-22T22:35:02.607 DEBUG:teuthology.orchestra.run.trial041:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:35:02.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:35:02.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T22:35:02.669 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T22:35:02.670 DEBUG:teuthology.misc:Transferring archived files from trial041:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:38-rbd-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64249/remote/trial041 2026-02-22T22:35:02.670 DEBUG:teuthology.orchestra.run.trial041:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T22:35:02.734 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T22:35:02.734 DEBUG:teuthology.orchestra.run.trial041:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T22:35:02.762 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T22:35:02.781 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T22:35:02.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T22:35:02.797 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T22:35:02.797 DEBUG:teuthology.orchestra.run.trial041:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T22:35:02.810 INFO:teuthology.orchestra.run.trial041.stdout: 1179677 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 22:35 /home/ubuntu/cephtest 2026-02-22T22:35:02.811 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T22:35:02.831 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T22:35:02.872 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} duration: 284.1177542209625 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T22:35:02.872 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T22:35:02.988 INFO:teuthology.run:pass