2026-02-17T11:09:13.974 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:09:13.988 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:09:14.072 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51274 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51274' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial109.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOY3w513Umw3iZaHRNagFlrJ66T9AQ/rf9p3JIN1W59SsUtVWgctD3B5bUKyFdEbs/NaO1Rei3NsU+Q3Om1XaY4= tasks: - install: null - ceph: pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - divergent_priors2: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:09:14.072 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T11:09:14.073 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T11:09:14.073 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:09:14.074 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:09:14.074 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T11:09:14.074 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:09:14.074 INFO:teuthology.packaging:ref: None 2026-02-17T11:09:14.074 INFO:teuthology.packaging:tag: None 2026-02-17T11:09:14.075 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T11:09:14.075 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:09:14.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T11:09:14.191 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:09:14.192 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:09:14.208 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:09:14.208 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:09:14.222 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:09:14.231 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:09:14.242 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:09:14.320 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial109.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51274', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:05:45.403694', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDhTjf31ZmS2Z/YjxJdixQV/BzJfCszLHZxTq7pByxR+'} 2026-02-17T11:09:14.320 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:09:14.330 INFO:teuthology.task.internal:roles: ubuntu@trial109.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T11:09:14.330 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:09:14.414 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72c20e0b9a80>, signals=[15]) 2026-02-17T11:09:14.414 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:09:14.428 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:09:14.428 DEBUG:teuthology.task.internal:connecting to ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:09:14.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:09:14.493 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:09:14.504 DEBUG:teuthology.orchestra.run.trial109:> uname -m 2026-02-17T11:09:14.573 INFO:teuthology.orchestra.run.trial109.stdout:x86_64 2026-02-17T11:09:14.574 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-17T11:09:14.618 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:NAME="Ubuntu" 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="22.04" 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_CODENAME=jammy 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:ID=ubuntu 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE=debian 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T11:09:14.619 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T11:09:14.620 INFO:teuthology.orchestra.run.trial109.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T11:09:14.620 INFO:teuthology.orchestra.run.trial109.stdout:UBUNTU_CODENAME=jammy 2026-02-17T11:09:14.621 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-17T11:09:14.709 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:09:14.721 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:09:14.733 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:09:14.733 DEBUG:teuthology.orchestra.run.trial109:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:09:14.736 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:09:14.746 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:09:14.746 DEBUG:teuthology.orchestra.run.trial109:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:09:14.783 INFO:teuthology.orchestra.run.trial109.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T11:09:14.783 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:09:14.881 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:09:14.899 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:09:14.899 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:09:14.899 DEBUG:teuthology.orchestra.run.trial109:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:09:14.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:09:14.902 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-17T11:09:14.947 INFO:teuthology.orchestra.run.trial109.stdout:5.15.0-164-generic 2026-02-17T11:09:14.947 INFO:teuthology.task.kernel:Running kernel on trial109: 5.15.0-164-generic 2026-02-17T11:09:14.947 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get clean 2026-02-17T11:09:15.009 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-17T11:09:15.484 INFO:teuthology.orchestra.run.trial109.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:09:15.567 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T11:09:15.884 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T11:09:16.025 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T11:09:16.156 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3236 kB] 2026-02-17T11:09:16.532 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T11:09:16.543 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T11:09:16.543 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T11:09:16.576 INFO:teuthology.orchestra.run.trial109.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T11:09:16.582 INFO:teuthology.orchestra.run.trial109.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T11:09:16.583 INFO:teuthology.orchestra.run.trial109.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T11:09:16.728 INFO:teuthology.orchestra.run.trial109.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T11:09:16.751 INFO:teuthology.orchestra.run.trial109.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T11:09:16.832 INFO:teuthology.orchestra.run.trial109.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T11:09:16.840 INFO:teuthology.orchestra.run.trial109.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T11:09:16.840 INFO:teuthology.orchestra.run.trial109.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T11:09:16.873 INFO:teuthology.orchestra.run.trial109.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T11:09:16.879 INFO:teuthology.orchestra.run.trial109.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T11:09:16.880 INFO:teuthology.orchestra.run.trial109.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T11:09:17.016 INFO:teuthology.orchestra.run.trial109.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T11:09:20.354 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 22.7 MB in 3s (8025 kB/s) 2026-02-17T11:09:20.883 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-17T11:09:20.897 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:09:20.930 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-17T11:09:21.040 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-17T11:09:21.040 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-17T11:09:21.126 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:09:21.126 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:09:21.126 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:09:21.126 INFO:teuthology.orchestra.run.trial109.stdout: sg3-utils-udev 2026-02-17T11:09:21.126 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:09:21.126 INFO:teuthology.orchestra.run.trial109.stdout:The following additional packages will be installed: 2026-02-17T11:09:21.127 INFO:teuthology.orchestra.run.trial109.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:09:21.127 INFO:teuthology.orchestra.run.trial109.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T11:09:21.127 INFO:teuthology.orchestra.run.trial109.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T11:09:21.127 INFO:teuthology.orchestra.run.trial109.stdout:Suggested packages: 2026-02-17T11:09:21.127 INFO:teuthology.orchestra.run.trial109.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T11:09:21.140 INFO:teuthology.orchestra.run.trial109.stdout:The following NEW packages will be installed: 2026-02-17T11:09:21.140 INFO:teuthology.orchestra.run.trial109.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:09:21.140 INFO:teuthology.orchestra.run.trial109.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T11:09:21.140 INFO:teuthology.orchestra.run.trial109.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T11:09:21.141 INFO:teuthology.orchestra.run.trial109.stdout:The following packages will be upgraded: 2026-02-17T11:09:21.141 INFO:teuthology.orchestra.run.trial109.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T11:09:21.236 INFO:teuthology.orchestra.run.trial109.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:09:21.236 INFO:teuthology.orchestra.run.trial109.stdout:Need to get 113 MB of archives. 2026-02-17T11:09:21.236 INFO:teuthology.orchestra.run.trial109.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T11:09:21.236 INFO:teuthology.orchestra.run.trial109.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T11:09:21.399 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T11:09:21.443 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T11:09:21.678 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T11:09:21.678 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T11:09:21.678 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T11:09:21.734 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T11:09:21.744 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T11:09:21.942 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 113 MB in 1s (189 MB/s) 2026-02-17T11:09:21.961 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T11:09:22.122 INFO:teuthology.orchestra.run.trial109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T11:09:22.123 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:09:22.125 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:22.470 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T11:09:22.477 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:09:22.496 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:22.536 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T11:09:22.543 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:09:22.543 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:23.675 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:09:23.676 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:09:23.698 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:09:23.700 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:09:23.716 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T11:09:23.723 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T11:09:23.723 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:09:25.096 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T11:09:25.108 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:09:25.108 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:25.716 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:09:25.716 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:09:25.741 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:09:25.743 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:25.744 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T11:09:25.746 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:26.522 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:27.348 INFO:teuthology.orchestra.run.trial109.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T11:09:27.349 INFO:teuthology.orchestra.run.trial109.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T11:09:27.354 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:28.158 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T11:09:28.159 INFO:teuthology.orchestra.run.trial109.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T11:09:28.160 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:09:28.165 INFO:teuthology.orchestra.run.trial109.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T11:09:28.166 INFO:teuthology.orchestra.run.trial109.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:09:35.247 INFO:teuthology.orchestra.run.trial109.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T11:09:41.883 INFO:teuthology.orchestra.run.trial109.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T11:09:41.883 INFO:teuthology.orchestra.run.trial109.stdout:Sourcing file `/etc/default/grub' 2026-02-17T11:09:41.903 INFO:teuthology.orchestra.run.trial109.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:09:41.904 INFO:teuthology.orchestra.run.trial109.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:09:41.906 INFO:teuthology.orchestra.run.trial109.stdout:Generating grub configuration file ... 2026-02-17T11:09:41.988 INFO:teuthology.orchestra.run.trial109.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:09:41.995 INFO:teuthology.orchestra.run.trial109.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:09:42.171 INFO:teuthology.orchestra.run.trial109.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:09:42.176 INFO:teuthology.orchestra.run.trial109.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:09:42.248 INFO:teuthology.orchestra.run.trial109.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:09:42.248 INFO:teuthology.orchestra.run.trial109.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:09:42.248 INFO:teuthology.orchestra.run.trial109.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:09:42.250 INFO:teuthology.orchestra.run.trial109.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:09:42.259 INFO:teuthology.orchestra.run.trial109.stdout:done 2026-02-17T11:09:42.661 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.661 INFO:teuthology.orchestra.run.trial109.stdout:Pending kernel upgrade! 2026-02-17T11:09:42.661 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.661 INFO:teuthology.orchestra.run.trial109.stdout:Running kernel version: 2026-02-17T11:09:42.662 INFO:teuthology.orchestra.run.trial109.stdout: 5.15.0-164-generic 2026-02-17T11:09:42.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.662 INFO:teuthology.orchestra.run.trial109.stdout:Diagnostics: 2026-02-17T11:09:42.662 INFO:teuthology.orchestra.run.trial109.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T11:09:42.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.662 INFO:teuthology.orchestra.run.trial109.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T11:09:42.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.663 INFO:teuthology.orchestra.run.trial109.stdout:The processor microcode seems to be up-to-date. 2026-02-17T11:09:42.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.663 INFO:teuthology.orchestra.run.trial109.stdout:No services need to be restarted. 2026-02-17T11:09:42.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.663 INFO:teuthology.orchestra.run.trial109.stdout:No containers need to be restarted. 2026-02-17T11:09:42.663 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.664 INFO:teuthology.orchestra.run.trial109.stdout:No user sessions are running outdated binaries. 2026-02-17T11:09:42.664 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:09:42.664 INFO:teuthology.orchestra.run.trial109.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T11:09:43.314 DEBUG:teuthology.orchestra.run.trial109:> dpkg -s linux-image-generic 2026-02-17T11:09:43.325 INFO:teuthology.orchestra.run.trial109.stdout:Package: linux-image-generic 2026-02-17T11:09:43.325 INFO:teuthology.orchestra.run.trial109.stdout:Status: install ok installed 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Priority: optional 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Section: kernel 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Installed-Size: 21 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Architecture: amd64 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Source: linux-meta 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Version: 5.15.0.170.159 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:09:43.326 INFO:teuthology.orchestra.run.trial109.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:09:43.327 INFO:teuthology.orchestra.run.trial109.stdout:Recommends: thermald 2026-02-17T11:09:43.327 INFO:teuthology.orchestra.run.trial109.stdout:Description: Generic Linux kernel image 2026-02-17T11:09:43.327 INFO:teuthology.orchestra.run.trial109.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:09:43.327 INFO:teuthology.orchestra.run.trial109.stdout: available. 2026-02-17T11:09:43.327 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T11:09:43.327 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:09:43.327 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:09:43.328 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:09:43.328 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial109.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:09:43.328 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get clean 2026-02-17T11:09:43.406 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-17T11:09:43.839 INFO:teuthology.orchestra.run.trial109.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:09:43.909 INFO:teuthology.orchestra.run.trial109.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T11:09:43.979 INFO:teuthology.orchestra.run.trial109.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T11:09:44.051 INFO:teuthology.orchestra.run.trial109.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T11:09:44.731 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-17T11:09:44.746 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:09:44.780 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-17T11:09:44.893 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-17T11:09:44.893 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-17T11:09:44.981 INFO:teuthology.orchestra.run.trial109.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T11:09:44.981 INFO:teuthology.orchestra.run.trial109.stdout:linux-image-generic set to manually installed. 2026-02-17T11:09:44.981 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:09:44.981 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:09:44.981 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:09:44.981 INFO:teuthology.orchestra.run.trial109.stdout: sg3-utils-udev 2026-02-17T11:09:44.981 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:09:45.001 INFO:teuthology.orchestra.run.trial109.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:09:45.004 DEBUG:teuthology.orchestra.run.trial109:> dpkg -s linux-image-generic 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Package: linux-image-generic 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Status: install ok installed 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Priority: optional 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Section: kernel 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Installed-Size: 21 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Architecture: amd64 2026-02-17T11:09:45.061 INFO:teuthology.orchestra.run.trial109.stdout:Source: linux-meta 2026-02-17T11:09:45.062 INFO:teuthology.orchestra.run.trial109.stdout:Version: 5.15.0.170.159 2026-02-17T11:09:45.062 INFO:teuthology.orchestra.run.trial109.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:09:45.062 INFO:teuthology.orchestra.run.trial109.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:09:45.062 INFO:teuthology.orchestra.run.trial109.stdout:Recommends: thermald 2026-02-17T11:09:45.062 INFO:teuthology.orchestra.run.trial109.stdout:Description: Generic Linux kernel image 2026-02-17T11:09:45.062 INFO:teuthology.orchestra.run.trial109.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:09:45.062 INFO:teuthology.orchestra.run.trial109.stdout: available. 2026-02-17T11:09:45.062 DEBUG:teuthology.orchestra.run.trial109:> mktemp 2026-02-17T11:09:45.107 INFO:teuthology.orchestra.run.trial109.stdout:/tmp/tmp.FXU6qXKAJV 2026-02-17T11:09:45.108 DEBUG:teuthology.orchestra.run.trial109:> sudo cp /boot/grub/grub.cfg /tmp/tmp.FXU6qXKAJV 2026-02-17T11:09:45.159 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 0666 /tmp/tmp.FXU6qXKAJV 2026-02-17T11:09:45.261 DEBUG:teuthology.orchestra.remote:trial109:/tmp/tmp.FXU6qXKAJV is 7KB 2026-02-17T11:09:45.269 DEBUG:teuthology.orchestra.run.trial109:> rm -fr /tmp/tmp.FXU6qXKAJV 2026-02-17T11:09:45.274 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T11:09:45.323 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:09:45.323 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T11:09:45.323 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T11:09:45.377 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T11:09:45.377 DEBUG:teuthology.orchestra.run.trial109:> sudo update-grub 2026-02-17T11:09:45.603 INFO:teuthology.orchestra.run.trial109.stderr:Sourcing file `/etc/default/grub' 2026-02-17T11:09:45.623 INFO:teuthology.orchestra.run.trial109.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:09:45.624 INFO:teuthology.orchestra.run.trial109.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:09:45.626 INFO:teuthology.orchestra.run.trial109.stderr:Generating grub configuration file ... 2026-02-17T11:09:45.706 INFO:teuthology.orchestra.run.trial109.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:09:45.712 INFO:teuthology.orchestra.run.trial109.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:09:45.885 INFO:teuthology.orchestra.run.trial109.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:09:45.891 INFO:teuthology.orchestra.run.trial109.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:09:45.959 INFO:teuthology.orchestra.run.trial109.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:09:45.959 INFO:teuthology.orchestra.run.trial109.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:09:45.959 INFO:teuthology.orchestra.run.trial109.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:09:45.961 INFO:teuthology.orchestra.run.trial109.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:09:45.968 INFO:teuthology.orchestra.run.trial109.stderr:done 2026-02-17T11:09:45.970 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial109 2026-02-17T11:09:45.970 DEBUG:teuthology.orchestra.run.trial109:> sudo bash -c ' 2026-02-17T11:09:45.970 DEBUG:teuthology.orchestra.run.trial109:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:09:45.971 DEBUG:teuthology.orchestra.run.trial109:> ' 2026-02-17T11:10:15.973 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T11:10:15.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-17T11:10:15.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:11:16.036 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T11:11:25.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-17T11:11:25.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:11:25.173 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-17T11:11:25.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-17T11:11:25.567 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T11:11:25.567 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-17T11:11:25.611 INFO:teuthology.orchestra.run.trial109.stdout:5.15.0-170-generic 2026-02-17T11:11:25.611 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T11:11:25.611 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:11:25.612 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T11:11:26.612 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T11:11:26.613 DEBUG:teuthology.orchestra.run.trial109:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:11:26.626 INFO:teuthology.orchestra.run.trial109.stdout:ttyS1 2026-02-17T11:11:26.645 DEBUG:teuthology.parallel:result is None 2026-02-17T11:11:26.646 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T11:11:26.657 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T11:11:26.657 DEBUG:teuthology.orchestra.run.trial109:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:11:26.691 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T11:11:26.705 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T11:11:26.717 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T11:11:26.718 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:11:26.742 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T11:11:26.753 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T11:11:26.753 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:11:26.788 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:11:26.795 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:11:26.796 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T11:11:26.808 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T11:11:26.808 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:11:26.848 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T11:11:26.863 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T11:11:26.864 DEBUG:teuthology.orchestra.run.trial109:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:11:26.895 DEBUG:teuthology.orchestra.run.trial109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:11:26.939 DEBUG:teuthology.orchestra.run.trial109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:11:26.987 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:11:26.987 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:11:27.035 DEBUG:teuthology.orchestra.run.trial109:> sudo service rsyslog restart 2026-02-17T11:11:27.092 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T11:11:27.105 INFO:teuthology.task.internal:Starting timer... 2026-02-17T11:11:27.105 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T11:11:27.127 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T11:11:27.144 DEBUG:teuthology.task.selinux:Excluding trial109: OS 'ubuntu' does not support SELinux 2026-02-17T11:11:27.145 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T11:11:27.145 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T11:11:27.145 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T11:11:27.145 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T11:11:27.160 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T11:11:27.164 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T11:11:27.275 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T11:11:27.286 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T11:11:27.287 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial109.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:13:55.269 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial109.front.sepia.ceph.com')] 2026-02-17T11:13:55.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-17T11:13:55.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:13:55.383 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-17T11:13:55.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-17T11:13:55.638 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:13:55.655 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:13:55.655 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:13:55.656 DEBUG:teuthology.orchestra.run.trial109:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:13:55.703 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T11:13:55.703 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Command line: ntpd -gq 2026-02-17T11:13:55.703 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: ---------------------------------------------------- 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: corporation. Support and training for ntp-4 are 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: available at https://www.nwtime.org/support 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: ---------------------------------------------------- 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: proto: precision = 0.030 usec (-25) 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: basedate set to 2022-02-04 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: gps base set to 2022-02-06 (week 2196) 2026-02-17T11:13:55.704 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T11:13:55.705 INFO:teuthology.orchestra.run.trial109.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T11:13:55.705 INFO:teuthology.orchestra.run.trial109.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T11:13:55.706 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T11:13:55.706 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T11:13:55.706 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T11:13:55.706 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T11:13:55.706 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Listen normally on 3 enp1s0f0 10.20.193.109:123 2026-02-17T11:13:55.706 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Listen normally on 4 lo [::1]:123 2026-02-17T11:13:55.706 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:61a2%2]:123 2026-02-17T11:13:55.707 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:13:55 ntpd[8786]: Listening on routing socket on fd #22 for interface updates 2026-02-17T11:13:56.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:56 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:13:56.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:56 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:13:56.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:57 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:13:56.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:57 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:13:56.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:57 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:13:56.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:57 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:13:58.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:58 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:13:58.707 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:58 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:13:58.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:13:58.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:13:58.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:13:58.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:13:59.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:13:59.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:13:59.707 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:13:59.707 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:13:59.707 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:13:59.707 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:13:59 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:00.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:00.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:00.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:00.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:00.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:00.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:00.705 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:00.705 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:00.706 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:14:00.706 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:00.711 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:00.711 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:00.711 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:14:00.711 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:00 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:00.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:00.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:00.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:14:00.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:01.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:01.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:01.708 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:01.708 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:01.708 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:14:01.708 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:01 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:02.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:02.703 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:02.704 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:02.704 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:02.704 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:02.704 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:02.706 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:02.706 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:02.706 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:14:02.706 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:02.711 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:02.711 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:02.711 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:14:02.712 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:02.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:03 ntpd[8786]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:14:02.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:03 ntpd[8786]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:14:02.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:03 ntpd[8786]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:14:02.841 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:03 ntpd[8786]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:14:02.841 INFO:teuthology.orchestra.run.trial109.stdout:17 Feb 11:14:02 ntpd[8786]: ntpd: time set -0.196968 s 2026-02-17T11:14:02.842 INFO:teuthology.orchestra.run.trial109.stdout:ntpd: time set -0.196968s 2026-02-17T11:14:02.842 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T11:14:02.842 INFO:teuthology.orchestra.run.trial109.stderr:17 Feb 11:14:02 ntpd[8786]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T11:14:02.934 INFO:teuthology.orchestra.run.trial109.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T11:14:02.934 INFO:teuthology.orchestra.run.trial109.stdout:============================================================================== 2026-02-17T11:14:02.934 INFO:teuthology.orchestra.run.trial109.stdout: sensei.ruselabs .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:14:02.934 INFO:teuthology.orchestra.run.trial109.stdout: 23.157.160.168 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:14:02.935 INFO:teuthology.orchestra.run.trial109.stdout: 198.137.202.32 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:14:02.935 INFO:teuthology.orchestra.run.trial109.stdout: mail.puresignal .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:14:02.936 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:14:02.952 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:14:02.952 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T11:14:02.952 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T11:14:02.952 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:14:02.961 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T11:14:02.961 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:14:02.961 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-key list | grep Ceph 2026-02-17T11:14:03.025 INFO:teuthology.orchestra.run.trial109.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T11:14:03.053 INFO:teuthology.orchestra.run.trial109.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T11:14:03.053 INFO:teuthology.orchestra.run.trial109.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T11:14:03.054 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T11:14:03.055 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:14:03.246 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default/ 2026-02-17T11:14:03.246 INFO:teuthology.task.install.deb:Package version is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:14:03.399 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:03.400 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T11:14:03.410 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-17T11:14:03.580 INFO:teuthology.orchestra.run.trial109.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T11:14:03.592 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-17T11:14:03.603 INFO:teuthology.orchestra.run.trial109.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T11:14:03.615 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T11:14:03.847 INFO:teuthology.orchestra.run.trial109.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:14:03.914 INFO:teuthology.orchestra.run.trial109.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T11:14:03.986 INFO:teuthology.orchestra.run.trial109.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T11:14:04.058 INFO:teuthology.orchestra.run.trial109.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T11:14:04.204 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 25.8 kB in 1s (40.8 kB/s) 2026-02-17T11:14:04.735 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-17T11:14:04.749 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-705-g04cf6dd4-1jammy cephadm=19.2.3-705-g04cf6dd4-1jammy ceph-mds=19.2.3-705-g04cf6dd4-1jammy ceph-mgr=19.2.3-705-g04cf6dd4-1jammy ceph-common=19.2.3-705-g04cf6dd4-1jammy ceph-fuse=19.2.3-705-g04cf6dd4-1jammy ceph-test=19.2.3-705-g04cf6dd4-1jammy ceph-volume=19.2.3-705-g04cf6dd4-1jammy radosgw=19.2.3-705-g04cf6dd4-1jammy python3-rados=19.2.3-705-g04cf6dd4-1jammy python3-rgw=19.2.3-705-g04cf6dd4-1jammy python3-cephfs=19.2.3-705-g04cf6dd4-1jammy python3-rbd=19.2.3-705-g04cf6dd4-1jammy libcephfs2=19.2.3-705-g04cf6dd4-1jammy libcephfs-dev=19.2.3-705-g04cf6dd4-1jammy librados2=19.2.3-705-g04cf6dd4-1jammy librbd1=19.2.3-705-g04cf6dd4-1jammy rbd-fuse=19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:14:04.782 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-17T11:14:04.892 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-17T11:14:04.893 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-17T11:14:04.983 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:14:04.983 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:14:04.983 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:14:04.983 INFO:teuthology.orchestra.run.trial109.stdout: sg3-utils-udev 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout:The following additional packages will be installed: 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T11:14:04.984 INFO:teuthology.orchestra.run.trial109.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T11:14:04.985 INFO:teuthology.orchestra.run.trial109.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout:Suggested packages: 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout:Recommended packages: 2026-02-17T11:14:04.986 INFO:teuthology.orchestra.run.trial109.stdout: btrfs-tools 2026-02-17T11:14:05.017 INFO:teuthology.orchestra.run.trial109.stdout:The following NEW packages will be installed: 2026-02-17T11:14:05.017 INFO:teuthology.orchestra.run.trial109.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T11:14:05.017 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T11:14:05.017 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T11:14:05.018 INFO:teuthology.orchestra.run.trial109.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T11:14:05.019 INFO:teuthology.orchestra.run.trial109.stdout: xmlstarlet zip 2026-02-17T11:14:05.094 INFO:teuthology.orchestra.run.trial109.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:14:05.094 INFO:teuthology.orchestra.run.trial109.stdout:Need to get 178 MB of archives. 2026-02-17T11:14:05.094 INFO:teuthology.orchestra.run.trial109.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T11:14:05.094 INFO:teuthology.orchestra.run.trial109.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-705-g04cf6dd4-1jammy [3593 kB] 2026-02-17T11:14:05.116 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T11:14:05.160 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T11:14:05.161 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T11:14:05.171 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T11:14:05.195 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-705-g04cf6dd4-1jammy [3257 kB] 2026-02-17T11:14:05.199 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T11:14:05.201 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T11:14:05.206 INFO:teuthology.orchestra.run.trial109.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T11:14:05.208 INFO:teuthology.orchestra.run.trial109.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T11:14:05.208 INFO:teuthology.orchestra.run.trial109.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T11:14:05.209 INFO:teuthology.orchestra.run.trial109.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T11:14:05.209 INFO:teuthology.orchestra.run.trial109.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T11:14:05.214 INFO:teuthology.orchestra.run.trial109.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T11:14:05.215 INFO:teuthology.orchestra.run.trial109.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T11:14:05.216 INFO:teuthology.orchestra.run.trial109.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T11:14:05.220 INFO:teuthology.orchestra.run.trial109.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T11:14:05.220 INFO:teuthology.orchestra.run.trial109.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T11:14:05.221 INFO:teuthology.orchestra.run.trial109.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T11:14:05.222 INFO:teuthology.orchestra.run.trial109.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T11:14:05.229 INFO:teuthology.orchestra.run.trial109.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T11:14:05.229 INFO:teuthology.orchestra.run.trial109.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T11:14:05.230 INFO:teuthology.orchestra.run.trial109.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T11:14:05.230 INFO:teuthology.orchestra.run.trial109.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T11:14:05.231 INFO:teuthology.orchestra.run.trial109.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T11:14:05.231 INFO:teuthology.orchestra.run.trial109.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T11:14:05.239 INFO:teuthology.orchestra.run.trial109.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T11:14:05.239 INFO:teuthology.orchestra.run.trial109.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T11:14:05.239 INFO:teuthology.orchestra.run.trial109.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T11:14:05.240 INFO:teuthology.orchestra.run.trial109.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T11:14:05.240 INFO:teuthology.orchestra.run.trial109.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-705-g04cf6dd4-1jammy [979 kB] 2026-02-17T11:14:05.248 INFO:teuthology.orchestra.run.trial109.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T11:14:05.249 INFO:teuthology.orchestra.run.trial109.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T11:14:05.249 INFO:teuthology.orchestra.run.trial109.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T11:14:05.249 INFO:teuthology.orchestra.run.trial109.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T11:14:05.250 INFO:teuthology.orchestra.run.trial109.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T11:14:05.250 INFO:teuthology.orchestra.run.trial109.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T11:14:05.255 INFO:teuthology.orchestra.run.trial109.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-705-g04cf6dd4-1jammy [357 kB] 2026-02-17T11:14:05.257 INFO:teuthology.orchestra.run.trial109.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T11:14:05.258 INFO:teuthology.orchestra.run.trial109.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T11:14:05.258 INFO:teuthology.orchestra.run.trial109.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T11:14:05.261 INFO:teuthology.orchestra.run.trial109.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-705-g04cf6dd4-1jammy [32.9 kB] 2026-02-17T11:14:05.262 INFO:teuthology.orchestra.run.trial109.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T11:14:05.262 INFO:teuthology.orchestra.run.trial109.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-705-g04cf6dd4-1jammy [184 kB] 2026-02-17T11:14:05.264 INFO:teuthology.orchestra.run.trial109.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-705-g04cf6dd4-1jammy [74.1 kB] 2026-02-17T11:14:05.266 INFO:teuthology.orchestra.run.trial109.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-705-g04cf6dd4-1jammy [337 kB] 2026-02-17T11:14:05.267 INFO:teuthology.orchestra.run.trial109.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T11:14:05.267 INFO:teuthology.orchestra.run.trial109.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T11:14:05.268 INFO:teuthology.orchestra.run.trial109.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T11:14:05.268 INFO:teuthology.orchestra.run.trial109.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T11:14:05.269 INFO:teuthology.orchestra.run.trial109.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T11:14:05.270 INFO:teuthology.orchestra.run.trial109.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T11:14:05.271 INFO:teuthology.orchestra.run.trial109.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-705-g04cf6dd4-1jammy [6935 kB] 2026-02-17T11:14:05.276 INFO:teuthology.orchestra.run.trial109.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T11:14:05.276 INFO:teuthology.orchestra.run.trial109.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T11:14:05.277 INFO:teuthology.orchestra.run.trial109.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T11:14:05.291 INFO:teuthology.orchestra.run.trial109.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T11:14:05.293 INFO:teuthology.orchestra.run.trial109.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T11:14:05.293 INFO:teuthology.orchestra.run.trial109.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T11:14:05.303 INFO:teuthology.orchestra.run.trial109.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T11:14:05.303 INFO:teuthology.orchestra.run.trial109.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T11:14:05.303 INFO:teuthology.orchestra.run.trial109.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T11:14:05.304 INFO:teuthology.orchestra.run.trial109.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T11:14:05.304 INFO:teuthology.orchestra.run.trial109.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T11:14:05.304 INFO:teuthology.orchestra.run.trial109.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T11:14:05.304 INFO:teuthology.orchestra.run.trial109.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T11:14:05.305 INFO:teuthology.orchestra.run.trial109.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T11:14:05.306 INFO:teuthology.orchestra.run.trial109.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T11:14:05.314 INFO:teuthology.orchestra.run.trial109.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T11:14:05.316 INFO:teuthology.orchestra.run.trial109.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T11:14:05.318 INFO:teuthology.orchestra.run.trial109.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T11:14:05.318 INFO:teuthology.orchestra.run.trial109.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T11:14:05.319 INFO:teuthology.orchestra.run.trial109.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T11:14:05.320 INFO:teuthology.orchestra.run.trial109.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T11:14:05.323 INFO:teuthology.orchestra.run.trial109.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T11:14:05.325 INFO:teuthology.orchestra.run.trial109.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T11:14:05.325 INFO:teuthology.orchestra.run.trial109.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T11:14:05.325 INFO:teuthology.orchestra.run.trial109.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T11:14:05.332 INFO:teuthology.orchestra.run.trial109.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T11:14:05.334 INFO:teuthology.orchestra.run.trial109.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T11:14:05.334 INFO:teuthology.orchestra.run.trial109.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T11:14:05.337 INFO:teuthology.orchestra.run.trial109.stdout:Get:82 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T11:14:05.337 INFO:teuthology.orchestra.run.trial109.stdout:Get:83 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T11:14:05.337 INFO:teuthology.orchestra.run.trial109.stdout:Get:84 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T11:14:05.342 INFO:teuthology.orchestra.run.trial109.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T11:14:05.342 INFO:teuthology.orchestra.run.trial109.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T11:14:05.386 INFO:teuthology.orchestra.run.trial109.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-705-g04cf6dd4-1jammy [112 kB] 2026-02-17T11:14:05.386 INFO:teuthology.orchestra.run.trial109.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-705-g04cf6dd4-1jammy [470 kB] 2026-02-17T11:14:05.394 INFO:teuthology.orchestra.run.trial109.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-705-g04cf6dd4-1jammy [26.5 MB] 2026-02-17T11:14:05.832 INFO:teuthology.orchestra.run.trial109.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-705-g04cf6dd4-1jammy [5178 kB] 2026-02-17T11:14:05.914 INFO:teuthology.orchestra.run.trial109.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-705-g04cf6dd4-1jammy [248 kB] 2026-02-17T11:14:05.917 INFO:teuthology.orchestra.run.trial109.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-705-g04cf6dd4-1jammy [125 kB] 2026-02-17T11:14:05.919 INFO:teuthology.orchestra.run.trial109.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-705-g04cf6dd4-1jammy [1081 kB] 2026-02-17T11:14:05.937 INFO:teuthology.orchestra.run.trial109.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-705-g04cf6dd4-1jammy [6239 kB] 2026-02-17T11:14:06.040 INFO:teuthology.orchestra.run.trial109.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-705-g04cf6dd4-1jammy [23.0 MB] 2026-02-17T11:14:06.420 INFO:teuthology.orchestra.run.trial109.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-705-g04cf6dd4-1jammy [14.2 kB] 2026-02-17T11:14:06.420 INFO:teuthology.orchestra.run.trial109.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [1173 kB] 2026-02-17T11:14:06.435 INFO:teuthology.orchestra.run.trial109.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-705-g04cf6dd4-1jammy [2503 kB] 2026-02-17T11:14:06.476 INFO:teuthology.orchestra.run.trial109.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-705-g04cf6dd4-1jammy [798 kB] 2026-02-17T11:14:06.489 INFO:teuthology.orchestra.run.trial109.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-705-g04cf6dd4-1jammy [157 kB] 2026-02-17T11:14:06.492 INFO:teuthology.orchestra.run.trial109.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-705-g04cf6dd4-1jammy [2396 kB] 2026-02-17T11:14:06.531 INFO:teuthology.orchestra.run.trial109.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-705-g04cf6dd4-1jammy [8625 kB] 2026-02-17T11:14:06.673 INFO:teuthology.orchestra.run.trial109.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-705-g04cf6dd4-1jammy [14.3 kB] 2026-02-17T11:14:06.674 INFO:teuthology.orchestra.run.trial109.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-705-g04cf6dd4-1jammy [52.1 MB] 2026-02-17T11:14:07.534 INFO:teuthology.orchestra.run.trial109.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-705-g04cf6dd4-1jammy [135 kB] 2026-02-17T11:14:07.535 INFO:teuthology.orchestra.run.trial109.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-705-g04cf6dd4-1jammy [41.0 kB] 2026-02-17T11:14:07.535 INFO:teuthology.orchestra.run.trial109.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-705-g04cf6dd4-1jammy [13.7 MB] 2026-02-17T11:14:07.755 INFO:teuthology.orchestra.run.trial109.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [92.1 kB] 2026-02-17T11:14:08.077 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 178 MB in 3s (64.9 MB/s) 2026-02-17T11:14:08.093 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T11:14:08.251 INFO:teuthology.orchestra.run.trial109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T11:14:08.253 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T11:14:08.254 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T11:14:08.275 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T11:14:08.287 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T11:14:08.287 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T11:14:08.307 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T11:14:08.315 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T11:14:08.315 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T11:14:08.336 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T11:14:08.344 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T11:14:08.349 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:14:08.381 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T11:14:08.389 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T11:14:08.389 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:14:08.406 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T11:14:08.414 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T11:14:08.415 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:14:08.435 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T11:14:08.443 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T11:14:08.444 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T11:14:08.460 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librados2. 2026-02-17T11:14:08.468 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../007-librados2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:08.468 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.510 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libnbd0. 2026-02-17T11:14:08.518 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T11:14:08.518 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T11:14:08.534 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librbd1. 2026-02-17T11:14:08.543 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../009-librbd1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:08.543 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.586 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T11:14:08.594 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:08.595 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.615 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rados. 2026-02-17T11:14:08.623 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../011-python3-rados_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:08.624 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.641 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T11:14:08.649 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:08.650 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.665 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T11:14:08.673 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:08.673 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.689 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T11:14:08.697 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:08.698 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.716 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T11:14:08.724 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T11:14:08.725 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T11:14:08.741 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T11:14:08.749 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T11:14:08.749 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T11:14:08.764 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T11:14:08.772 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:08.773 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:08.790 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T11:14:08.798 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T11:14:08.799 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T11:14:08.816 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T11:14:08.824 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T11:14:08.825 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T11:14:08.843 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T11:14:08.851 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T11:14:08.852 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T11:14:08.869 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package lua5.1. 2026-02-17T11:14:08.877 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T11:14:08.878 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T11:14:08.898 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package lua-any. 2026-02-17T11:14:08.906 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T11:14:08.939 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T11:14:08.939 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package zip. 2026-02-17T11:14:08.939 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T11:14:08.939 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T11:14:08.949 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package unzip. 2026-02-17T11:14:08.957 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T11:14:08.957 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T11:14:08.976 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package luarocks. 2026-02-17T11:14:08.984 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T11:14:08.985 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T11:14:09.023 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librgw2. 2026-02-17T11:14:09.031 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../026-librgw2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:09.032 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:09.105 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T11:14:09.113 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:09.114 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:09.128 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T11:14:09.137 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T11:14:09.137 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T11:14:09.153 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T11:14:09.162 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:09.162 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:09.181 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-common. 2026-02-17T11:14:09.190 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../030-ceph-common_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:09.190 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:09.393 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-base. 2026-02-17T11:14:09.402 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../031-ceph-base_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:09.407 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:09.471 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T11:14:09.480 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T11:14:09.481 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T11:14:09.495 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T11:14:09.503 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T11:14:09.503 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T11:14:09.521 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T11:14:09.529 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T11:14:09.530 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T11:14:09.545 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T11:14:09.553 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T11:14:09.553 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T11:14:09.568 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T11:14:09.577 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T11:14:09.578 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T11:14:09.592 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T11:14:09.600 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T11:14:09.600 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T11:14:09.616 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-portend. 2026-02-17T11:14:09.624 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T11:14:09.625 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T11:14:09.640 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T11:14:09.648 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T11:14:09.648 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T11:14:09.663 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T11:14:09.671 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T11:14:09.672 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T11:14:09.695 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T11:14:09.703 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T11:14:09.704 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T11:14:09.720 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T11:14:09.728 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T11:14:09.729 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T11:14:09.743 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-mako. 2026-02-17T11:14:09.751 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T11:14:09.752 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T11:14:09.769 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T11:14:09.778 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T11:14:09.778 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T11:14:09.793 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T11:14:09.801 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T11:14:09.801 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T11:14:09.816 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-webob. 2026-02-17T11:14:09.825 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T11:14:09.825 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T11:14:09.843 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T11:14:09.851 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T11:14:09.853 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T11:14:09.869 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T11:14:09.878 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T11:14:09.878 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T11:14:09.892 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-paste. 2026-02-17T11:14:09.900 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T11:14:09.901 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T11:14:09.930 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T11:14:09.938 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T11:14:09.938 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T11:14:09.953 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T11:14:09.961 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T11:14:09.961 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T11:14:09.977 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T11:14:09.985 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T11:14:09.986 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T11:14:10.001 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T11:14:10.009 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T11:14:10.009 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T11:14:10.035 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T11:14:10.043 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T11:14:10.043 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T11:14:10.064 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T11:14:10.072 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:10.072 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.102 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T11:14:10.110 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.110 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.126 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T11:14:10.135 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.135 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.157 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T11:14:10.165 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.166 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.222 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T11:14:10.231 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T11:14:10.231 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T11:14:10.248 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T11:14:10.256 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.257 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.418 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph. 2026-02-17T11:14:10.426 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../061-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.427 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.442 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T11:14:10.450 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.450 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.475 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T11:14:10.483 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.483 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.517 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package cephadm. 2026-02-17T11:14:10.526 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../064-cephadm_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:10.526 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.542 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T11:14:10.551 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T11:14:10.551 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T11:14:10.572 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T11:14:10.581 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:10.581 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.601 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T11:14:10.610 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T11:14:10.610 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T11:14:10.625 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-routes. 2026-02-17T11:14:10.634 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T11:14:10.634 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T11:14:10.653 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T11:14:10.661 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:10.662 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:10.863 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T11:14:10.872 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T11:14:10.872 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T11:14:10.910 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T11:14:10.919 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T11:14:10.919 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T11:14:10.947 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T11:14:10.955 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T11:14:10.955 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T11:14:10.970 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T11:14:10.978 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T11:14:10.979 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T11:14:11.061 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T11:14:11.070 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:11.070 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:11.239 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T11:14:11.248 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T11:14:11.248 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T11:14:11.263 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T11:14:11.271 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T11:14:11.272 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T11:14:11.288 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T11:14:11.297 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T11:14:11.297 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T11:14:11.315 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T11:14:11.324 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T11:14:11.324 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T11:14:11.339 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T11:14:11.347 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T11:14:11.348 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T11:14:11.366 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T11:14:11.374 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T11:14:11.374 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T11:14:11.469 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T11:14:11.477 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:11.477 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:11.493 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T11:14:11.501 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T11:14:11.508 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T11:14:11.523 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T11:14:11.532 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T11:14:11.532 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T11:14:11.548 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package jq. 2026-02-17T11:14:11.557 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T11:14:11.557 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T11:14:11.572 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package socat. 2026-02-17T11:14:11.581 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T11:14:11.581 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T11:14:11.601 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T11:14:11.609 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T11:14:11.610 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T11:14:11.646 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-test. 2026-02-17T11:14:11.655 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../087-ceph-test_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:11.655 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:12.105 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T11:14:12.114 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:14:12.114 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:12.138 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T11:14:12.147 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:12.147 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:12.164 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T11:14:12.172 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T11:14:12.173 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T11:14:12.194 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T11:14:12.202 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T11:14:12.203 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T11:14:12.221 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T11:14:12.229 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T11:14:12.230 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T11:14:12.261 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package pkg-config. 2026-02-17T11:14:12.269 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T11:14:12.270 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T11:14:12.287 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T11:14:12.296 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T11:14:12.296 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T11:14:12.326 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T11:14:12.335 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T11:14:12.335 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T11:14:12.351 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T11:14:12.360 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T11:14:12.360 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T11:14:12.378 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T11:14:12.387 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T11:14:12.387 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T11:14:12.404 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T11:14:12.413 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T11:14:12.413 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T11:14:12.432 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-py. 2026-02-17T11:14:12.441 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T11:14:12.441 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T11:14:12.462 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T11:14:12.470 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T11:14:12.471 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T11:14:12.513 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T11:14:12.522 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T11:14:12.522 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T11:14:12.539 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-toml. 2026-02-17T11:14:12.548 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T11:14:12.548 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T11:14:12.563 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T11:14:12.572 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T11:14:12.572 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T11:14:12.595 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T11:14:12.603 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T11:14:12.604 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T11:14:12.622 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T11:14:12.631 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T11:14:12.631 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T11:14:12.704 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package radosgw. 2026-02-17T11:14:12.713 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../106-radosgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:12.713 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:12.828 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T11:14:12.837 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:14:12.838 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:12.867 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T11:14:12.934 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T11:14:12.935 INFO:teuthology.orchestra.run.trial109.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T11:14:13.006 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:14:13.282 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T11:14:13.658 INFO:teuthology.orchestra.run.trial109.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T11:14:13.669 INFO:teuthology.orchestra.run.trial109.stdout:Setting up cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:13.725 INFO:teuthology.orchestra.run.trial109.stdout:Adding system user cephadm....done 2026-02-17T11:14:13.737 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T11:14:13.809 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T11:14:13.882 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T11:14:13.883 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T11:14:13.955 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T11:14:14.030 INFO:teuthology.orchestra.run.trial109.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T11:14:14.030 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T11:14:14.127 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T11:14:14.249 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T11:14:14.329 INFO:teuthology.orchestra.run.trial109.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T11:14:14.341 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T11:14:14.408 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T11:14:14.480 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:14.545 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T11:14:14.546 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T11:14:14.547 INFO:teuthology.orchestra.run.trial109.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T11:14:14.548 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T11:14:14.549 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T11:14:14.549 INFO:teuthology.orchestra.run.trial109.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T11:14:14.567 INFO:teuthology.orchestra.run.trial109.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T11:14:14.568 INFO:teuthology.orchestra.run.trial109.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T11:14:14.569 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T11:14:14.571 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T11:14:14.694 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T11:14:14.772 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T11:14:14.844 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T11:14:14.930 INFO:teuthology.orchestra.run.trial109.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T11:14:14.931 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T11:14:15.180 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T11:14:15.259 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T11:14:15.260 INFO:teuthology.orchestra.run.trial109.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T11:14:15.261 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T11:14:15.356 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T11:14:15.480 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T11:14:15.606 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T11:14:15.687 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T11:14:15.791 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T11:14:15.863 INFO:teuthology.orchestra.run.trial109.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T11:14:15.864 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:15.952 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T11:14:16.446 INFO:teuthology.orchestra.run.trial109.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T11:14:16.467 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:14:16.472 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T11:14:16.547 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T11:14:16.548 INFO:teuthology.orchestra.run.trial109.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T11:14:16.549 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T11:14:16.625 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T11:14:16.698 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:14:16.699 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T11:14:16.776 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T11:14:16.848 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T11:14:16.923 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T11:14:16.997 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T11:14:17.070 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T11:14:17.153 INFO:teuthology.orchestra.run.trial109.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T11:14:17.154 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T11:14:17.237 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T11:14:17.238 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T11:14:17.318 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T11:14:17.400 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T11:14:17.485 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T11:14:17.559 INFO:teuthology.orchestra.run.trial109.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T11:14:17.560 INFO:teuthology.orchestra.run.trial109.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T11:14:17.561 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T11:14:17.562 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T11:14:17.700 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T11:14:17.778 INFO:teuthology.orchestra.run.trial109.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T11:14:17.779 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T11:14:17.855 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:14:17.856 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T11:14:17.943 INFO:teuthology.orchestra.run.trial109.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T11:14:17.944 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T11:14:18.027 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T11:14:18.160 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T11:14:18.249 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T11:14:18.362 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T11:14:18.363 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:18.364 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:18.365 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T11:14:18.881 INFO:teuthology.orchestra.run.trial109.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T11:14:18.892 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:18.893 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:18.894 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:18.895 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:18.895 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:18.960 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T11:14:18.960 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T11:14:19.343 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.344 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.345 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.346 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.347 INFO:teuthology.orchestra.run.trial109.stdout:Setting up rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.348 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.348 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.349 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:19.378 INFO:teuthology.orchestra.run.trial109.stdout:Adding group ceph....done 2026-02-17T11:14:19.415 INFO:teuthology.orchestra.run.trial109.stdout:Adding system user ceph....done 2026-02-17T11:14:19.425 INFO:teuthology.orchestra.run.trial109.stdout:Setting system user ceph properties....done 2026-02-17T11:14:19.430 INFO:teuthology.orchestra.run.trial109.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T11:14:19.517 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T11:14:19.782 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T11:14:20.165 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:20.166 INFO:teuthology.orchestra.run.trial109.stdout:Setting up radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:20.426 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:14:20.427 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:14:20.818 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:20.895 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T11:14:21.276 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:21.334 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T11:14:21.334 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T11:14:21.736 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:21.818 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T11:14:21.818 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T11:14:22.207 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:22.292 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T11:14:22.292 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T11:14:22.679 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:22.680 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:22.690 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:22.765 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T11:14:22.766 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T11:14:23.144 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:23.154 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:23.154 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:23.165 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:14:23.276 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T11:14:23.285 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T11:14:23.530 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T11:14:23.616 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T11:14:24.101 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:24.101 INFO:teuthology.orchestra.run.trial109.stdout:Running kernel seems to be up-to-date. 2026-02-17T11:14:24.101 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:24.101 INFO:teuthology.orchestra.run.trial109.stdout:The processor microcode seems to be up-to-date. 2026-02-17T11:14:24.101 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:24.101 INFO:teuthology.orchestra.run.trial109.stdout:No services need to be restarted. 2026-02-17T11:14:24.101 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:24.102 INFO:teuthology.orchestra.run.trial109.stdout:No containers need to be restarted. 2026-02-17T11:14:24.102 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:24.102 INFO:teuthology.orchestra.run.trial109.stdout:No user sessions are running outdated binaries. 2026-02-17T11:14:24.102 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:24.102 INFO:teuthology.orchestra.run.trial109.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T11:14:24.750 INFO:teuthology.orchestra.run.trial109.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T11:14:24.756 DEBUG:teuthology.parallel:result is None 2026-02-17T11:14:24.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:14:24.925 DEBUG:teuthology.orchestra.run.trial109:> dpkg-query -W -f '${Version}' ceph 2026-02-17T11:14:24.936 INFO:teuthology.orchestra.run.trial109.stdout:19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:14:24.936 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:14:24.936 INFO:teuthology.task.install:The correct ceph version 19.2.3-705-g04cf6dd4-1jammy is installed. 2026-02-17T11:14:24.939 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:14:24.939 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:24.939 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:14:24.987 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:14:24.987 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:24.987 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:14:25.037 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:14:25.085 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:14:25.085 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:25.085 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:14:25.134 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:14:25.189 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:14:25.189 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:25.189 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:14:25.237 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:14:25.289 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T11:14:25.404 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T11:14:25.404 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 777 /var/log/ceph 2026-02-17T11:14:25.413 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T11:14:25.413 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:14:25.460 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T11:14:25.461 DEBUG:teuthology.orchestra.run.trial109:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:14:25.521 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T11:14:25.522 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T11:14:25.522 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51274', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51274', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial109.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOY3w513Umw3iZaHRNagFlrJ66T9AQ/rf9p3JIN1W59SsUtVWgctD3B5bUKyFdEbs/NaO1Rei3NsU+Q3Om1XaY4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'cluster': 'ceph'}}, {'divergent_priors2': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T11:14:25.522 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:14:25.561 DEBUG:teuthology.orchestra.run.trial109:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:14:25.609 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:25.609 DEBUG:teuthology.orchestra.run.trial109:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:14:25.654 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:14:25.654 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_1 2026-02-17T11:14:25.701 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:14:25.701 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:14:25.702 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 901 Links: 1 2026-02-17T11:14:25.702 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:14:25.702 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-17 11:13:42.849101691 +0000 2026-02-17T11:14:25.702 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-17 11:13:42.701106406 +0000 2026-02-17T11:14:25.702 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-17 11:13:42.701106406 +0000 2026-02-17T11:14:25.702 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-17T11:14:25.702 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:14:25.752 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-17T11:14:25.753 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-17T11:14:25.753 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.000188738 s, 2.7 MB/s 2026-02-17T11:14:25.754 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:14:25.804 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_2 2026-02-17T11:14:25.848 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:14:25.848 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:14:25.849 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 925 Links: 1 2026-02-17T11:14:25.849 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:14:25.849 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-17 11:13:43.201090477 +0000 2026-02-17T11:14:25.849 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-17 11:13:43.017096339 +0000 2026-02-17T11:14:25.849 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-17 11:13:43.017096339 +0000 2026-02-17T11:14:25.849 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-17T11:14:25.849 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:14:25.896 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-17T11:14:25.897 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-17T11:14:25.897 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.000179621 s, 2.9 MB/s 2026-02-17T11:14:25.898 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:14:25.946 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_3 2026-02-17T11:14:25.997 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:14:25.998 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:14:25.998 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 947 Links: 1 2026-02-17T11:14:25.998 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:14:25.998 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-17 11:13:43.537079770 +0000 2026-02-17T11:14:25.998 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-17 11:13:43.365085251 +0000 2026-02-17T11:14:25.998 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-17 11:13:43.365085251 +0000 2026-02-17T11:14:25.998 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-17T11:14:25.999 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:14:26.048 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-17T11:14:26.049 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-17T11:14:26.049 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.000174452 s, 2.9 MB/s 2026-02-17T11:14:26.050 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:14:26.098 DEBUG:teuthology.orchestra.run.trial109:> stat /dev/vg_nvme/lv_4 2026-02-17T11:14:26.145 INFO:teuthology.orchestra.run.trial109.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:14:26.145 INFO:teuthology.orchestra.run.trial109.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:14:26.145 INFO:teuthology.orchestra.run.trial109.stdout:Device: 5h/5d Inode: 970 Links: 1 2026-02-17T11:14:26.146 INFO:teuthology.orchestra.run.trial109.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:14:26.146 INFO:teuthology.orchestra.run.trial109.stdout:Access: 2026-02-17 11:13:43.897068300 +0000 2026-02-17T11:14:26.146 INFO:teuthology.orchestra.run.trial109.stdout:Modify: 2026-02-17 11:13:43.705074418 +0000 2026-02-17T11:14:26.146 INFO:teuthology.orchestra.run.trial109.stdout:Change: 2026-02-17 11:13:43.705074418 +0000 2026-02-17T11:14:26.146 INFO:teuthology.orchestra.run.trial109.stdout: Birth: - 2026-02-17T11:14:26.146 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:14:26.192 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records in 2026-02-17T11:14:26.193 INFO:teuthology.orchestra.run.trial109.stderr:1+0 records out 2026-02-17T11:14:26.193 INFO:teuthology.orchestra.run.trial109.stderr:512 bytes copied, 0.000165745 s, 3.1 MB/s 2026-02-17T11:14:26.194 DEBUG:teuthology.orchestra.run.trial109:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:14:26.243 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:14:26.243 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial109.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T11:14:26.243 INFO:tasks.ceph:Generating config... 2026-02-17T11:14:26.245 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T11:14:26.245 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T11:14:26.246 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T11:14:26.246 INFO:tasks.ceph:[global] ms type = async 2026-02-17T11:14:26.246 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T11:14:26.246 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T11:14:26.246 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T11:14:26.246 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T11:14:26.246 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T11:14:26.246 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T11:14:26.246 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T11:14:26.246 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2026-02-17T11:14:26.246 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T11:14:26.247 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T11:14:26.248 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T11:14:26.248 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T11:14:26.248 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T11:14:26.248 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T11:14:26.248 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T11:14:26.248 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T11:14:26.248 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T11:14:26.302 INFO:teuthology.orchestra.run.trial109.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T11:14:26.305 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T11:14:26.364 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:14:26.413 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.109')] 2026-02-17T11:14:26.414 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.109', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T11:14:26.414 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:26.415 DEBUG:teuthology.orchestra.run.trial109:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:14:26.457 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.109 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:14:26.513 INFO:teuthology.orchestra.run.trial109.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:14:26.513 INFO:teuthology.orchestra.run.trial109.stdout:monmaptool: generated fsid 145943f2-efc8-4ce6-8d3c-254689d8dfe1 2026-02-17T11:14:26.513 INFO:teuthology.orchestra.run.trial109.stdout:setting min_mon_release = quincy 2026-02-17T11:14:26.513 INFO:teuthology.orchestra.run.trial109.stdout:epoch 0 2026-02-17T11:14:26.513 INFO:teuthology.orchestra.run.trial109.stdout:fsid 145943f2-efc8-4ce6-8d3c-254689d8dfe1 2026-02-17T11:14:26.513 INFO:teuthology.orchestra.run.trial109.stdout:last_changed 2026-02-17T11:14:26.549502+0000 2026-02-17T11:14:26.513 INFO:teuthology.orchestra.run.trial109.stdout:created 2026-02-17T11:14:26.549502+0000 2026-02-17T11:14:26.514 INFO:teuthology.orchestra.run.trial109.stdout:min_mon_release 17 (quincy) 2026-02-17T11:14:26.514 INFO:teuthology.orchestra.run.trial109.stdout:election_strategy: 1 2026-02-17T11:14:26.514 INFO:teuthology.orchestra.run.trial109.stdout:0: [v2:10.20.193.109:3300/0,v1:10.20.193.109:6789/0] mon.a 2026-02-17T11:14:26.514 INFO:teuthology.orchestra.run.trial109.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T11:14:26.516 DEBUG:teuthology.orchestra.run.trial109:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:14:26.561 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 145943f2-efc8-4ce6-8d3c-254689d8dfe1... 2026-02-17T11:14:26.562 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:14:26.622 INFO:teuthology.orchestra.run.trial109.stdout:[global] 2026-02-17T11:14:26.622 INFO:teuthology.orchestra.run.trial109.stdout: chdir = "" 2026-02-17T11:14:26.622 INFO:teuthology.orchestra.run.trial109.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:14:26.622 INFO:teuthology.orchestra.run.trial109.stdout: auth supported = cephx 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: filestore xattr use omap = true 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: mon clock drift allowed = 1.000 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: osd crush chooseleaf type = 0 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: auth debug = true 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: ms die on old message = true 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: ms die on bug = true 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.623 INFO:teuthology.orchestra.run.trial109.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon pg warn max object skew = 0 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: osd pool default size = 2 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon osd allow primary affinity = true 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon osd allow pg remap = true 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on no sortbitwise = false 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:14:26.624 INFO:teuthology.orchestra.run.trial109.stdout: mon warn on too few osds = false 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: mon_allow_pool_size_one = true 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: osd default data pool replay window = 5 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: mon allow pool delete = true 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: mon cluster log file level = debug 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: debug asserts on shutdown = true 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: mon health detail to clog = false 2026-02-17T11:14:26.625 INFO:teuthology.orchestra.run.trial109.stdout: mon host = 10.20.193.109 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: mon client directed command retry = 5 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: mon election default strategy = 1 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: ms inject socket failures = 5000 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: ms type = async 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: fsid = 145943f2-efc8-4ce6-8d3c-254689d8dfe1 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout:[osd] 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: osd journal size = 100 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: osd scrub load threshold = 5.0 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: osd scrub max interval = 600 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.626 INFO:teuthology.orchestra.run.trial109.stdout: osd recover clone overlap = true 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd recovery max chunk = 1048576 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd debug shutdown = true 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd debug op order = true 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd debug verify stray on activate = true 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd debug trim objects = true 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd open classes on start = true 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd debug pg log writeout = true 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: osd map max advance = 10 2026-02-17T11:14:26.627 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: journal zero on create = true 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: filestore apply finisher threads = 3 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: bdev debug aio = true 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: osd debug misdirected ops = true 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: bluestore block size = 96636764160 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: bluestore compression algorithm = snappy 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: bluestore compression mode = aggressive 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: bluestore fsck on mount = True 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: bluestore zero block detection = True 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: debug bluefs = 20 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: debug bluestore = 20 2026-02-17T11:14:26.628 INFO:teuthology.orchestra.run.trial109.stdout: debug ms = 1 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: debug osd = 20 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: debug rocksdb = 10 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: mon osd full ratio = 0.9 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: osd debug verify cached snaps = True 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: osd debug verify missing on start = True 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: osd mclock override recovery settings = True 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: osd objectstore = bluestore 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: osd op queue = debug_random 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: osd op queue cut off = debug_random 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout:[mgr] 2026-02-17T11:14:26.629 INFO:teuthology.orchestra.run.trial109.stdout: debug ms = 1 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: debug mgr = 20 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: debug mon = 20 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: debug auth = 20 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: mgr/telemetry/nag = false 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout:[mon] 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: debug ms = 1 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: debug mon = 20 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: debug paxos = 20 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: debug auth = 20 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: mon data avail warn = 5 2026-02-17T11:14:26.630 INFO:teuthology.orchestra.run.trial109.stdout: mon mgr mkfs grace = 240 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: mon osd reporter subtree level = osd 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: mon osd prime pg temp = true 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.631 INFO:teuthology.orchestra.run.trial109.stdout: # 1m isn't quite enough 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: mon scrub interval = 300 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout:[client] 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: rgw cache enabled = true 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: rgw enable ops log = true 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: rgw enable usage log = true 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:14:26.632 INFO:teuthology.orchestra.run.trial109.stdout:[mon.a] 2026-02-17T11:14:26.633 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T11:14:26.634 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T11:14:26.700 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T11:14:26.700 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:26.700 DEBUG:teuthology.orchestra.run.trial109:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T11:14:26.747 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:26.747 DEBUG:teuthology.orchestra.run.trial109:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T11:14:26.794 INFO:tasks.ceph:Sending monmap to node ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:14:26.794 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:26.794 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:14:26.794 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:14:26.853 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:26.853 DEBUG:teuthology.orchestra.run.trial109:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:14:26.898 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T11:14:26.899 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T11:14:26.899 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:14:26.964 INFO:teuthology.orchestra.run.trial109.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:14:26.966 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T11:14:26.966 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T11:14:26.967 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T11:14:27.032 INFO:teuthology.orchestra.run.trial109.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T11:14:27.040 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T11:14:27.041 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial109.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T11:14:27.041 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T11:14:27.089 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:14:27.090 INFO:tasks.ceph:role: osd.0 2026-02-17T11:14:27.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:14:27.090 DEBUG:teuthology.orchestra.run.trial109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:14:27.143 INFO:teuthology.orchestra.run.trial109.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:14:27.143 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:14:27.143 INFO:teuthology.orchestra.run.trial109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:14:27.143 INFO:teuthology.orchestra.run.trial109.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T11:14:27.143 INFO:teuthology.orchestra.run.trial109.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:14:27.143 INFO:teuthology.orchestra.run.trial109.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:14:27.144 INFO:teuthology.orchestra.run.trial109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:14:27.144 INFO:teuthology.orchestra.run.trial109.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:14:27.144 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:14:27.144 INFO:teuthology.orchestra.run.trial109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:14:27.718 INFO:teuthology.orchestra.run.trial109.stdout:Discarding blocks...Done. 2026-02-17T11:14:27.720 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial109.front.sepia.ceph.com -o noatime 2026-02-17T11:14:27.720 DEBUG:teuthology.orchestra.run.trial109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T11:14:27.778 DEBUG:teuthology.orchestra.run.trial109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T11:14:27.827 INFO:teuthology.orchestra.run.trial109.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T11:14:27.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:14:27.828 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T11:14:27.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:14:27.879 INFO:tasks.ceph:role: osd.1 2026-02-17T11:14:27.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:14:27.880 DEBUG:teuthology.orchestra.run.trial109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:14:27.931 INFO:teuthology.orchestra.run.trial109.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:14:27.932 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:14:27.932 INFO:teuthology.orchestra.run.trial109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:14:28.496 INFO:teuthology.orchestra.run.trial109.stdout:Discarding blocks...Done. 2026-02-17T11:14:28.498 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial109.front.sepia.ceph.com -o noatime 2026-02-17T11:14:28.498 DEBUG:teuthology.orchestra.run.trial109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T11:14:28.559 DEBUG:teuthology.orchestra.run.trial109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T11:14:28.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:14:28.608 INFO:teuthology.orchestra.run.trial109.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T11:14:28.609 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T11:14:28.659 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T11:14:28.659 INFO:tasks.ceph:role: osd.2 2026-02-17T11:14:28.659 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:14:28.659 DEBUG:teuthology.orchestra.run.trial109:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:14:28.711 INFO:teuthology.orchestra.run.trial109.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:14:28.712 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:14:28.712 INFO:teuthology.orchestra.run.trial109.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:14:28.712 INFO:teuthology.orchestra.run.trial109.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T11:14:28.712 INFO:teuthology.orchestra.run.trial109.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:14:28.712 INFO:teuthology.orchestra.run.trial109.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:14:28.712 INFO:teuthology.orchestra.run.trial109.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:14:28.712 INFO:teuthology.orchestra.run.trial109.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:14:28.713 INFO:teuthology.orchestra.run.trial109.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:14:28.713 INFO:teuthology.orchestra.run.trial109.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:14:29.277 INFO:teuthology.orchestra.run.trial109.stdout:Discarding blocks...Done. 2026-02-17T11:14:29.278 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial109.front.sepia.ceph.com -o noatime 2026-02-17T11:14:29.279 DEBUG:teuthology.orchestra.run.trial109:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T11:14:29.338 DEBUG:teuthology.orchestra.run.trial109:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T11:14:29.391 INFO:teuthology.orchestra.run.trial109.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T11:14:29.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:14:29.392 DEBUG:teuthology.orchestra.run.trial109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:14:29.454 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:29.487+0000 7fb4fc7408c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T11:14:29.455 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:29.487+0000 7fb4fc7408c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T11:14:29.455 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:29.487+0000 7fb4fc7408c0 -1 bdev(0x55ad8ab63800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T11:14:29.455 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:29.487+0000 7fb4fc7408c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T11:14:32.577 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T11:14:32.626 DEBUG:teuthology.orchestra.run.trial109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:14:32.691 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:32.723+0000 7f7fe1e188c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T11:14:32.692 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:32.723+0000 7f7fe1e188c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T11:14:32.692 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:32.723+0000 7f7fe1e188c0 -1 bdev(0x56498a145800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T11:14:32.692 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:32.723+0000 7f7fe1e188c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T11:14:35.781 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T11:14:35.831 DEBUG:teuthology.orchestra.run.trial109:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:14:35.894 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:35.927+0000 7fb30c2138c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T11:14:35.894 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:35.927+0000 7fb30c2138c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T11:14:35.894 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:35.927+0000 7fb30c2138c0 -1 bdev(0x55e06c847800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T11:14:35.894 INFO:teuthology.orchestra.run.trial109.stderr:2026-02-17T11:14:35.927+0000 7fb30c2138c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T11:14:39.017 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T11:14:39.067 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T11:14:39.067 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:39.067 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T11:14:39.119 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:39.119 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T11:14:39.170 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:39.171 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T11:14:39.222 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:39.222 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T11:14:39.275 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:39.275 DEBUG:teuthology.orchestra.run.trial109:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T11:14:39.324 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T11:14:39.325 DEBUG:teuthology.orchestra.run.trial109:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:14:39.372 INFO:teuthology.orchestra.run.trial109.stdout:[mgr.x] 2026-02-17T11:14:39.372 INFO:teuthology.orchestra.run.trial109.stdout: key = AQCTTZRpyNsBABAAkDIYjAmwqPu7NzmIwulQvw== 2026-02-17T11:14:39.372 INFO:teuthology.orchestra.run.trial109.stdout:[osd.0] 2026-02-17T11:14:39.372 INFO:teuthology.orchestra.run.trial109.stdout: key = AQCVTZRpJuE2HRAA4alGF9FnbNQx/R52X2s/0Q== 2026-02-17T11:14:39.373 INFO:teuthology.orchestra.run.trial109.stdout:[osd.1] 2026-02-17T11:14:39.373 INFO:teuthology.orchestra.run.trial109.stdout: key = AQCYTZRp6ZtVKxAAsxRSOdY3UqsSR+fAlfCvoA== 2026-02-17T11:14:39.373 INFO:teuthology.orchestra.run.trial109.stdout:[osd.2] 2026-02-17T11:14:39.373 INFO:teuthology.orchestra.run.trial109.stdout: key = AQCbTZRp1XdyNxAALJIB3VoDBVRIbmgBBsPSNg== 2026-02-17T11:14:39.373 INFO:teuthology.orchestra.run.trial109.stdout:[client.0] 2026-02-17T11:14:39.373 INFO:teuthology.orchestra.run.trial109.stdout: key = AQCTTZRpOOwUBBAA2VRXJLJFOnhL2LYHzcOFEg== 2026-02-17T11:14:39.374 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:14:39.439 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:14:39.503 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:14:39.566 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:14:39.630 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T11:14:39.697 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T11:14:39.697 DEBUG:teuthology.orchestra.run.trial109:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T11:14:39.749 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:14:39.815 DEBUG:teuthology.orchestra.run.trial109:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T11:14:39.865 DEBUG:teuthology.orchestra.run.trial109:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:14:39.909 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T11:14:39.909 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:14:39.909 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:14:39.951 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:14:39.951 DEBUG:teuthology.orchestra.run.trial109:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T11:14:40.086 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T11:14:40.086 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T11:14:40.086 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T11:14:40.089 INFO:tasks.ceph.mgr.x:Started 2026-02-17T11:14:40.089 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T11:14:40.089 DEBUG:teuthology.orchestra.run.trial109:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T11:14:40.195 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.227+0000 7fce610df280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:14:40.196 INFO:teuthology.orchestra.run.trial109.stderr:adjusted tunables profile to default 2026-02-17T11:14:40.206 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T11:14:40.206 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T11:14:40.206 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:40.206 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T11:14:40.215 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:40.216 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T11:14:40.220 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.251+0000 7fce610df280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:14:40.228 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-17T11:14:40.229 DEBUG:teuthology.orchestra.run.trial109:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T11:14:40.258 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.287+0000 7fce610df280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:14:40.266 DEBUG:teuthology.orchestra.run.trial109:> sudo ceph --cluster ceph osd new 4c3afd2a-70ca-4a51-8063-7f991469117c 0 2026-02-17T11:14:40.343 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.375+0000 7fce610df280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:14:40.407 INFO:teuthology.orchestra.run.trial109.stdout:0 2026-02-17T11:14:40.416 DEBUG:teuthology.orchestra.run.trial109:> sudo ceph --cluster ceph osd new 03ab0fe1-da71-4b96-987a-5cfb0998c0c2 1 2026-02-17T11:14:40.424 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.455+0000 7fce610df280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:14:40.461 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.491+0000 7fce610df280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:14:40.521 INFO:teuthology.orchestra.run.trial109.stdout:1 2026-02-17T11:14:40.531 DEBUG:teuthology.orchestra.run.trial109:> sudo ceph --cluster ceph osd new 7b10d72c-c96d-4a1e-8a86-90968a898435 2 2026-02-17T11:14:40.535 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.567+0000 7fce610df280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:14:40.633 INFO:teuthology.orchestra.run.trial109.stdout:2 2026-02-17T11:14:40.642 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:14:40.642 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T11:14:40.643 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:14:40.644 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:14:40.644 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T11:14:40.645 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:14:40.645 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:14:40.645 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T11:14:40.647 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:14:40.647 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:14:40.712 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:40.743+0000 7fce610df280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:14:40.741 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:40.741 INFO:teuthology.orchestra.run.trial109.stdout:{"epoch":5,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:14:40.668266+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:14:40.668266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:14:40.750 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T11:14:40.750 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T11:14:41.020 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.051+0000 7fce610df280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:14:41.052 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:14:41.111 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.143+0000 7fce610df280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:14:41.139 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.171+0000 7fce610df280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:14:41.169 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.199+0000 7fce610df280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:14:41.212 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.243+0000 7fce610df280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:14:41.310 INFO:teuthology.misc.health.trial109.stderr:2026-02-17T11:14:41.343+0000 7f492ffff640 0 --2- 10.20.193.109:0/2053734646 >> v2:10.20.193.109:3300/0 conn(0x7f4930075d50 0x7f49301284e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-17T11:14:41.313 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.343+0000 7fce610df280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:14:41.341 INFO:teuthology.misc.health.trial109.stdout: 2026-02-17T11:14:41.342 INFO:teuthology.misc.health.trial109.stdout:{"epoch":5,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:14:40.668266+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:14:40.668266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:14:41.350 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T11:14:41.513 INFO:tasks.ceph.mgr.x.trial109.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-17T11:14:41.689 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.719+0000 7fce610df280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:14:41.720 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.751+0000 7fce610df280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:14:41.815 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.847+0000 7fce610df280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:14:41.839 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.871+0000 7fce610df280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:14:41.866 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.895+0000 7fce610df280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:14:41.892 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:41.923+0000 7fce610df280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:14:42.013 INFO:tasks.ceph.mgr.x.trial109.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:14:42.013 INFO:tasks.ceph.mgr.x.trial109.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:14:42.013 INFO:tasks.ceph.mgr.x.trial109.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:14:42.020 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:42.051+0000 7fce610df280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:14:42.047 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:42.079+0000 7fce610df280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:14:42.086 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:42.119+0000 7fce610df280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:14:42.207 INFO:tasks.ceph.osd.0.trial109.stderr:2026-02-17T11:14:42.239+0000 7f78b0e108c0 -1 Falling back to public interface 2026-02-17T11:14:42.222 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:14:42.255+0000 7f548fd958c0 -1 Falling back to public interface 2026-02-17T11:14:42.671 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:14:42.703+0000 7f28297358c0 -1 Falling back to public interface 2026-02-17T11:14:43.113 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:14:43.143+0000 7fcd7fb29640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T11:14:46.093 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:14:46.123+0000 7f548fd958c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:14:46.286 INFO:tasks.ceph.osd.0.trial109.stderr:2026-02-17T11:14:46.319+0000 7f78b0e108c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:14:46.766 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:14:46.799+0000 7f28297358c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:14:47.118 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:14:47.147+0000 7f548bd3e640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T11:14:47.139 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:14:47.171+0000 7f5487b79640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:14:47.652 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:14:47.795 INFO:teuthology.misc.health.trial109.stdout: 2026-02-17T11:14:47.795 INFO:teuthology.misc.health.trial109.stdout:{"epoch":7,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:14:47.147666+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:14:40.668266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:14:47.804 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T11:14:48.503 INFO:tasks.ceph.osd.0.trial109.stderr:2026-02-17T11:14:48.535+0000 7f78acdb9640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:14:48.508 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:14:48.539+0000 7f28256de640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T11:14:48.518 INFO:tasks.ceph.osd.0.trial109.stderr:2026-02-17T11:14:48.551+0000 7f78a4bec640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:14:48.534 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:14:48.567+0000 7f281d511640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:14:54.107 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:14:54.252 INFO:teuthology.misc.health.trial109.stdout: 2026-02-17T11:14:54.253 INFO:teuthology.misc.health.trial109.stdout:{"epoch":9,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:14:49.545187+0000","last_up_change":"2026-02-17T11:14:49.545187+0000","last_in_change":"2026-02-17T11:14:40.668266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6803","nonce":138594769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6805","nonce":138594769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6809","nonce":138594769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6807","nonce":138594769}]},"public_addr":"10.20.193.109:6803/138594769","cluster_addr":"10.20.193.109:6805/138594769","heartbeat_back_addr":"10.20.193.109:6809/138594769","heartbeat_front_addr":"10.20.193.109:6807/138594769","state":["exists","up"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6818","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6819","nonce":2319189624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6820","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6821","nonce":2319189624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6824","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6825","nonce":2319189624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6822","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6823","nonce":2319189624}]},"public_addr":"10.20.193.109:6819/2319189624","cluster_addr":"10.20.193.109:6821/2319189624","heartbeat_back_addr":"10.20.193.109:6825/2319189624","heartbeat_front_addr":"10.20.193.109:6823/2319189624","state":["exists","up"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6811","nonce":3812957209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6813","nonce":3812957209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6816","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6817","nonce":3812957209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6815","nonce":3812957209}]},"public_addr":"10.20.193.109:6811/3812957209","cluster_addr":"10.20.193.109:6813/3812957209","heartbeat_back_addr":"10.20.193.109:6817/3812957209","heartbeat_front_addr":"10.20.193.109:6815/3812957209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:14:54.263 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T11:14:54.263 INFO:tasks.ceph:Creating RBD pool 2026-02-17T11:14:54.263 DEBUG:teuthology.orchestra.run.trial109:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T11:14:55.127 INFO:teuthology.orchestra.run.trial109.stderr:pool 'rbd' created 2026-02-17T11:14:55.139 DEBUG:teuthology.orchestra.run.trial109:> rbd --cluster ceph pool init rbd 2026-02-17T11:14:58.142 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T11:14:58.143 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T11:14:58.143 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T11:14:58.143 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T11:14:58.143 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T11:14:58.314 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:58.323 INFO:teuthology.orchestra.run.trial109.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6800","nonce":2320661245},{"type":"v1","addr":"10.20.193.109:6801","nonce":2320661245}]},"active_addr":"10.20.193.109:6801/2320661245","active_change":"2026-02-17T11:14:42.142472+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.109:0","nonce":1828012831}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.109:0","nonce":2569284155}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.109:0","nonce":852432742}]}]} 2026-02-17T11:14:58.327 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T11:14:58.327 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T11:14:58.328 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:14:58.483 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:58.483 INFO:teuthology.orchestra.run.trial109.stdout:{"epoch":13,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:14:58.167083+0000","last_up_change":"2026-02-17T11:14:49.545187+0000","last_in_change":"2026-02-17T11:14:40.668266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T11:14:54.449014+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6803","nonce":138594769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6805","nonce":138594769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6809","nonce":138594769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6807","nonce":138594769}]},"public_addr":"10.20.193.109:6803/138594769","cluster_addr":"10.20.193.109:6805/138594769","heartbeat_back_addr":"10.20.193.109:6809/138594769","heartbeat_front_addr":"10.20.193.109:6807/138594769","state":["exists","up"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6818","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6819","nonce":2319189624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6820","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6821","nonce":2319189624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6824","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6825","nonce":2319189624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6822","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6823","nonce":2319189624}]},"public_addr":"10.20.193.109:6819/2319189624","cluster_addr":"10.20.193.109:6821/2319189624","heartbeat_back_addr":"10.20.193.109:6825/2319189624","heartbeat_front_addr":"10.20.193.109:6823/2319189624","state":["exists","up"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6811","nonce":3812957209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6813","nonce":3812957209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6816","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6817","nonce":3812957209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6815","nonce":3812957209}]},"public_addr":"10.20.193.109:6811/3812957209","cluster_addr":"10.20.193.109:6813/3812957209","heartbeat_back_addr":"10.20.193.109:6817/3812957209","heartbeat_front_addr":"10.20.193.109:6815/3812957209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:14:58.493 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T11:14:58.493 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:14:58.635 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:14:58.636 INFO:teuthology.orchestra.run.trial109.stdout:{"epoch":13,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:14:58.167083+0000","last_up_change":"2026-02-17T11:14:49.545187+0000","last_in_change":"2026-02-17T11:14:40.668266+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T11:14:54.449014+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6803","nonce":138594769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6805","nonce":138594769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6809","nonce":138594769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6807","nonce":138594769}]},"public_addr":"10.20.193.109:6803/138594769","cluster_addr":"10.20.193.109:6805/138594769","heartbeat_back_addr":"10.20.193.109:6809/138594769","heartbeat_front_addr":"10.20.193.109:6807/138594769","state":["exists","up"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6818","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6819","nonce":2319189624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6820","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6821","nonce":2319189624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6824","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6825","nonce":2319189624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6822","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6823","nonce":2319189624}]},"public_addr":"10.20.193.109:6819/2319189624","cluster_addr":"10.20.193.109:6821/2319189624","heartbeat_back_addr":"10.20.193.109:6825/2319189624","heartbeat_front_addr":"10.20.193.109:6823/2319189624","state":["exists","up"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6811","nonce":3812957209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6813","nonce":3812957209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6816","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6817","nonce":3812957209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6815","nonce":3812957209}]},"public_addr":"10.20.193.109:6811/3812957209","cluster_addr":"10.20.193.109:6813/3812957209","heartbeat_back_addr":"10.20.193.109:6817/3812957209","heartbeat_front_addr":"10.20.193.109:6815/3812957209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:14:58.648 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:14:58.648 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:14:58.648 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:14:58.733 INFO:teuthology.orchestra.run.trial109.stdout:34359738371 2026-02-17T11:14:58.734 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:14:58.735 INFO:teuthology.orchestra.run.trial109.stdout:38654705668 2026-02-17T11:14:58.736 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:14:58.737 INFO:teuthology.orchestra.run.trial109.stdout:38654705667 2026-02-17T11:14:58.738 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:14:58.892 INFO:teuthology.orchestra.run.trial109.stdout:34359738370 2026-02-17T11:14:58.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.2 2026-02-17T11:14:58.918 INFO:teuthology.orchestra.run.trial109.stdout:38654705666 2026-02-17T11:14:58.921 INFO:teuthology.orchestra.run.trial109.stdout:38654705667 2026-02-17T11:14:58.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-17T11:14:58.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2026-02-17T11:14:59.904 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:14:59.930 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:14:59.933 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:15:00.058 INFO:teuthology.orchestra.run.trial109.stdout:34359738370 2026-02-17T11:15:00.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.2 2026-02-17T11:15:00.101 INFO:teuthology.orchestra.run.trial109.stdout:38654705666 2026-02-17T11:15:00.105 INFO:teuthology.orchestra.run.trial109.stdout:38654705667 2026-02-17T11:15:00.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-17T11:15:00.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2026-02-17T11:15:01.070 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:15:01.113 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:15:01.118 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:15:01.226 INFO:teuthology.orchestra.run.trial109.stdout:34359738372 2026-02-17T11:15:01.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738372 for osd.2 2026-02-17T11:15:01.239 DEBUG:teuthology.parallel:result is None 2026-02-17T11:15:01.257 INFO:teuthology.orchestra.run.trial109.stdout:38654705667 2026-02-17T11:15:01.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2026-02-17T11:15:01.269 DEBUG:teuthology.parallel:result is None 2026-02-17T11:15:01.306 INFO:teuthology.orchestra.run.trial109.stdout:38654705668 2026-02-17T11:15:01.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2026-02-17T11:15:01.318 DEBUG:teuthology.parallel:result is None 2026-02-17T11:15:01.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:15:01.318 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:01.505 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:01.506 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:01.516 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-17T11:15:00.146885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89556,"kb_used_data":336,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025964,"statfs":{"total":289910292480,"available":289818587136,"internally_reserved":0,"allocated":344064,"data_stored":85455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173838+0000","last_change":"2026-02-17T11:14:58.173838+0000","last_active":"2026-02-17T11:14:58.173838+0000","last_peered":"2026-02-17T11:14:58.173838+0000","last_clean":"2026-02-17T11:14:58.173838+0000","last_became_active":"2026-02-17T11:14:56.168904+0000","last_became_peered":"2026-02-17T11:14:56.168904+0000","last_unstale":"2026-02-17T11:14:58.173838+0000","last_undegraded":"2026-02-17T11:14:58.173838+0000","last_fullsized":"2026-02-17T11:14:58.173838+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:14:03.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173885+0000","last_change":"2026-02-17T11:14:58.173885+0000","last_active":"2026-02-17T11:14:58.173885+0000","last_peered":"2026-02-17T11:14:58.173885+0000","last_clean":"2026-02-17T11:14:58.173885+0000","last_became_active":"2026-02-17T11:14:56.169121+0000","last_became_peered":"2026-02-17T11:14:56.169121+0000","last_unstale":"2026-02-17T11:14:58.173885+0000","last_undegraded":"2026-02-17T11:14:58.173885+0000","last_fullsized":"2026-02-17T11:14:58.173885+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:13:44.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169464+0000","last_change":"2026-02-17T11:14:58.169464+0000","last_active":"2026-02-17T11:14:58.169464+0000","last_peered":"2026-02-17T11:14:58.169464+0000","last_clean":"2026-02-17T11:14:58.169464+0000","last_became_active":"2026-02-17T11:14:56.169680+0000","last_became_peered":"2026-02-17T11:14:56.169680+0000","last_unstale":"2026-02-17T11:14:58.169464+0000","last_undegraded":"2026-02-17T11:14:58.169464+0000","last_fullsized":"2026-02-17T11:14:58.169464+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:17:47.657996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037345800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173982+0000","last_change":"2026-02-17T11:14:58.173982+0000","last_active":"2026-02-17T11:14:58.173982+0000","last_peered":"2026-02-17T11:14:58.173982+0000","last_clean":"2026-02-17T11:14:58.173982+0000","last_became_active":"2026-02-17T11:14:56.169153+0000","last_became_peered":"2026-02-17T11:14:56.169153+0000","last_unstale":"2026-02-17T11:14:58.173982+0000","last_undegraded":"2026-02-17T11:14:58.173982+0000","last_fullsized":"2026-02-17T11:14:58.173982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:37.785842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173547+0000","last_change":"2026-02-17T11:14:58.173547+0000","last_active":"2026-02-17T11:14:58.173547+0000","last_peered":"2026-02-17T11:14:58.173547+0000","last_clean":"2026-02-17T11:14:58.173547+0000","last_became_active":"2026-02-17T11:14:56.168843+0000","last_became_peered":"2026-02-17T11:14:56.168843+0000","last_unstale":"2026-02-17T11:14:58.173547+0000","last_undegraded":"2026-02-17T11:14:58.173547+0000","last_fullsized":"2026-02-17T11:14:58.173547+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:56:30.047543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.172918+0000","last_change":"2026-02-17T11:14:58.172246+0000","last_active":"2026-02-17T11:14:58.172918+0000","last_peered":"2026-02-17T11:14:58.172918+0000","last_clean":"2026-02-17T11:14:58.172918+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:14:58.172918+0000","last_undegraded":"2026-02-17T11:14:58.172918+0000","last_fullsized":"2026-02-17T11:14:58.172918+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:32:15.395238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169473+0000","last_change":"2026-02-17T11:14:58.169473+0000","last_active":"2026-02-17T11:14:58.169473+0000","last_peered":"2026-02-17T11:14:58.169473+0000","last_clean":"2026-02-17T11:14:58.169473+0000","last_became_active":"2026-02-17T11:14:56.169221+0000","last_became_peered":"2026-02-17T11:14:56.169221+0000","last_unstale":"2026-02-17T11:14:58.169473+0000","last_undegraded":"2026-02-17T11:14:58.169473+0000","last_fullsized":"2026-02-17T11:14:58.169473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:32:48.599879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040298299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173544+0000","last_change":"2026-02-17T11:14:58.173544+0000","last_active":"2026-02-17T11:14:58.173544+0000","last_peered":"2026-02-17T11:14:58.173544+0000","last_clean":"2026-02-17T11:14:58.173544+0000","last_became_active":"2026-02-17T11:14:56.169243+0000","last_became_peered":"2026-02-17T11:14:56.169243+0000","last_unstale":"2026-02-17T11:14:58.173544+0000","last_undegraded":"2026-02-17T11:14:58.173544+0000","last_fullsized":"2026-02-17T11:14:58.173544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:21:50.273700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":110592,"data_stored":26368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":118784,"data_stored":29553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":29534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:01.517 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:01.662 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:01.662 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:01.673 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-17T11:15:00.146885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89556,"kb_used_data":336,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025964,"statfs":{"total":289910292480,"available":289818587136,"internally_reserved":0,"allocated":344064,"data_stored":85455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173838+0000","last_change":"2026-02-17T11:14:58.173838+0000","last_active":"2026-02-17T11:14:58.173838+0000","last_peered":"2026-02-17T11:14:58.173838+0000","last_clean":"2026-02-17T11:14:58.173838+0000","last_became_active":"2026-02-17T11:14:56.168904+0000","last_became_peered":"2026-02-17T11:14:56.168904+0000","last_unstale":"2026-02-17T11:14:58.173838+0000","last_undegraded":"2026-02-17T11:14:58.173838+0000","last_fullsized":"2026-02-17T11:14:58.173838+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:14:03.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173885+0000","last_change":"2026-02-17T11:14:58.173885+0000","last_active":"2026-02-17T11:14:58.173885+0000","last_peered":"2026-02-17T11:14:58.173885+0000","last_clean":"2026-02-17T11:14:58.173885+0000","last_became_active":"2026-02-17T11:14:56.169121+0000","last_became_peered":"2026-02-17T11:14:56.169121+0000","last_unstale":"2026-02-17T11:14:58.173885+0000","last_undegraded":"2026-02-17T11:14:58.173885+0000","last_fullsized":"2026-02-17T11:14:58.173885+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:13:44.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169464+0000","last_change":"2026-02-17T11:14:58.169464+0000","last_active":"2026-02-17T11:14:58.169464+0000","last_peered":"2026-02-17T11:14:58.169464+0000","last_clean":"2026-02-17T11:14:58.169464+0000","last_became_active":"2026-02-17T11:14:56.169680+0000","last_became_peered":"2026-02-17T11:14:56.169680+0000","last_unstale":"2026-02-17T11:14:58.169464+0000","last_undegraded":"2026-02-17T11:14:58.169464+0000","last_fullsized":"2026-02-17T11:14:58.169464+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:17:47.657996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037345800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173982+0000","last_change":"2026-02-17T11:14:58.173982+0000","last_active":"2026-02-17T11:14:58.173982+0000","last_peered":"2026-02-17T11:14:58.173982+0000","last_clean":"2026-02-17T11:14:58.173982+0000","last_became_active":"2026-02-17T11:14:56.169153+0000","last_became_peered":"2026-02-17T11:14:56.169153+0000","last_unstale":"2026-02-17T11:14:58.173982+0000","last_undegraded":"2026-02-17T11:14:58.173982+0000","last_fullsized":"2026-02-17T11:14:58.173982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:37.785842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173547+0000","last_change":"2026-02-17T11:14:58.173547+0000","last_active":"2026-02-17T11:14:58.173547+0000","last_peered":"2026-02-17T11:14:58.173547+0000","last_clean":"2026-02-17T11:14:58.173547+0000","last_became_active":"2026-02-17T11:14:56.168843+0000","last_became_peered":"2026-02-17T11:14:56.168843+0000","last_unstale":"2026-02-17T11:14:58.173547+0000","last_undegraded":"2026-02-17T11:14:58.173547+0000","last_fullsized":"2026-02-17T11:14:58.173547+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:56:30.047543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.172918+0000","last_change":"2026-02-17T11:14:58.172246+0000","last_active":"2026-02-17T11:14:58.172918+0000","last_peered":"2026-02-17T11:14:58.172918+0000","last_clean":"2026-02-17T11:14:58.172918+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:14:58.172918+0000","last_undegraded":"2026-02-17T11:14:58.172918+0000","last_fullsized":"2026-02-17T11:14:58.172918+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:32:15.395238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169473+0000","last_change":"2026-02-17T11:14:58.169473+0000","last_active":"2026-02-17T11:14:58.169473+0000","last_peered":"2026-02-17T11:14:58.169473+0000","last_clean":"2026-02-17T11:14:58.169473+0000","last_became_active":"2026-02-17T11:14:56.169221+0000","last_became_peered":"2026-02-17T11:14:56.169221+0000","last_unstale":"2026-02-17T11:14:58.169473+0000","last_undegraded":"2026-02-17T11:14:58.169473+0000","last_fullsized":"2026-02-17T11:14:58.169473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:32:48.599879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040298299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173544+0000","last_change":"2026-02-17T11:14:58.173544+0000","last_active":"2026-02-17T11:14:58.173544+0000","last_peered":"2026-02-17T11:14:58.173544+0000","last_clean":"2026-02-17T11:14:58.173544+0000","last_became_active":"2026-02-17T11:14:56.169243+0000","last_became_peered":"2026-02-17T11:14:56.169243+0000","last_unstale":"2026-02-17T11:14:58.173544+0000","last_undegraded":"2026-02-17T11:14:58.173544+0000","last_fullsized":"2026-02-17T11:14:58.173544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:21:50.273700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":110592,"data_stored":26368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":118784,"data_stored":29553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":29534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:01.673 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:15:01.673 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T11:15:01.673 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T11:15:01.674 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:15:01.837 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:01.837 INFO:teuthology.orchestra.run.trial109.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T11:15:01.847 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T11:15:01.848 INFO:teuthology.run_tasks:Running task divergent_priors2... 2026-02-17T11:15:01.868 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-17T11:15:02.024 INFO:teuthology.orchestra.run.trial109.stdout:epoch 13 2026-02-17T11:15:02.024 INFO:teuthology.orchestra.run.trial109.stdout:fsid 145943f2-efc8-4ce6-8d3c-254689d8dfe1 2026-02-17T11:15:02.024 INFO:teuthology.orchestra.run.trial109.stdout:created 2026-02-17T11:14:40.071089+0000 2026-02-17T11:15:02.024 INFO:teuthology.orchestra.run.trial109.stdout:modified 2026-02-17T11:14:58.167083+0000 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:crush_version 5 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:full_ratio 0.95 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:backfillfull_ratio 0.9 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:nearfull_ratio 0.85 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:require_min_compat_client luminous 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:min_compat_client jewel 2026-02-17T11:15:02.025 INFO:teuthology.orchestra.run.trial109.stdout:require_osd_release squid 2026-02-17T11:15:02.026 INFO:teuthology.orchestra.run.trial109.stdout:stretch_mode_enabled false 2026-02-17T11:15:02.026 INFO:teuthology.orchestra.run.trial109.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 13 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.88 2026-02-17T11:15:02.026 INFO:teuthology.orchestra.run.trial109.stdout: removed_snaps_queue [2~1] 2026-02-17T11:15:02.026 INFO:teuthology.orchestra.run.trial109.stdout:max_osd 3 2026-02-17T11:15:02.026 INFO:teuthology.orchestra.run.trial109.stdout:osd.0 up in weight 1 up_from 9 up_thru 10 down_at 0 last_clean_interval [0,0) [v2:10.20.193.109:6802/138594769,v1:10.20.193.109:6803/138594769] [v2:10.20.193.109:6804/138594769,v1:10.20.193.109:6805/138594769] exists,up 4c3afd2a-70ca-4a51-8063-7f991469117c 2026-02-17T11:15:02.026 INFO:teuthology.orchestra.run.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 10 down_at 0 last_clean_interval [0,0) [v2:10.20.193.109:6818/2319189624,v1:10.20.193.109:6819/2319189624] [v2:10.20.193.109:6820/2319189624,v1:10.20.193.109:6821/2319189624] exists,up 03ab0fe1-da71-4b96-987a-5cfb0998c0c2 2026-02-17T11:15:02.026 INFO:teuthology.orchestra.run.trial109.stdout:osd.2 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) [v2:10.20.193.109:6810/3812957209,v1:10.20.193.109:6811/3812957209] [v2:10.20.193.109:6812/3812957209,v1:10.20.193.109:6813/3812957209] exists,up 7b10d72c-c96d-4a1e-8a86-90968a898435 2026-02-17T11:15:02.035 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 10 down_at 0 last_clean_interval [0,0) [v2:10.20.193.109:6802/138594769,v1:10.20.193.109:6803/138594769] [v2:10.20.193.109:6804/138594769,v1:10.20.193.109:6805/138594769] exists,up 4c3afd2a-70ca-4a51-8063-7f991469117c', 'osd.1 up in weight 1 up_from 9 up_thru 10 down_at 0 last_clean_interval [0,0) [v2:10.20.193.109:6818/2319189624,v1:10.20.193.109:6819/2319189624] [v2:10.20.193.109:6820/2319189624,v1:10.20.193.109:6821/2319189624] exists,up 03ab0fe1-da71-4b96-987a-5cfb0998c0c2', 'osd.2 up in weight 1 up_from 8 up_thru 10 down_at 0 last_clean_interval [0,0) [v2:10.20.193.109:6810/3812957209,v1:10.20.193.109:6811/3812957209] [v2:10.20.193.109:6812/3812957209,v1:10.20.193.109:6813/3812957209] exists,up 7b10d72c-c96d-4a1e-8a86-90968a898435'] 2026-02-17T11:15:02.035 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:15:02.036 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:15:02.037 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:15:02.120 INFO:teuthology.orchestra.run.trial109.stdout:38654705669 2026-02-17T11:15:02.121 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:15:02.122 INFO:teuthology.orchestra.run.trial109.stdout:34359738373 2026-02-17T11:15:02.123 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:15:02.124 INFO:teuthology.orchestra.run.trial109.stdout:38654705670 2026-02-17T11:15:02.124 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:15:02.311 INFO:teuthology.orchestra.run.trial109.stdout:38654705669 2026-02-17T11:15:02.317 INFO:teuthology.orchestra.run.trial109.stdout:34359738372 2026-02-17T11:15:02.320 INFO:teuthology.orchestra.run.trial109.stdout:38654705669 2026-02-17T11:15:02.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2026-02-17T11:15:02.322 DEBUG:teuthology.parallel:result is None 2026-02-17T11:15:02.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2026-02-17T11:15:02.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2026-02-17T11:15:03.331 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:15:03.333 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:15:03.476 INFO:teuthology.orchestra.run.trial109.stdout:38654705669 2026-02-17T11:15:03.482 INFO:teuthology.orchestra.run.trial109.stdout:34359738372 2026-02-17T11:15:03.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2026-02-17T11:15:03.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2026-02-17T11:15:04.488 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:15:04.494 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:15:04.640 INFO:teuthology.orchestra.run.trial109.stdout:38654705670 2026-02-17T11:15:04.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2026-02-17T11:15:04.651 DEBUG:teuthology.parallel:result is None 2026-02-17T11:15:04.672 INFO:teuthology.orchestra.run.trial109.stdout:34359738373 2026-02-17T11:15:04.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2026-02-17T11:15:04.683 DEBUG:teuthology.parallel:result is None 2026-02-17T11:15:04.684 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noout 2026-02-17T11:15:04.993 INFO:teuthology.orchestra.run.trial109.stderr:noout is set 2026-02-17T11:15:05.008 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noin 2026-02-17T11:15:05.994 INFO:teuthology.orchestra.run.trial109.stderr:noin is set 2026-02-17T11:15:06.007 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodown 2026-02-17T11:15:06.996 INFO:teuthology.orchestra.run.trial109.stderr:nodown is set 2026-02-17T11:15:07.010 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:15:07.010 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:07.154 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:07.154 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:07.163 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-17T11:15:07.031832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89556,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025964,"statfs":{"total":289910292480,"available":289818587136,"internally_reserved":0,"allocated":352256,"data_stored":88640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.884946"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173838+0000","last_change":"2026-02-17T11:14:58.173838+0000","last_active":"2026-02-17T11:14:58.173838+0000","last_peered":"2026-02-17T11:14:58.173838+0000","last_clean":"2026-02-17T11:14:58.173838+0000","last_became_active":"2026-02-17T11:14:56.168904+0000","last_became_peered":"2026-02-17T11:14:56.168904+0000","last_unstale":"2026-02-17T11:14:58.173838+0000","last_undegraded":"2026-02-17T11:14:58.173838+0000","last_fullsized":"2026-02-17T11:14:58.173838+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:14:03.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173885+0000","last_change":"2026-02-17T11:14:58.173885+0000","last_active":"2026-02-17T11:14:58.173885+0000","last_peered":"2026-02-17T11:14:58.173885+0000","last_clean":"2026-02-17T11:14:58.173885+0000","last_became_active":"2026-02-17T11:14:56.169121+0000","last_became_peered":"2026-02-17T11:14:56.169121+0000","last_unstale":"2026-02-17T11:14:58.173885+0000","last_undegraded":"2026-02-17T11:14:58.173885+0000","last_fullsized":"2026-02-17T11:14:58.173885+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:13:44.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169464+0000","last_change":"2026-02-17T11:14:58.169464+0000","last_active":"2026-02-17T11:14:58.169464+0000","last_peered":"2026-02-17T11:14:58.169464+0000","last_clean":"2026-02-17T11:14:58.169464+0000","last_became_active":"2026-02-17T11:14:56.169680+0000","last_became_peered":"2026-02-17T11:14:56.169680+0000","last_unstale":"2026-02-17T11:14:58.169464+0000","last_undegraded":"2026-02-17T11:14:58.169464+0000","last_fullsized":"2026-02-17T11:14:58.169464+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:17:47.657996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037345800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173982+0000","last_change":"2026-02-17T11:14:58.173982+0000","last_active":"2026-02-17T11:14:58.173982+0000","last_peered":"2026-02-17T11:14:58.173982+0000","last_clean":"2026-02-17T11:14:58.173982+0000","last_became_active":"2026-02-17T11:14:56.169153+0000","last_became_peered":"2026-02-17T11:14:56.169153+0000","last_unstale":"2026-02-17T11:14:58.173982+0000","last_undegraded":"2026-02-17T11:14:58.173982+0000","last_fullsized":"2026-02-17T11:14:58.173982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:37.785842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173547+0000","last_change":"2026-02-17T11:14:58.173547+0000","last_active":"2026-02-17T11:14:58.173547+0000","last_peered":"2026-02-17T11:14:58.173547+0000","last_clean":"2026-02-17T11:14:58.173547+0000","last_became_active":"2026-02-17T11:14:56.168843+0000","last_became_peered":"2026-02-17T11:14:56.168843+0000","last_unstale":"2026-02-17T11:14:58.173547+0000","last_undegraded":"2026-02-17T11:14:58.173547+0000","last_fullsized":"2026-02-17T11:14:58.173547+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:56:30.047543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.172918+0000","last_change":"2026-02-17T11:14:58.172246+0000","last_active":"2026-02-17T11:14:58.172918+0000","last_peered":"2026-02-17T11:14:58.172918+0000","last_clean":"2026-02-17T11:14:58.172918+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:14:58.172918+0000","last_undegraded":"2026-02-17T11:14:58.172918+0000","last_fullsized":"2026-02-17T11:14:58.172918+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:32:15.395238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169473+0000","last_change":"2026-02-17T11:14:58.169473+0000","last_active":"2026-02-17T11:14:58.169473+0000","last_peered":"2026-02-17T11:14:58.169473+0000","last_clean":"2026-02-17T11:14:58.169473+0000","last_became_active":"2026-02-17T11:14:56.169221+0000","last_became_peered":"2026-02-17T11:14:56.169221+0000","last_unstale":"2026-02-17T11:14:58.169473+0000","last_undegraded":"2026-02-17T11:14:58.169473+0000","last_fullsized":"2026-02-17T11:14:58.169473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:32:48.599879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040298299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173544+0000","last_change":"2026-02-17T11:14:58.173544+0000","last_active":"2026-02-17T11:14:58.173544+0000","last_peered":"2026-02-17T11:14:58.173544+0000","last_clean":"2026-02-17T11:14:58.173544+0000","last_became_active":"2026-02-17T11:14:56.169243+0000","last_became_peered":"2026-02-17T11:14:56.169243+0000","last_unstale":"2026-02-17T11:14:58.173544+0000","last_undegraded":"2026-02-17T11:14:58.173544+0000","last_fullsized":"2026-02-17T11:14:58.173544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:21:50.273700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":118784,"data_stored":29553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":118784,"data_stored":29553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":29534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:07.163 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:07.316 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:07.317 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:07.326 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-17T11:15:07.031832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89556,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025964,"statfs":{"total":289910292480,"available":289818587136,"internally_reserved":0,"allocated":352256,"data_stored":88640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.884946"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173838+0000","last_change":"2026-02-17T11:14:58.173838+0000","last_active":"2026-02-17T11:14:58.173838+0000","last_peered":"2026-02-17T11:14:58.173838+0000","last_clean":"2026-02-17T11:14:58.173838+0000","last_became_active":"2026-02-17T11:14:56.168904+0000","last_became_peered":"2026-02-17T11:14:56.168904+0000","last_unstale":"2026-02-17T11:14:58.173838+0000","last_undegraded":"2026-02-17T11:14:58.173838+0000","last_fullsized":"2026-02-17T11:14:58.173838+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:14:03.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173885+0000","last_change":"2026-02-17T11:14:58.173885+0000","last_active":"2026-02-17T11:14:58.173885+0000","last_peered":"2026-02-17T11:14:58.173885+0000","last_clean":"2026-02-17T11:14:58.173885+0000","last_became_active":"2026-02-17T11:14:56.169121+0000","last_became_peered":"2026-02-17T11:14:56.169121+0000","last_unstale":"2026-02-17T11:14:58.173885+0000","last_undegraded":"2026-02-17T11:14:58.173885+0000","last_fullsized":"2026-02-17T11:14:58.173885+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:13:44.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169464+0000","last_change":"2026-02-17T11:14:58.169464+0000","last_active":"2026-02-17T11:14:58.169464+0000","last_peered":"2026-02-17T11:14:58.169464+0000","last_clean":"2026-02-17T11:14:58.169464+0000","last_became_active":"2026-02-17T11:14:56.169680+0000","last_became_peered":"2026-02-17T11:14:56.169680+0000","last_unstale":"2026-02-17T11:14:58.169464+0000","last_undegraded":"2026-02-17T11:14:58.169464+0000","last_fullsized":"2026-02-17T11:14:58.169464+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:17:47.657996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037345800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173982+0000","last_change":"2026-02-17T11:14:58.173982+0000","last_active":"2026-02-17T11:14:58.173982+0000","last_peered":"2026-02-17T11:14:58.173982+0000","last_clean":"2026-02-17T11:14:58.173982+0000","last_became_active":"2026-02-17T11:14:56.169153+0000","last_became_peered":"2026-02-17T11:14:56.169153+0000","last_unstale":"2026-02-17T11:14:58.173982+0000","last_undegraded":"2026-02-17T11:14:58.173982+0000","last_fullsized":"2026-02-17T11:14:58.173982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:37.785842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173547+0000","last_change":"2026-02-17T11:14:58.173547+0000","last_active":"2026-02-17T11:14:58.173547+0000","last_peered":"2026-02-17T11:14:58.173547+0000","last_clean":"2026-02-17T11:14:58.173547+0000","last_became_active":"2026-02-17T11:14:56.168843+0000","last_became_peered":"2026-02-17T11:14:56.168843+0000","last_unstale":"2026-02-17T11:14:58.173547+0000","last_undegraded":"2026-02-17T11:14:58.173547+0000","last_fullsized":"2026-02-17T11:14:58.173547+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:56:30.047543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.172918+0000","last_change":"2026-02-17T11:14:58.172246+0000","last_active":"2026-02-17T11:14:58.172918+0000","last_peered":"2026-02-17T11:14:58.172918+0000","last_clean":"2026-02-17T11:14:58.172918+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:14:58.172918+0000","last_undegraded":"2026-02-17T11:14:58.172918+0000","last_fullsized":"2026-02-17T11:14:58.172918+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:32:15.395238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.169473+0000","last_change":"2026-02-17T11:14:58.169473+0000","last_active":"2026-02-17T11:14:58.169473+0000","last_peered":"2026-02-17T11:14:58.169473+0000","last_clean":"2026-02-17T11:14:58.169473+0000","last_became_active":"2026-02-17T11:14:56.169221+0000","last_became_peered":"2026-02-17T11:14:56.169221+0000","last_unstale":"2026-02-17T11:14:58.169473+0000","last_undegraded":"2026-02-17T11:14:58.169473+0000","last_fullsized":"2026-02-17T11:14:58.169473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:32:48.599879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040298299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:14:58.173544+0000","last_change":"2026-02-17T11:14:58.173544+0000","last_active":"2026-02-17T11:14:58.173544+0000","last_peered":"2026-02-17T11:14:58.173544+0000","last_clean":"2026-02-17T11:14:58.173544+0000","last_became_active":"2026-02-17T11:14:56.169243+0000","last_became_peered":"2026-02-17T11:14:56.169243+0000","last_unstale":"2026-02-17T11:14:58.173544+0000","last_undegraded":"2026-02-17T11:14:58.173544+0000","last_fullsized":"2026-02-17T11:14:58.173544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:21:50.273700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":118784,"data_stored":29553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31240,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340600,"statfs":{"total":96636764160,"available":96604774400,"internally_reserved":0,"allocated":118784,"data_stored":29553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":29534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:07.327 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:15:07.328 INFO:tasks.divergent_priors2:creating foo 2026-02-17T11:15:07.328 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create foo 1 2026-02-17T11:15:08.000 INFO:teuthology.orchestra.run.trial109.stderr:pool 'foo' created 2026-02-17T11:15:08.014 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set osd_min_pg_log_entries 10 2026-02-17T11:15:08.083 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.083 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_min_pg_log_entries = '' (not observed, change may require restart) " 2026-02-17T11:15:08.083 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.090 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set osd_max_pg_log_entries 10 2026-02-17T11:15:08.158 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.158 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_max_pg_log_entries = '' (not observed, change may require restart) " 2026-02-17T11:15:08.158 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.165 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set osd_pg_log_trim_min 5 2026-02-17T11:15:08.226 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.226 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_pg_log_trim_min = '' (not observed, change may require restart) " 2026-02-17T11:15:08.227 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.233 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set osd_min_pg_log_entries 10 2026-02-17T11:15:08.294 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.294 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_min_pg_log_entries = '' (not observed, change may require restart) " 2026-02-17T11:15:08.294 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.301 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set osd_max_pg_log_entries 10 2026-02-17T11:15:08.370 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.370 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_max_pg_log_entries = '' (not observed, change may require restart) " 2026-02-17T11:15:08.370 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.377 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set osd_pg_log_trim_min 5 2026-02-17T11:15:08.437 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.437 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_pg_log_trim_min = '' (not observed, change may require restart) " 2026-02-17T11:15:08.437 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.444 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set osd_min_pg_log_entries 10 2026-02-17T11:15:08.513 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.513 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_min_pg_log_entries = '' (not observed, change may require restart) " 2026-02-17T11:15:08.513 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.520 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set osd_max_pg_log_entries 10 2026-02-17T11:15:08.590 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.590 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_max_pg_log_entries = '' (not observed, change may require restart) " 2026-02-17T11:15:08.590 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.597 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set osd_pg_log_trim_min 5 2026-02-17T11:15:08.663 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:08.663 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_pg_log_trim_min = '' (not observed, change may require restart) " 2026-02-17T11:15:08.663 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:08.670 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:15:08.821 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:08.822 INFO:teuthology.orchestra.run.trial109.stdout:{"epoch":17,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:15:08.031948+0000","last_up_change":"2026-02-17T11:14:49.545187+0000","last_in_change":"2026-02-17T11:14:40.668266+0000","flags":"nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800384,"flags_set":["nodown","noin","noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T11:14:54.449014+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"foo","create_time":"2026-02-17T11:15:07.522714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6803","nonce":138594769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6805","nonce":138594769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6809","nonce":138594769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":138594769},{"type":"v1","addr":"10.20.193.109:6807","nonce":138594769}]},"public_addr":"10.20.193.109:6803/138594769","cluster_addr":"10.20.193.109:6805/138594769","heartbeat_back_addr":"10.20.193.109:6809/138594769","heartbeat_front_addr":"10.20.193.109:6807/138594769","state":["exists","up"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6818","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6819","nonce":2319189624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6820","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6821","nonce":2319189624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6824","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6825","nonce":2319189624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6822","nonce":2319189624},{"type":"v1","addr":"10.20.193.109:6823","nonce":2319189624}]},"public_addr":"10.20.193.109:6819/2319189624","cluster_addr":"10.20.193.109:6821/2319189624","heartbeat_back_addr":"10.20.193.109:6825/2319189624","heartbeat_front_addr":"10.20.193.109:6823/2319189624","state":["exists","up"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6811","nonce":3812957209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6813","nonce":3812957209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6816","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6817","nonce":3812957209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":3812957209},{"type":"v1","addr":"10.20.193.109:6815","nonce":3812957209}]},"public_addr":"10.20.193.109:6811/3812957209","cluster_addr":"10.20.193.109:6813/3812957209","heartbeat_back_addr":"10.20.193.109:6817/3812957209","heartbeat_front_addr":"10.20.193.109:6815/3812957209","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:15:08.833 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg map 2.0 --format=json 2026-02-17T11:15:08.987 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:08.997 INFO:teuthology.orchestra.run.trial109.stdout:{"epoch":17,"raw_pgid":"2.0","pgid":"2.0","up":[2,1],"acting":[2,1]} 2026-02-17T11:15:08.998 INFO:tasks.divergent_priors2:primary and soon to be divergent is 2 2026-02-17T11:15:08.998 INFO:tasks.divergent_priors2:writing initial objects 2026-02-17T11:15:08.998 INFO:tasks.util.rados:rados -p foo put existing_0 /etc/fstab 2026-02-17T11:15:08.998 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_0 /etc/fstab 2026-02-17T11:15:09.751 INFO:tasks.util.rados:rados -p foo put existing_1 /etc/fstab 2026-02-17T11:15:09.751 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_1 /etc/fstab 2026-02-17T11:15:09.777 INFO:tasks.util.rados:rados -p foo put existing_2 /etc/fstab 2026-02-17T11:15:09.778 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_2 /etc/fstab 2026-02-17T11:15:09.847 INFO:tasks.util.rados:rados -p foo put existing_3 /etc/fstab 2026-02-17T11:15:09.847 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_3 /etc/fstab 2026-02-17T11:15:09.914 INFO:tasks.util.rados:rados -p foo put existing_4 /etc/fstab 2026-02-17T11:15:09.914 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_4 /etc/fstab 2026-02-17T11:15:09.987 INFO:tasks.util.rados:rados -p foo put existing_5 /etc/fstab 2026-02-17T11:15:09.987 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_5 /etc/fstab 2026-02-17T11:15:10.054 INFO:tasks.util.rados:rados -p foo put existing_6 /etc/fstab 2026-02-17T11:15:10.054 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_6 /etc/fstab 2026-02-17T11:15:10.122 INFO:tasks.util.rados:rados -p foo put existing_7 /etc/fstab 2026-02-17T11:15:10.122 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_7 /etc/fstab 2026-02-17T11:15:10.186 INFO:tasks.util.rados:rados -p foo put existing_8 /etc/fstab 2026-02-17T11:15:10.186 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_8 /etc/fstab 2026-02-17T11:15:10.255 INFO:tasks.util.rados:rados -p foo put existing_9 /etc/fstab 2026-02-17T11:15:10.255 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_9 /etc/fstab 2026-02-17T11:15:10.322 INFO:tasks.util.rados:rados -p foo put existing_10 /etc/fstab 2026-02-17T11:15:10.322 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_10 /etc/fstab 2026-02-17T11:15:10.390 INFO:tasks.util.rados:rados -p foo put existing_11 /etc/fstab 2026-02-17T11:15:10.390 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_11 /etc/fstab 2026-02-17T11:15:10.459 INFO:tasks.util.rados:rados -p foo put existing_12 /etc/fstab 2026-02-17T11:15:10.459 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_12 /etc/fstab 2026-02-17T11:15:10.526 INFO:tasks.util.rados:rados -p foo put existing_13 /etc/fstab 2026-02-17T11:15:10.526 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_13 /etc/fstab 2026-02-17T11:15:10.594 INFO:tasks.util.rados:rados -p foo put existing_14 /etc/fstab 2026-02-17T11:15:10.594 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_14 /etc/fstab 2026-02-17T11:15:10.661 INFO:tasks.util.rados:rados -p foo put existing_15 /etc/fstab 2026-02-17T11:15:10.661 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_15 /etc/fstab 2026-02-17T11:15:10.725 INFO:tasks.util.rados:rados -p foo put existing_16 /etc/fstab 2026-02-17T11:15:10.726 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_16 /etc/fstab 2026-02-17T11:15:10.790 INFO:tasks.util.rados:rados -p foo put existing_17 /etc/fstab 2026-02-17T11:15:10.790 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_17 /etc/fstab 2026-02-17T11:15:10.857 INFO:tasks.util.rados:rados -p foo put existing_18 /etc/fstab 2026-02-17T11:15:10.858 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_18 /etc/fstab 2026-02-17T11:15:10.922 INFO:tasks.util.rados:rados -p foo put existing_19 /etc/fstab 2026-02-17T11:15:10.922 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_19 /etc/fstab 2026-02-17T11:15:10.990 INFO:tasks.util.rados:rados -p foo put existing_20 /etc/fstab 2026-02-17T11:15:10.990 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_20 /etc/fstab 2026-02-17T11:15:11.057 INFO:tasks.util.rados:rados -p foo put existing_21 /etc/fstab 2026-02-17T11:15:11.058 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_21 /etc/fstab 2026-02-17T11:15:11.122 INFO:tasks.util.rados:rados -p foo put existing_22 /etc/fstab 2026-02-17T11:15:11.122 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_22 /etc/fstab 2026-02-17T11:15:11.189 INFO:tasks.util.rados:rados -p foo put existing_23 /etc/fstab 2026-02-17T11:15:11.190 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_23 /etc/fstab 2026-02-17T11:15:11.259 INFO:tasks.util.rados:rados -p foo put existing_24 /etc/fstab 2026-02-17T11:15:11.259 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_24 /etc/fstab 2026-02-17T11:15:11.326 INFO:tasks.util.rados:rados -p foo put existing_25 /etc/fstab 2026-02-17T11:15:11.326 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_25 /etc/fstab 2026-02-17T11:15:11.392 INFO:tasks.util.rados:rados -p foo put existing_26 /etc/fstab 2026-02-17T11:15:11.392 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_26 /etc/fstab 2026-02-17T11:15:11.459 INFO:tasks.util.rados:rados -p foo put existing_27 /etc/fstab 2026-02-17T11:15:11.459 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_27 /etc/fstab 2026-02-17T11:15:11.528 INFO:tasks.util.rados:rados -p foo put existing_28 /etc/fstab 2026-02-17T11:15:11.528 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_28 /etc/fstab 2026-02-17T11:15:11.595 INFO:tasks.util.rados:rados -p foo put existing_29 /etc/fstab 2026-02-17T11:15:11.596 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_29 /etc/fstab 2026-02-17T11:15:11.663 INFO:tasks.util.rados:rados -p foo put existing_30 /etc/fstab 2026-02-17T11:15:11.663 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_30 /etc/fstab 2026-02-17T11:15:11.730 INFO:tasks.util.rados:rados -p foo put existing_31 /etc/fstab 2026-02-17T11:15:11.730 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_31 /etc/fstab 2026-02-17T11:15:11.799 INFO:tasks.util.rados:rados -p foo put existing_32 /etc/fstab 2026-02-17T11:15:11.800 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_32 /etc/fstab 2026-02-17T11:15:11.867 INFO:tasks.util.rados:rados -p foo put existing_33 /etc/fstab 2026-02-17T11:15:11.867 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_33 /etc/fstab 2026-02-17T11:15:11.938 INFO:tasks.util.rados:rados -p foo put existing_34 /etc/fstab 2026-02-17T11:15:11.938 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_34 /etc/fstab 2026-02-17T11:15:12.006 INFO:tasks.util.rados:rados -p foo put existing_35 /etc/fstab 2026-02-17T11:15:12.007 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_35 /etc/fstab 2026-02-17T11:15:12.073 INFO:tasks.util.rados:rados -p foo put existing_36 /etc/fstab 2026-02-17T11:15:12.074 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_36 /etc/fstab 2026-02-17T11:15:12.139 INFO:tasks.util.rados:rados -p foo put existing_37 /etc/fstab 2026-02-17T11:15:12.139 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_37 /etc/fstab 2026-02-17T11:15:12.212 INFO:tasks.util.rados:rados -p foo put existing_38 /etc/fstab 2026-02-17T11:15:12.212 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_38 /etc/fstab 2026-02-17T11:15:12.278 INFO:tasks.util.rados:rados -p foo put existing_39 /etc/fstab 2026-02-17T11:15:12.278 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_39 /etc/fstab 2026-02-17T11:15:12.342 INFO:tasks.util.rados:rados -p foo put existing_40 /etc/fstab 2026-02-17T11:15:12.342 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_40 /etc/fstab 2026-02-17T11:15:12.410 INFO:tasks.util.rados:rados -p foo put existing_41 /etc/fstab 2026-02-17T11:15:12.410 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_41 /etc/fstab 2026-02-17T11:15:12.478 INFO:tasks.util.rados:rados -p foo put existing_42 /etc/fstab 2026-02-17T11:15:12.479 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_42 /etc/fstab 2026-02-17T11:15:12.546 INFO:tasks.util.rados:rados -p foo put existing_43 /etc/fstab 2026-02-17T11:15:12.546 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_43 /etc/fstab 2026-02-17T11:15:12.614 INFO:tasks.util.rados:rados -p foo put existing_44 /etc/fstab 2026-02-17T11:15:12.615 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_44 /etc/fstab 2026-02-17T11:15:12.682 INFO:tasks.util.rados:rados -p foo put existing_45 /etc/fstab 2026-02-17T11:15:12.683 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_45 /etc/fstab 2026-02-17T11:15:12.751 INFO:tasks.util.rados:rados -p foo put existing_46 /etc/fstab 2026-02-17T11:15:12.751 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_46 /etc/fstab 2026-02-17T11:15:12.819 INFO:tasks.util.rados:rados -p foo put existing_47 /etc/fstab 2026-02-17T11:15:12.819 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_47 /etc/fstab 2026-02-17T11:15:12.886 INFO:tasks.util.rados:rados -p foo put existing_48 /etc/fstab 2026-02-17T11:15:12.886 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_48 /etc/fstab 2026-02-17T11:15:12.950 INFO:tasks.util.rados:rados -p foo put existing_49 /etc/fstab 2026-02-17T11:15:12.950 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_49 /etc/fstab 2026-02-17T11:15:13.015 INFO:tasks.util.rados:rados -p foo put existing_50 /etc/fstab 2026-02-17T11:15:13.015 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_50 /etc/fstab 2026-02-17T11:15:13.082 INFO:tasks.util.rados:rados -p foo put existing_51 /etc/fstab 2026-02-17T11:15:13.082 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_51 /etc/fstab 2026-02-17T11:15:13.151 INFO:tasks.util.rados:rados -p foo put existing_52 /etc/fstab 2026-02-17T11:15:13.151 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_52 /etc/fstab 2026-02-17T11:15:13.219 INFO:tasks.util.rados:rados -p foo put existing_53 /etc/fstab 2026-02-17T11:15:13.219 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_53 /etc/fstab 2026-02-17T11:15:13.287 INFO:tasks.util.rados:rados -p foo put existing_54 /etc/fstab 2026-02-17T11:15:13.288 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_54 /etc/fstab 2026-02-17T11:15:13.354 INFO:tasks.util.rados:rados -p foo put existing_55 /etc/fstab 2026-02-17T11:15:13.355 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_55 /etc/fstab 2026-02-17T11:15:13.424 INFO:tasks.util.rados:rados -p foo put existing_56 /etc/fstab 2026-02-17T11:15:13.424 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_56 /etc/fstab 2026-02-17T11:15:13.490 INFO:tasks.util.rados:rados -p foo put existing_57 /etc/fstab 2026-02-17T11:15:13.490 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_57 /etc/fstab 2026-02-17T11:15:13.558 INFO:tasks.util.rados:rados -p foo put existing_58 /etc/fstab 2026-02-17T11:15:13.558 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_58 /etc/fstab 2026-02-17T11:15:13.626 INFO:tasks.util.rados:rados -p foo put existing_59 /etc/fstab 2026-02-17T11:15:13.626 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_59 /etc/fstab 2026-02-17T11:15:13.690 INFO:tasks.util.rados:rados -p foo put existing_60 /etc/fstab 2026-02-17T11:15:13.690 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_60 /etc/fstab 2026-02-17T11:15:13.758 INFO:tasks.util.rados:rados -p foo put existing_61 /etc/fstab 2026-02-17T11:15:13.758 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_61 /etc/fstab 2026-02-17T11:15:13.823 INFO:tasks.util.rados:rados -p foo put existing_62 /etc/fstab 2026-02-17T11:15:13.823 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_62 /etc/fstab 2026-02-17T11:15:13.890 INFO:tasks.util.rados:rados -p foo put existing_63 /etc/fstab 2026-02-17T11:15:13.891 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_63 /etc/fstab 2026-02-17T11:15:13.960 INFO:tasks.util.rados:rados -p foo put existing_64 /etc/fstab 2026-02-17T11:15:13.960 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_64 /etc/fstab 2026-02-17T11:15:14.027 INFO:tasks.util.rados:rados -p foo put existing_65 /etc/fstab 2026-02-17T11:15:14.027 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_65 /etc/fstab 2026-02-17T11:15:14.094 INFO:tasks.util.rados:rados -p foo put existing_66 /etc/fstab 2026-02-17T11:15:14.094 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_66 /etc/fstab 2026-02-17T11:15:14.162 INFO:tasks.util.rados:rados -p foo put existing_67 /etc/fstab 2026-02-17T11:15:14.162 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_67 /etc/fstab 2026-02-17T11:15:14.233 INFO:tasks.util.rados:rados -p foo put existing_68 /etc/fstab 2026-02-17T11:15:14.234 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_68 /etc/fstab 2026-02-17T11:15:14.298 INFO:tasks.util.rados:rados -p foo put existing_69 /etc/fstab 2026-02-17T11:15:14.299 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_69 /etc/fstab 2026-02-17T11:15:14.366 INFO:tasks.util.rados:rados -p foo put existing_70 /etc/fstab 2026-02-17T11:15:14.366 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_70 /etc/fstab 2026-02-17T11:15:14.434 INFO:tasks.util.rados:rados -p foo put existing_71 /etc/fstab 2026-02-17T11:15:14.434 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_71 /etc/fstab 2026-02-17T11:15:14.498 INFO:tasks.util.rados:rados -p foo put existing_72 /etc/fstab 2026-02-17T11:15:14.498 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_72 /etc/fstab 2026-02-17T11:15:14.561 INFO:tasks.util.rados:rados -p foo put existing_73 /etc/fstab 2026-02-17T11:15:14.561 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_73 /etc/fstab 2026-02-17T11:15:14.626 INFO:tasks.util.rados:rados -p foo put existing_74 /etc/fstab 2026-02-17T11:15:14.627 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_74 /etc/fstab 2026-02-17T11:15:14.694 INFO:tasks.util.rados:rados -p foo put existing_75 /etc/fstab 2026-02-17T11:15:14.694 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_75 /etc/fstab 2026-02-17T11:15:14.762 INFO:tasks.util.rados:rados -p foo put existing_76 /etc/fstab 2026-02-17T11:15:14.763 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_76 /etc/fstab 2026-02-17T11:15:14.830 INFO:tasks.util.rados:rados -p foo put existing_77 /etc/fstab 2026-02-17T11:15:14.830 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_77 /etc/fstab 2026-02-17T11:15:14.898 INFO:tasks.util.rados:rados -p foo put existing_78 /etc/fstab 2026-02-17T11:15:14.898 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_78 /etc/fstab 2026-02-17T11:15:14.962 INFO:tasks.util.rados:rados -p foo put existing_79 /etc/fstab 2026-02-17T11:15:14.962 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_79 /etc/fstab 2026-02-17T11:15:15.026 INFO:tasks.util.rados:rados -p foo put existing_80 /etc/fstab 2026-02-17T11:15:15.027 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_80 /etc/fstab 2026-02-17T11:15:15.094 INFO:tasks.util.rados:rados -p foo put existing_81 /etc/fstab 2026-02-17T11:15:15.094 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_81 /etc/fstab 2026-02-17T11:15:15.161 INFO:tasks.util.rados:rados -p foo put existing_82 /etc/fstab 2026-02-17T11:15:15.162 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_82 /etc/fstab 2026-02-17T11:15:15.226 INFO:tasks.util.rados:rados -p foo put existing_83 /etc/fstab 2026-02-17T11:15:15.226 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_83 /etc/fstab 2026-02-17T11:15:15.294 INFO:tasks.util.rados:rados -p foo put existing_84 /etc/fstab 2026-02-17T11:15:15.294 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_84 /etc/fstab 2026-02-17T11:15:15.358 INFO:tasks.util.rados:rados -p foo put existing_85 /etc/fstab 2026-02-17T11:15:15.358 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_85 /etc/fstab 2026-02-17T11:15:15.427 INFO:tasks.util.rados:rados -p foo put existing_86 /etc/fstab 2026-02-17T11:15:15.427 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_86 /etc/fstab 2026-02-17T11:15:15.494 INFO:tasks.util.rados:rados -p foo put existing_87 /etc/fstab 2026-02-17T11:15:15.495 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_87 /etc/fstab 2026-02-17T11:15:15.562 INFO:tasks.util.rados:rados -p foo put existing_88 /etc/fstab 2026-02-17T11:15:15.562 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_88 /etc/fstab 2026-02-17T11:15:15.626 INFO:tasks.util.rados:rados -p foo put existing_89 /etc/fstab 2026-02-17T11:15:15.626 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_89 /etc/fstab 2026-02-17T11:15:15.693 INFO:tasks.util.rados:rados -p foo put existing_90 /etc/fstab 2026-02-17T11:15:15.693 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_90 /etc/fstab 2026-02-17T11:15:15.759 INFO:tasks.util.rados:rados -p foo put existing_91 /etc/fstab 2026-02-17T11:15:15.759 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_91 /etc/fstab 2026-02-17T11:15:15.825 INFO:tasks.util.rados:rados -p foo put existing_92 /etc/fstab 2026-02-17T11:15:15.826 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_92 /etc/fstab 2026-02-17T11:15:15.890 INFO:tasks.util.rados:rados -p foo put existing_93 /etc/fstab 2026-02-17T11:15:15.890 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_93 /etc/fstab 2026-02-17T11:15:15.954 INFO:tasks.util.rados:rados -p foo put existing_94 /etc/fstab 2026-02-17T11:15:15.955 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_94 /etc/fstab 2026-02-17T11:15:16.021 INFO:tasks.util.rados:rados -p foo put existing_95 /etc/fstab 2026-02-17T11:15:16.021 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_95 /etc/fstab 2026-02-17T11:15:16.091 INFO:tasks.util.rados:rados -p foo put existing_96 /etc/fstab 2026-02-17T11:15:16.091 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_96 /etc/fstab 2026-02-17T11:15:16.159 INFO:tasks.util.rados:rados -p foo put existing_97 /etc/fstab 2026-02-17T11:15:16.159 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_97 /etc/fstab 2026-02-17T11:15:16.226 INFO:tasks.util.rados:rados -p foo put existing_98 /etc/fstab 2026-02-17T11:15:16.227 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_98 /etc/fstab 2026-02-17T11:15:16.294 INFO:tasks.util.rados:rados -p foo put existing_99 /etc/fstab 2026-02-17T11:15:16.294 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_99 /etc/fstab 2026-02-17T11:15:16.366 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:15:16.366 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:16.553 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:16.553 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:16.562 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2026-02-17T11:15:16.148804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45889,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90236,"kb_used_data":1032,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025284,"statfs":{"total":289910292480,"available":289817890816,"internally_reserved":0,"allocated":1056768,"data_stored":238033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45870,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000931"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087688+0000","last_change":"2026-02-17T11:14:58.173838+0000","last_active":"2026-02-17T11:15:10.087688+0000","last_peered":"2026-02-17T11:15:10.087688+0000","last_clean":"2026-02-17T11:15:10.087688+0000","last_became_active":"2026-02-17T11:14:56.168904+0000","last_became_peered":"2026-02-17T11:14:56.168904+0000","last_unstale":"2026-02-17T11:15:10.087688+0000","last_undegraded":"2026-02-17T11:15:10.087688+0000","last_fullsized":"2026-02-17T11:15:10.087688+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:14:03.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087690+0000","last_change":"2026-02-17T11:14:58.173885+0000","last_active":"2026-02-17T11:15:10.087690+0000","last_peered":"2026-02-17T11:15:10.087690+0000","last_clean":"2026-02-17T11:15:10.087690+0000","last_became_active":"2026-02-17T11:14:56.169121+0000","last_became_peered":"2026-02-17T11:14:56.169121+0000","last_unstale":"2026-02-17T11:15:10.087690+0000","last_undegraded":"2026-02-17T11:15:10.087690+0000","last_fullsized":"2026-02-17T11:15:10.087690+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:13:44.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.039443+0000","last_change":"2026-02-17T11:14:58.169464+0000","last_active":"2026-02-17T11:15:10.039443+0000","last_peered":"2026-02-17T11:15:10.039443+0000","last_clean":"2026-02-17T11:15:10.039443+0000","last_became_active":"2026-02-17T11:14:56.169680+0000","last_became_peered":"2026-02-17T11:14:56.169680+0000","last_unstale":"2026-02-17T11:15:10.039443+0000","last_undegraded":"2026-02-17T11:15:10.039443+0000","last_fullsized":"2026-02-17T11:15:10.039443+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:17:47.657996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037345800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087674+0000","last_change":"2026-02-17T11:14:58.173982+0000","last_active":"2026-02-17T11:15:10.087674+0000","last_peered":"2026-02-17T11:15:10.087674+0000","last_clean":"2026-02-17T11:15:10.087674+0000","last_became_active":"2026-02-17T11:14:56.169153+0000","last_became_peered":"2026-02-17T11:14:56.169153+0000","last_unstale":"2026-02-17T11:15:10.087674+0000","last_undegraded":"2026-02-17T11:15:10.087674+0000","last_fullsized":"2026-02-17T11:15:10.087674+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:37.785842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"19'66","reported_seq":78,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:14.059968+0000","last_change":"2026-02-17T11:15:09.782764+0000","last_active":"2026-02-17T11:15:14.059968+0000","last_peered":"2026-02-17T11:15:14.059968+0000","last_clean":"2026-02-17T11:15:14.059968+0000","last_became_active":"2026-02-17T11:15:09.781838+0000","last_became_peered":"2026-02-17T11:15:09.781838+0000","last_unstale":"2026-02-17T11:15:14.059968+0000","last_undegraded":"2026-02-17T11:15:14.059968+0000","last_fullsized":"2026-02-17T11:15:14.059968+0000","mapping_epoch":17,"log_start":"19'55","ondisk_log_start":"19'55","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":55,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:23:53.969371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45870,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":32,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087660+0000","last_change":"2026-02-17T11:14:58.173547+0000","last_active":"2026-02-17T11:15:10.087660+0000","last_peered":"2026-02-17T11:15:10.087660+0000","last_clean":"2026-02-17T11:15:10.087660+0000","last_became_active":"2026-02-17T11:14:56.168843+0000","last_became_peered":"2026-02-17T11:14:56.168843+0000","last_unstale":"2026-02-17T11:15:10.087660+0000","last_undegraded":"2026-02-17T11:15:10.087660+0000","last_fullsized":"2026-02-17T11:15:10.087660+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:56:30.047543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:11.525146+0000","last_change":"2026-02-17T11:14:58.172246+0000","last_active":"2026-02-17T11:15:11.525146+0000","last_peered":"2026-02-17T11:15:11.525146+0000","last_clean":"2026-02-17T11:15:11.525146+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:15:11.525146+0000","last_undegraded":"2026-02-17T11:15:11.525146+0000","last_fullsized":"2026-02-17T11:15:11.525146+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:32:15.395238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.039424+0000","last_change":"2026-02-17T11:14:58.169473+0000","last_active":"2026-02-17T11:15:10.039424+0000","last_peered":"2026-02-17T11:15:10.039424+0000","last_clean":"2026-02-17T11:15:10.039424+0000","last_became_active":"2026-02-17T11:14:56.169221+0000","last_became_peered":"2026-02-17T11:14:56.169221+0000","last_unstale":"2026-02-17T11:15:10.039424+0000","last_undegraded":"2026-02-17T11:15:10.039424+0000","last_fullsized":"2026-02-17T11:15:10.039424+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:32:48.599879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040298299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087633+0000","last_change":"2026-02-17T11:14:58.173544+0000","last_active":"2026-02-17T11:15:10.087633+0000","last_peered":"2026-02-17T11:15:10.087633+0000","last_clean":"2026-02-17T11:15:10.087633+0000","last_became_active":"2026-02-17T11:14:56.169243+0000","last_became_peered":"2026-02-17T11:14:56.169243+0000","last_unstale":"2026-02-17T11:15:10.087633+0000","last_undegraded":"2026-02-17T11:15:10.087633+0000","last_fullsized":"2026-02-17T11:15:10.087633+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:21:50.273700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":45870,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":102165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":471040,"data_stored":99274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":167936,"data_stored":47844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":417792,"data_stored":90915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":56295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":45870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:16.564 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:16.720 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:16.720 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:16.730 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2026-02-17T11:15:16.148804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45889,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90236,"kb_used_data":1032,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025284,"statfs":{"total":289910292480,"available":289817890816,"internally_reserved":0,"allocated":1056768,"data_stored":238033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45870,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000931"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087688+0000","last_change":"2026-02-17T11:14:58.173838+0000","last_active":"2026-02-17T11:15:10.087688+0000","last_peered":"2026-02-17T11:15:10.087688+0000","last_clean":"2026-02-17T11:15:10.087688+0000","last_became_active":"2026-02-17T11:14:56.168904+0000","last_became_peered":"2026-02-17T11:14:56.168904+0000","last_unstale":"2026-02-17T11:15:10.087688+0000","last_undegraded":"2026-02-17T11:15:10.087688+0000","last_fullsized":"2026-02-17T11:15:10.087688+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:14:03.083642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087690+0000","last_change":"2026-02-17T11:14:58.173885+0000","last_active":"2026-02-17T11:15:10.087690+0000","last_peered":"2026-02-17T11:15:10.087690+0000","last_clean":"2026-02-17T11:15:10.087690+0000","last_became_active":"2026-02-17T11:14:56.169121+0000","last_became_peered":"2026-02-17T11:14:56.169121+0000","last_unstale":"2026-02-17T11:15:10.087690+0000","last_undegraded":"2026-02-17T11:15:10.087690+0000","last_fullsized":"2026-02-17T11:15:10.087690+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:13:44.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.039443+0000","last_change":"2026-02-17T11:14:58.169464+0000","last_active":"2026-02-17T11:15:10.039443+0000","last_peered":"2026-02-17T11:15:10.039443+0000","last_clean":"2026-02-17T11:15:10.039443+0000","last_became_active":"2026-02-17T11:14:56.169680+0000","last_became_peered":"2026-02-17T11:14:56.169680+0000","last_unstale":"2026-02-17T11:15:10.039443+0000","last_undegraded":"2026-02-17T11:15:10.039443+0000","last_fullsized":"2026-02-17T11:15:10.039443+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:17:47.657996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037345800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087674+0000","last_change":"2026-02-17T11:14:58.173982+0000","last_active":"2026-02-17T11:15:10.087674+0000","last_peered":"2026-02-17T11:15:10.087674+0000","last_clean":"2026-02-17T11:15:10.087674+0000","last_became_active":"2026-02-17T11:14:56.169153+0000","last_became_peered":"2026-02-17T11:14:56.169153+0000","last_unstale":"2026-02-17T11:15:10.087674+0000","last_undegraded":"2026-02-17T11:15:10.087674+0000","last_fullsized":"2026-02-17T11:15:10.087674+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:37.785842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"19'66","reported_seq":78,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:14.059968+0000","last_change":"2026-02-17T11:15:09.782764+0000","last_active":"2026-02-17T11:15:14.059968+0000","last_peered":"2026-02-17T11:15:14.059968+0000","last_clean":"2026-02-17T11:15:14.059968+0000","last_became_active":"2026-02-17T11:15:09.781838+0000","last_became_peered":"2026-02-17T11:15:09.781838+0000","last_unstale":"2026-02-17T11:15:14.059968+0000","last_undegraded":"2026-02-17T11:15:14.059968+0000","last_fullsized":"2026-02-17T11:15:14.059968+0000","mapping_epoch":17,"log_start":"19'55","ondisk_log_start":"19'55","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":55,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:23:53.969371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45870,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":32,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087660+0000","last_change":"2026-02-17T11:14:58.173547+0000","last_active":"2026-02-17T11:15:10.087660+0000","last_peered":"2026-02-17T11:15:10.087660+0000","last_clean":"2026-02-17T11:15:10.087660+0000","last_became_active":"2026-02-17T11:14:56.168843+0000","last_became_peered":"2026-02-17T11:14:56.168843+0000","last_unstale":"2026-02-17T11:15:10.087660+0000","last_undegraded":"2026-02-17T11:15:10.087660+0000","last_fullsized":"2026-02-17T11:15:10.087660+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:56:30.047543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:11.525146+0000","last_change":"2026-02-17T11:14:58.172246+0000","last_active":"2026-02-17T11:15:11.525146+0000","last_peered":"2026-02-17T11:15:11.525146+0000","last_clean":"2026-02-17T11:15:11.525146+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:15:11.525146+0000","last_undegraded":"2026-02-17T11:15:11.525146+0000","last_fullsized":"2026-02-17T11:15:11.525146+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:32:15.395238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.039424+0000","last_change":"2026-02-17T11:14:58.169473+0000","last_active":"2026-02-17T11:15:10.039424+0000","last_peered":"2026-02-17T11:15:10.039424+0000","last_clean":"2026-02-17T11:15:10.039424+0000","last_became_active":"2026-02-17T11:14:56.169221+0000","last_became_peered":"2026-02-17T11:14:56.169221+0000","last_unstale":"2026-02-17T11:15:10.039424+0000","last_undegraded":"2026-02-17T11:15:10.039424+0000","last_fullsized":"2026-02-17T11:15:10.039424+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:32:48.599879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040298299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T11:15:10.087633+0000","last_change":"2026-02-17T11:14:58.173544+0000","last_active":"2026-02-17T11:15:10.087633+0000","last_peered":"2026-02-17T11:15:10.087633+0000","last_clean":"2026-02-17T11:15:10.087633+0000","last_became_active":"2026-02-17T11:14:56.169243+0000","last_became_peered":"2026-02-17T11:14:56.169243+0000","last_unstale":"2026-02-17T11:15:10.087633+0000","last_undegraded":"2026-02-17T11:15:10.087633+0000","last_fullsized":"2026-02-17T11:15:10.087633+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:21:50.273700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":45870,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":102165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":471040,"data_stored":99274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":167936,"data_stored":47844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":417792,"data_stored":90915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":56295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":45870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:16.731 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:15:16.731 INFO:tasks.divergent_priors2:blackholing osds [0, 1] 2026-02-17T11:15:16.731 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T11:15:16.802 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:16.802 INFO:teuthology.orchestra.run.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:15:16.802 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:16.810 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set objectstore_blackhole 1 2026-02-17T11:15:16.872 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:16.872 INFO:teuthology.orchestra.run.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:15:16.873 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:16.880 INFO:tasks.divergent_priors2:writing divergent objects 2026-02-17T11:15:16.880 INFO:tasks.util.rados:rados -p foo put existing_0 /etc/resolv.conf 2026-02-17T11:15:16.880 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_0 /etc/resolv.conf 2026-02-17T11:15:16.882 INFO:tasks.util.rados:rados -p foo put existing_1 /etc/resolv.conf 2026-02-17T11:15:16.882 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_1 /etc/resolv.conf 2026-02-17T11:15:16.931 INFO:tasks.util.rados:rados -p foo put existing_2 /etc/resolv.conf 2026-02-17T11:15:16.931 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_2 /etc/resolv.conf 2026-02-17T11:15:16.951 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:16.982+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:16.952 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:16.982+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:16.953 INFO:tasks.util.rados:rados -p foo put existing_3 /etc/resolv.conf 2026-02-17T11:15:16.953 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_3 /etc/resolv.conf 2026-02-17T11:15:16.995 INFO:tasks.util.rados:rados -p foo put existing_4 /etc/resolv.conf 2026-02-17T11:15:16.995 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_4 /etc/resolv.conf 2026-02-17T11:15:17.039 INFO:tasks.divergent_priors2:remove divergent objects 2026-02-17T11:15:17.039 INFO:tasks.util.rados:rados -p foo rm existing_5 2026-02-17T11:15:17.039 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_5 2026-02-17T11:15:17.060 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.090+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.060 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.090+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.062 INFO:tasks.util.rados:rados -p foo rm existing_6 2026-02-17T11:15:17.062 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_6 2026-02-17T11:15:17.081 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.110+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.081 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.110+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.082 INFO:tasks.util.rados:rados -p foo rm existing_7 2026-02-17T11:15:17.083 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_7 2026-02-17T11:15:17.101 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.130+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.102 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.130+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.102 INFO:tasks.util.rados:rados -p foo rm existing_8 2026-02-17T11:15:17.103 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_8 2026-02-17T11:15:17.105 INFO:tasks.util.rados:rados -p foo rm existing_9 2026-02-17T11:15:17.105 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo rm existing_9 2026-02-17T11:15:17.108 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.138+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.109 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.138+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.126 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.154+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.126 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.154+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.131 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.162+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.131 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.162+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.131 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.162+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.131 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.162+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.184 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.214+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.184 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.214+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.216 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.246+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:17.216 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:17.246+0000 7f2815a11640 -1 bdev(0x55d0d3b24000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:18.802 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:18.834+0000 7f2819a19640 -1 bdev(0x55d0d3990c00 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2026-02-17T11:15:27.111 DEBUG:teuthology.orchestra.run.trial109:> killall -9 rados 2026-02-17T11:15:27.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:15:27.122 INFO:teuthology.orchestra.run.trial109.stderr:rados: no process found 2026-02-17T11:15:27.122 INFO:tasks.divergent_priors2:killing all the osds 2026-02-17T11:15:27.122 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T11:15:27.122 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:15:27.215 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T11:15:27.215 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T11:15:27.215 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:15:27.287 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T11:15:27.287 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T11:15:27.288 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:15:27.359 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T11:15:27.359 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2026-02-17T11:15:27.511 INFO:tasks.ceph.mon.a.trial109.stderr:2026-02-17T11:15:27.542+0000 7fe13fec5640 -1 mon.a@0(leader).osd e19 definitely_dead 0 2026-02-17T11:15:27.562 INFO:teuthology.orchestra.run.trial109.stderr:marked down osd.0. 2026-02-17T11:15:27.575 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2026-02-17T11:15:27.732 INFO:tasks.ceph.mon.a.trial109.stderr:2026-02-17T11:15:27.762+0000 7fe13fec5640 -1 mon.a@0(leader).osd e20 definitely_dead 0 2026-02-17T11:15:28.566 INFO:teuthology.orchestra.run.trial109.stderr:marked down osd.1. 2026-02-17T11:15:28.581 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2026-02-17T11:15:28.743 INFO:tasks.ceph.mon.a.trial109.stderr:2026-02-17T11:15:28.774+0000 7fe13fec5640 -1 mon.a@0(leader).osd e21 definitely_dead 0 2026-02-17T11:15:29.570 INFO:teuthology.orchestra.run.trial109.stderr:marked down osd.2. 2026-02-17T11:15:29.583 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2026-02-17T11:15:29.740 INFO:tasks.ceph.mon.a.trial109.stderr:2026-02-17T11:15:29.769+0000 7fe13fec5640 -1 mon.a@0(leader).osd e22 definitely_dead 0 2026-02-17T11:15:30.572 INFO:teuthology.orchestra.run.trial109.stderr:marked out osd.0. 2026-02-17T11:15:30.586 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2026-02-17T11:15:30.734 INFO:tasks.ceph.mon.a.trial109.stderr:2026-02-17T11:15:30.761+0000 7fe13fec5640 -1 mon.a@0(leader).osd e23 definitely_dead 0 2026-02-17T11:15:31.575 INFO:teuthology.orchestra.run.trial109.stderr:marked out osd.1. 2026-02-17T11:15:31.588 INFO:tasks.divergent_priors2:bringing up non_divergent [0, 1] 2026-02-17T11:15:31.588 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:15:31.588 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T11:15:31.590 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:15:31.591 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:config diff 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:config diff get 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:config get 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:config help [] 2026-02-17T11:15:31.649 INFO:teuthology.orchestra.run.trial109.stderr:config set ... 2026-02-17T11:15:31.650 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:15:31.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:15:31.652 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-17T11:15:32.891 INFO:tasks.ceph.osd.0.trial109.stderr:2026-02-17T11:15:32.921+0000 7f802c04d8c0 -1 Falling back to public interface 2026-02-17T11:15:36.653 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T11:15:36.720 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:15:36.720 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:15:36.720 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:15:36.720 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:15:36.720 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:15:36.720 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:15:36.721 INFO:teuthology.orchestra.run.trial109.stderr:bluefs debug_inject_read_zeros 2026-02-17T11:15:36.721 INFO:teuthology.orchestra.run.trial109.stderr:bluefs files list 2026-02-17T11:15:36.721 INFO:teuthology.orchestra.run.trial109.stderr:bluefs stats 2026-02-17T11:15:36.721 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator dump block 2026-02-17T11:15:36.721 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator fragmentation block 2026-02-17T11:15:36.721 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:15:36.721 INFO:tasks.ceph.osd.0.trial109.stderr:2026-02-17T11:15:36.749+0000 7f802c04d8c0 -1 osd.0 19 log_to_monitors true 2026-02-17T11:15:36.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:15:36.723 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-17T11:15:37.207 INFO:tasks.ceph.osd.0.trial109.stderr:2026-02-17T11:15:37.241+0000 7f801fe29640 -1 osd.0 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:15:41.723 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T11:15:41.789 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:41.789 INFO:teuthology.orchestra.run.trial109.stdout: "ops": [], 2026-02-17T11:15:41.789 INFO:teuthology.orchestra.run.trial109.stdout: "num_ops": 0 2026-02-17T11:15:41.790 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:41.797 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:15:41.797 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T11:15:41.799 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:15:41.799 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T11:15:41.858 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:15:41.859 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:15:41.859 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:15:41.859 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:15:41.859 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:15:41.859 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:15:41.859 INFO:teuthology.orchestra.run.trial109.stderr:config diff 2026-02-17T11:15:41.859 INFO:teuthology.orchestra.run.trial109.stderr:config diff get 2026-02-17T11:15:41.860 INFO:teuthology.orchestra.run.trial109.stderr:config get 2026-02-17T11:15:41.860 INFO:teuthology.orchestra.run.trial109.stderr:config help [] 2026-02-17T11:15:41.860 INFO:teuthology.orchestra.run.trial109.stderr:config set ... 2026-02-17T11:15:41.860 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:15:41.861 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:15:41.861 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2026-02-17T11:15:42.138 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:15:42.169+0000 7fcd7a31e640 -1 calc_pg_upmaps abort due to max <= 0 2026-02-17T11:15:42.139 INFO:tasks.ceph.mgr.x.trial109.stderr:2026-02-17T11:15:42.169+0000 7fcd7a31e640 -1 calc_pg_upmaps abort due to max <= 0 2026-02-17T11:15:43.091 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:43.125+0000 7fc54a56c8c0 -1 Falling back to public interface 2026-02-17T11:15:46.863 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T11:15:46.931 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:15:46.931 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:15:46.931 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:15:46.931 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:bluefs debug_inject_read_zeros 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:bluefs files list 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:bluefs stats 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator dump block 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator fragmentation block 2026-02-17T11:15:46.932 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:15:46.933 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:15:46.934 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2026-02-17T11:15:46.976 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:47.009+0000 7fc54a56c8c0 -1 osd.1 19 log_to_monitors true 2026-02-17T11:15:47.203 INFO:tasks.ceph.osd.1.trial109.stderr:2026-02-17T11:15:47.237+0000 7fc542350640 -1 osd.1 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:15:51.935 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T11:15:52.007 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:15:52.007 INFO:teuthology.orchestra.run.trial109.stdout: "ops": [], 2026-02-17T11:15:52.007 INFO:teuthology.orchestra.run.trial109.stdout: "num_ops": 0 2026-02-17T11:15:52.007 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:15:52.014 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2026-02-17T11:15:52.160 INFO:tasks.ceph.mon.a.trial109.stderr:2026-02-17T11:15:52.193+0000 7fe13fec5640 -1 mon.a@0(leader).osd e28 definitely_dead 0 2026-02-17T11:15:52.210 INFO:teuthology.orchestra.run.trial109.stderr:marked in osd.0. 2026-02-17T11:15:52.223 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2026-02-17T11:15:52.372 INFO:tasks.ceph.mon.a.trial109.stderr:2026-02-17T11:15:52.405+0000 7fe13fec5640 -1 mon.a@0(leader).osd e29 definitely_dead 0 2026-02-17T11:15:53.212 INFO:teuthology.orchestra.run.trial109.stderr:marked in osd.1. 2026-02-17T11:15:53.227 INFO:tasks.divergent_priors2:writing non-divergent object existing_10 2026-02-17T11:15:53.227 INFO:tasks.util.rados:rados -p foo put existing_10 /etc/resolv.conf 2026-02-17T11:15:53.227 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put existing_10 /etc/resolv.conf 2026-02-17T11:15:54.220 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2026-02-17T11:15:54.221 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:54.361 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:54.361 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:54.371 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2026-02-17T11:15:54.247653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":9,"acting":9,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":59400,"kb_used_data":784,"kb_used_omap":5,"kb_used_meta":58554,"kb_avail":188684280,"statfs":{"total":193273528320,"available":193212702720,"internally_reserved":0,"allocated":802816,"data_stored":196624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6029,"internal_metadata":59959411},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67385,"num_objects":-96,"num_object_clones":0,"num_object_copies":-192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-110,"num_write_kb":-105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.038011"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249137+0000","last_change":"2026-02-17T11:15:53.227235+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249137+0000","last_undegraded":"2026-02-17T11:15:52.249137+0000","last_fullsized":"2026-02-17T11:15:52.249137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247244+0000","last_change":"2026-02-17T11:15:53.227226+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247244+0000","last_undegraded":"2026-02-17T11:15:52.247244+0000","last_fullsized":"2026-02-17T11:15:52.247244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247254+0000","last_change":"2026-02-17T11:15:52.247254+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247254+0000","last_undegraded":"2026-02-17T11:15:52.247254+0000","last_fullsized":"2026-02-17T11:15:52.247254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247171+0000","last_change":"2026-02-17T11:15:53.227205+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247171+0000","last_undegraded":"2026-02-17T11:15:52.247171+0000","last_fullsized":"2026-02-17T11:15:52.247171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249126+0000","last_change":"2026-02-17T11:15:53.227115+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249126+0000","last_undegraded":"2026-02-17T11:15:52.249126+0000","last_fullsized":"2026-02-17T11:15:52.249126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.248949+0000","last_change":"2026-02-17T11:15:53.227194+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.248949+0000","last_undegraded":"2026-02-17T11:15:52.248949+0000","last_fullsized":"2026-02-17T11:15:52.248949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247224+0000","last_change":"2026-02-17T11:15:53.227183+0000","last_active":"2026-02-17T11:15:37.223905+0000","last_peered":"2026-02-17T11:15:05.522919+0000","last_clean":"2026-02-17T11:15:05.522919+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:15:52.247224+0000","last_undegraded":"2026-02-17T11:15:52.247224+0000","last_fullsized":"2026-02-17T11:15:52.247224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247202+0000","last_change":"2026-02-17T11:15:52.247202+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247202+0000","last_undegraded":"2026-02-17T11:15:52.247202+0000","last_fullsized":"2026-02-17T11:15:52.247202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247223+0000","last_change":"2026-02-17T11:15:53.227157+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247223+0000","last_undegraded":"2026-02-17T11:15:52.247223+0000","last_fullsized":"2026-02-17T11:15:52.247223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":136885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":1,"acting":1,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":0,"seq":120259084290,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":244,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":249856,"data_stored":81414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":552960,"data_stored":115210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":69500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":67385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:54.372 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:54.523 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:54.523 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:54.533 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2026-02-17T11:15:54.247653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":9,"acting":9,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":59400,"kb_used_data":784,"kb_used_omap":5,"kb_used_meta":58554,"kb_avail":188684280,"statfs":{"total":193273528320,"available":193212702720,"internally_reserved":0,"allocated":802816,"data_stored":196624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6029,"internal_metadata":59959411},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67385,"num_objects":-96,"num_object_clones":0,"num_object_copies":-192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-110,"num_write_kb":-105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.038011"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249137+0000","last_change":"2026-02-17T11:15:53.227235+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249137+0000","last_undegraded":"2026-02-17T11:15:52.249137+0000","last_fullsized":"2026-02-17T11:15:52.249137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247244+0000","last_change":"2026-02-17T11:15:53.227226+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247244+0000","last_undegraded":"2026-02-17T11:15:52.247244+0000","last_fullsized":"2026-02-17T11:15:52.247244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247254+0000","last_change":"2026-02-17T11:15:52.247254+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247254+0000","last_undegraded":"2026-02-17T11:15:52.247254+0000","last_fullsized":"2026-02-17T11:15:52.247254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247171+0000","last_change":"2026-02-17T11:15:53.227205+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247171+0000","last_undegraded":"2026-02-17T11:15:52.247171+0000","last_fullsized":"2026-02-17T11:15:52.247171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249126+0000","last_change":"2026-02-17T11:15:53.227115+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249126+0000","last_undegraded":"2026-02-17T11:15:52.249126+0000","last_fullsized":"2026-02-17T11:15:52.249126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.248949+0000","last_change":"2026-02-17T11:15:53.227194+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.248949+0000","last_undegraded":"2026-02-17T11:15:52.248949+0000","last_fullsized":"2026-02-17T11:15:52.248949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247224+0000","last_change":"2026-02-17T11:15:53.227183+0000","last_active":"2026-02-17T11:15:37.223905+0000","last_peered":"2026-02-17T11:15:05.522919+0000","last_clean":"2026-02-17T11:15:05.522919+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:15:52.247224+0000","last_undegraded":"2026-02-17T11:15:52.247224+0000","last_fullsized":"2026-02-17T11:15:52.247224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247202+0000","last_change":"2026-02-17T11:15:52.247202+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247202+0000","last_undegraded":"2026-02-17T11:15:52.247202+0000","last_fullsized":"2026-02-17T11:15:52.247202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247223+0000","last_change":"2026-02-17T11:15:53.227157+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247223+0000","last_undegraded":"2026-02-17T11:15:52.247223+0000","last_fullsized":"2026-02-17T11:15:52.247223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":136885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":1,"acting":1,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":0,"seq":120259084290,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":244,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":249856,"data_stored":81414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":552960,"data_stored":115210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":69500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":67385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:54.534 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:54.675 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:54.676 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:54.685 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2026-02-17T11:15:54.247653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":9,"acting":9,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":59400,"kb_used_data":784,"kb_used_omap":5,"kb_used_meta":58554,"kb_avail":188684280,"statfs":{"total":193273528320,"available":193212702720,"internally_reserved":0,"allocated":802816,"data_stored":196624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6029,"internal_metadata":59959411},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67385,"num_objects":-96,"num_object_clones":0,"num_object_copies":-192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-110,"num_write_kb":-105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.038011"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249137+0000","last_change":"2026-02-17T11:15:53.227235+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249137+0000","last_undegraded":"2026-02-17T11:15:52.249137+0000","last_fullsized":"2026-02-17T11:15:52.249137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247244+0000","last_change":"2026-02-17T11:15:53.227226+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247244+0000","last_undegraded":"2026-02-17T11:15:52.247244+0000","last_fullsized":"2026-02-17T11:15:52.247244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247254+0000","last_change":"2026-02-17T11:15:52.247254+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247254+0000","last_undegraded":"2026-02-17T11:15:52.247254+0000","last_fullsized":"2026-02-17T11:15:52.247254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247171+0000","last_change":"2026-02-17T11:15:53.227205+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247171+0000","last_undegraded":"2026-02-17T11:15:52.247171+0000","last_fullsized":"2026-02-17T11:15:52.247171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249126+0000","last_change":"2026-02-17T11:15:53.227115+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249126+0000","last_undegraded":"2026-02-17T11:15:52.249126+0000","last_fullsized":"2026-02-17T11:15:52.249126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.248949+0000","last_change":"2026-02-17T11:15:53.227194+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.248949+0000","last_undegraded":"2026-02-17T11:15:52.248949+0000","last_fullsized":"2026-02-17T11:15:52.248949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247224+0000","last_change":"2026-02-17T11:15:53.227183+0000","last_active":"2026-02-17T11:15:37.223905+0000","last_peered":"2026-02-17T11:15:05.522919+0000","last_clean":"2026-02-17T11:15:05.522919+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:15:52.247224+0000","last_undegraded":"2026-02-17T11:15:52.247224+0000","last_fullsized":"2026-02-17T11:15:52.247224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247202+0000","last_change":"2026-02-17T11:15:52.247202+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247202+0000","last_undegraded":"2026-02-17T11:15:52.247202+0000","last_fullsized":"2026-02-17T11:15:52.247202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247223+0000","last_change":"2026-02-17T11:15:53.227157+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247223+0000","last_undegraded":"2026-02-17T11:15:52.247223+0000","last_fullsized":"2026-02-17T11:15:52.247223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":136885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":1,"acting":1,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":0,"seq":120259084290,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":244,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":249856,"data_stored":81414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":552960,"data_stored":115210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":69500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":67385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:57.688 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:57.842 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:57.843 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:57.852 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2026-02-17T11:15:56.153275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":9,"acting":9,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":59400,"kb_used_data":784,"kb_used_omap":5,"kb_used_meta":58554,"kb_avail":188684280,"statfs":{"total":193273528320,"available":193212702720,"internally_reserved":0,"allocated":802816,"data_stored":196624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6029,"internal_metadata":59959411},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67385,"num_objects":-96,"num_object_clones":0,"num_object_copies":-192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-110,"num_write_kb":-105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000535"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249137+0000","last_change":"2026-02-17T11:15:53.227235+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249137+0000","last_undegraded":"2026-02-17T11:15:52.249137+0000","last_fullsized":"2026-02-17T11:15:52.249137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247244+0000","last_change":"2026-02-17T11:15:53.227226+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247244+0000","last_undegraded":"2026-02-17T11:15:52.247244+0000","last_fullsized":"2026-02-17T11:15:52.247244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247254+0000","last_change":"2026-02-17T11:15:52.247254+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247254+0000","last_undegraded":"2026-02-17T11:15:52.247254+0000","last_fullsized":"2026-02-17T11:15:52.247254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247171+0000","last_change":"2026-02-17T11:15:53.227205+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247171+0000","last_undegraded":"2026-02-17T11:15:52.247171+0000","last_fullsized":"2026-02-17T11:15:52.247171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249126+0000","last_change":"2026-02-17T11:15:53.227115+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249126+0000","last_undegraded":"2026-02-17T11:15:52.249126+0000","last_fullsized":"2026-02-17T11:15:52.249126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.248949+0000","last_change":"2026-02-17T11:15:53.227194+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.248949+0000","last_undegraded":"2026-02-17T11:15:52.248949+0000","last_fullsized":"2026-02-17T11:15:52.248949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247224+0000","last_change":"2026-02-17T11:15:53.227183+0000","last_active":"2026-02-17T11:15:37.223905+0000","last_peered":"2026-02-17T11:15:05.522919+0000","last_clean":"2026-02-17T11:15:05.522919+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:15:52.247224+0000","last_undegraded":"2026-02-17T11:15:52.247224+0000","last_fullsized":"2026-02-17T11:15:52.247224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247202+0000","last_change":"2026-02-17T11:15:52.247202+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247202+0000","last_undegraded":"2026-02-17T11:15:52.247202+0000","last_fullsized":"2026-02-17T11:15:52.247202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247223+0000","last_change":"2026-02-17T11:15:53.227157+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247223+0000","last_undegraded":"2026-02-17T11:15:52.247223+0000","last_fullsized":"2026-02-17T11:15:52.247223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":136885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":1,"acting":1,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":0,"seq":120259084290,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":244,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":249856,"data_stored":81414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":552960,"data_stored":115210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":69500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":67385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:15:57.854 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:15:57.996 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:15:57.997 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:15:58.006 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2026-02-17T11:15:56.153275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":9,"acting":9,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":188743680,"kb_used":59400,"kb_used_data":784,"kb_used_omap":5,"kb_used_meta":58554,"kb_avail":188684280,"statfs":{"total":193273528320,"available":193212702720,"internally_reserved":0,"allocated":802816,"data_stored":196624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6029,"internal_metadata":59959411},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-67385,"num_objects":-96,"num_object_clones":0,"num_object_copies":-192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-96,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-110,"num_write_kb":-105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000535"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249137+0000","last_change":"2026-02-17T11:15:53.227235+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249137+0000","last_undegraded":"2026-02-17T11:15:52.249137+0000","last_fullsized":"2026-02-17T11:15:52.249137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247244+0000","last_change":"2026-02-17T11:15:53.227226+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247244+0000","last_undegraded":"2026-02-17T11:15:52.247244+0000","last_fullsized":"2026-02-17T11:15:52.247244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247254+0000","last_change":"2026-02-17T11:15:52.247254+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247254+0000","last_undegraded":"2026-02-17T11:15:52.247254+0000","last_fullsized":"2026-02-17T11:15:52.247254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247171+0000","last_change":"2026-02-17T11:15:53.227205+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247171+0000","last_undegraded":"2026-02-17T11:15:52.247171+0000","last_fullsized":"2026-02-17T11:15:52.247171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.249126+0000","last_change":"2026-02-17T11:15:53.227115+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.249126+0000","last_undegraded":"2026-02-17T11:15:52.249126+0000","last_fullsized":"2026-02-17T11:15:52.249126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.248949+0000","last_change":"2026-02-17T11:15:53.227194+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.248949+0000","last_undegraded":"2026-02-17T11:15:52.248949+0000","last_fullsized":"2026-02-17T11:15:52.248949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":26,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247224+0000","last_change":"2026-02-17T11:15:53.227183+0000","last_active":"2026-02-17T11:15:37.223905+0000","last_peered":"2026-02-17T11:15:05.522919+0000","last_clean":"2026-02-17T11:15:05.522919+0000","last_became_active":"2026-02-17T11:14:56.168680+0000","last_became_peered":"2026-02-17T11:14:56.168680+0000","last_unstale":"2026-02-17T11:15:52.247224+0000","last_undegraded":"2026-02-17T11:15:52.247224+0000","last_fullsized":"2026-02-17T11:15:52.247224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"peering","last_fresh":"2026-02-17T11:15:52.247202+0000","last_change":"2026-02-17T11:15:52.247202+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247202+0000","last_undegraded":"2026-02-17T11:15:52.247202+0000","last_fullsized":"2026-02-17T11:15:52.247202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"unknown","last_fresh":"2026-02-17T11:15:52.247223+0000","last_change":"2026-02-17T11:15:53.227157+0000","last_active":"2026-02-17T11:14:55.159870+0000","last_peered":"2026-02-17T11:14:55.159870+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:15:52.247223+0000","last_undegraded":"2026-02-17T11:15:52.247223+0000","last_fullsized":"2026-02-17T11:15:52.247223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":136885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":1,"acting":1,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":0,"seq":120259084290,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":244,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":249856,"data_stored":81414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":552960,"data_stored":115210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":69500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":67385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:16:01.008 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:16:01.162 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:16:01.162 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:16:01.173 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2026-02-17T11:16:00.153874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69791,"num_objects":102,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":100,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":13,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91672,"kb_used_data":1476,"kb_used_omap":10,"kb_used_meta":90101,"kb_avail":283023848,"statfs":{"total":289910292480,"available":289816420352,"internally_reserved":0,"allocated":1511424,"data_stored":367708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10463,"internal_metadata":92264225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69772,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":100,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000907"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean+remapped","last_fresh":"2026-02-17T11:15:55.253901+0000","last_change":"2026-02-17T11:15:55.253255+0000","last_active":"2026-02-17T11:15:55.253901+0000","last_peered":"2026-02-17T11:15:55.253901+0000","last_clean":"2026-02-17T11:15:55.253901+0000","last_became_active":"2026-02-17T11:15:55.252482+0000","last_became_peered":"2026-02-17T11:15:55.252482+0000","last_unstale":"2026-02-17T11:15:55.253901+0000","last_undegraded":"2026-02-17T11:15:55.253901+0000","last_fullsized":"2026-02-17T11:15:55.253901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:10:03.249157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T11:15:55.253885+0000","last_change":"2026-02-17T11:15:55.253185+0000","last_active":"2026-02-17T11:15:55.253885+0000","last_peered":"2026-02-17T11:15:55.253885+0000","last_clean":"2026-02-17T11:15:55.253885+0000","last_became_active":"2026-02-17T11:15:55.252526+0000","last_became_peered":"2026-02-17T11:15:55.252526+0000","last_unstale":"2026-02-17T11:15:55.253885+0000","last_undegraded":"2026-02-17T11:15:55.253885+0000","last_fullsized":"2026-02-17T11:15:55.253885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:20:44.246266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+undersized","last_fresh":"2026-02-17T11:15:55.249357+0000","last_change":"2026-02-17T11:15:53.249344+0000","last_active":"2026-02-17T11:15:55.249357+0000","last_peered":"2026-02-17T11:15:55.249357+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"2026-02-17T11:15:53.249344+0000","last_became_peered":"2026-02-17T11:15:53.249344+0000","last_unstale":"2026-02-17T11:15:55.249357+0000","last_undegraded":"2026-02-17T11:15:55.249357+0000","last_fullsized":"2026-02-17T11:15:53.248339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:07:05.101919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T11:15:55.253883+0000","last_change":"2026-02-17T11:15:55.253261+0000","last_active":"2026-02-17T11:15:55.253883+0000","last_peered":"2026-02-17T11:15:55.253883+0000","last_clean":"2026-02-17T11:15:55.253883+0000","last_became_active":"2026-02-17T11:15:55.252575+0000","last_became_peered":"2026-02-17T11:15:55.252575+0000","last_unstale":"2026-02-17T11:15:55.253883+0000","last_undegraded":"2026-02-17T11:15:55.253883+0000","last_fullsized":"2026-02-17T11:15:55.253883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:00:54.457443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"31'101","reported_seq":121,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2026-02-17T11:15:55.250992+0000","last_change":"2026-02-17T11:15:54.250212+0000","last_active":"2026-02-17T11:15:55.250992+0000","last_peered":"2026-02-17T11:15:55.250992+0000","last_clean":"2026-02-17T11:15:16.327414+0000","last_became_active":"2026-02-17T11:15:54.250212+0000","last_became_peered":"2026-02-17T11:15:54.250212+0000","last_unstale":"2026-02-17T11:15:55.250992+0000","last_undegraded":"2026-02-17T11:15:54.249432+0000","last_fullsized":"2026-02-17T11:15:54.249258+0000","mapping_epoch":30,"log_start":"19'85","ondisk_log_start":"19'85","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":85,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:05:05.311530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69772,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":100,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":100}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":37,"reported_epoch":32,"state":"active+clean+remapped","last_fresh":"2026-02-17T11:15:55.254922+0000","last_change":"2026-02-17T11:15:55.254671+0000","last_active":"2026-02-17T11:15:55.254922+0000","last_peered":"2026-02-17T11:15:55.254922+0000","last_clean":"2026-02-17T11:15:55.254922+0000","last_became_active":"2026-02-17T11:15:55.252624+0000","last_became_peered":"2026-02-17T11:15:55.252624+0000","last_unstale":"2026-02-17T11:15:55.254922+0000","last_undegraded":"2026-02-17T11:15:55.254922+0000","last_fullsized":"2026-02-17T11:15:55.254922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:31:27.429130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T11:15:55.249281+0000","last_change":"2026-02-17T11:15:54.252471+0000","last_active":"2026-02-17T11:15:55.249281+0000","last_peered":"2026-02-17T11:15:55.249281+0000","last_clean":"2026-02-17T11:15:55.249281+0000","last_became_active":"2026-02-17T11:15:54.252044+0000","last_became_peered":"2026-02-17T11:15:54.252044+0000","last_unstale":"2026-02-17T11:15:55.249281+0000","last_undegraded":"2026-02-17T11:15:55.249281+0000","last_fullsized":"2026-02-17T11:15:55.249281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:41:28.720036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+undersized","last_fresh":"2026-02-17T11:15:55.249347+0000","last_change":"2026-02-17T11:15:53.249593+0000","last_active":"2026-02-17T11:15:55.249347+0000","last_peered":"2026-02-17T11:15:55.249347+0000","last_clean":"2026-02-17T11:14:55.159870+0000","last_became_active":"2026-02-17T11:15:53.249593+0000","last_became_peered":"2026-02-17T11:15:53.249593+0000","last_unstale":"2026-02-17T11:15:55.249347+0000","last_undegraded":"2026-02-17T11:15:55.249347+0000","last_fullsized":"2026-02-17T11:15:53.248273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:13:00.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T11:15:55.253621+0000","last_change":"2026-02-17T11:15:55.252985+0000","last_active":"2026-02-17T11:15:55.253621+0000","last_peered":"2026-02-17T11:15:55.253621+0000","last_clean":"2026-02-17T11:15:55.253621+0000","last_became_active":"2026-02-17T11:15:55.252520+0000","last_became_peered":"2026-02-17T11:15:55.252520+0000","last_unstale":"2026-02-17T11:15:55.253621+0000","last_undegraded":"2026-02-17T11:15:55.253621+0000","last_fullsized":"2026-02-17T11:15:55.253621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:16:30.769184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":69772,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":100,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":137157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":1,"acting":1,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":28,"seq":120259084291,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":668,"kb_used_omap":4,"kb_used_meta":31547,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":684032,"data_stored":161135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4434,"internal_metadata":32304814},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149701,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":268,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":274432,"data_stored":91363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":552960,"data_stored":115210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":69772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":67385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:16:01.174 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2026-02-17T11:16:01.174 INFO:tasks.divergent_priors2:delay recovery 2026-02-17T11:16:01.175 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T11:16:01.237 INFO:teuthology.orchestra.run.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:16:01.245 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T11:16:01.314 INFO:teuthology.orchestra.run.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:16:01.321 INFO:tasks.divergent_priors2:revive divergent 2 2026-02-17T11:16:01.321 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noup 2026-02-17T11:16:02.226 INFO:teuthology.orchestra.run.trial109.stderr:noup is set 2026-02-17T11:16:02.238 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:16:02.238 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T11:16:02.240 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:16:02.240 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:config diff 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:config diff get 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:config get 2026-02-17T11:16:02.298 INFO:teuthology.orchestra.run.trial109.stderr:config help [] 2026-02-17T11:16:02.299 INFO:teuthology.orchestra.run.trial109.stderr:config set ... 2026-02-17T11:16:02.299 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:16:02.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:16:02.301 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-17T11:16:03.535 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:03.568+0000 7f35ef7308c0 -1 Falling back to public interface 2026-02-17T11:16:07.301 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T11:16:07.371 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:16:07.371 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:16:07.371 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:16:07.371 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:16:07.371 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:16:07.372 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:16:07.372 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator dump block 2026-02-17T11:16:07.372 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator fragmentation block 2026-02-17T11:16:07.372 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator fragmentation histogram block [] [] 2026-02-17T11:16:07.372 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator score block 2026-02-17T11:16:07.372 INFO:teuthology.orchestra.run.trial109.stderr:config diff 2026-02-17T11:16:07.372 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:16:07.373 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:16:07.374 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-17T11:16:07.412 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:07.444+0000 7f35ef7308c0 -1 osd.2 19 log_to_monitors true 2026-02-17T11:16:07.935 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:07.968+0000 7f35e350c640 -1 osd.2 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:16:07.958 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:07.988+0000 7f35eb6d9640 -1 osd.2 35 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T11:16:12.375 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T11:16:12.446 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:16:12.446 INFO:teuthology.orchestra.run.trial109.stdout: "ops": [], 2026-02-17T11:16:12.446 INFO:teuthology.orchestra.run.trial109.stdout: "num_ops": 0 2026-02-17T11:16:12.446 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:16:12.453 INFO:tasks.divergent_priors2:delay recovery divergent 2026-02-17T11:16:12.453 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T11:16:12.516 INFO:teuthology.orchestra.run.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:16:12.523 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noup 2026-02-17T11:16:13.189 INFO:teuthology.orchestra.run.trial109.stderr:noup is unset 2026-02-17T11:16:13.191 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:13.224+0000 7f35e350c640 -1 osd.2 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:16:13.201 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-17T11:16:13.354 INFO:teuthology.orchestra.run.trial109.stdout:epoch 36 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:fsid 145943f2-efc8-4ce6-8d3c-254689d8dfe1 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:created 2026-02-17T11:14:40.071089+0000 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:modified 2026-02-17T11:16:13.221101+0000 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:flags nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:crush_version 8 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:full_ratio 0.95 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:backfillfull_ratio 0.9 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:nearfull_ratio 0.85 2026-02-17T11:16:13.355 INFO:teuthology.orchestra.run.trial109.stdout:require_min_compat_client luminous 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:min_compat_client jewel 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:require_osd_release squid 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:stretch_mode_enabled false 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 13 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.87 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:pool 2 'foo' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 read_balance_score 3.03 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:max_osd 3 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:osd.0 up in weight 1 up_from 26 up_thru 30 down_at 20 last_clean_interval [9,19) [v2:10.20.193.109:6802/3895160025,v1:10.20.193.109:6803/3895160025] [v2:10.20.193.109:6804/3895160025,v1:10.20.193.109:6805/3895160025] exists,up 4c3afd2a-70ca-4a51-8063-7f991469117c 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:osd.1 up in weight 1 up_from 28 up_thru 31 down_at 21 last_clean_interval [9,19) [v2:10.20.193.109:6810/2658053127,v1:10.20.193.109:6811/2658053127] [v2:10.20.193.109:6812/2658053127,v1:10.20.193.109:6813/2658053127] exists,up 03ab0fe1-da71-4b96-987a-5cfb0998c0c2 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:osd.2 down in weight 1 up_from 8 up_thru 17 down_at 22 last_clean_interval [0,0) [v2:10.20.193.109:6810/3812957209,v1:10.20.193.109:6811/3812957209] [v2:10.20.193.109:6812/3812957209,v1:10.20.193.109:6813/3812957209] exists 7b10d72c-c96d-4a1e-8a86-90968a898435 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:pg_temp 1.3 [1,0] 2026-02-17T11:16:13.356 INFO:teuthology.orchestra.run.trial109.stdout:pg_temp 1.7 [1,0] 2026-02-17T11:16:13.366 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 26 up_thru 30 down_at 20 last_clean_interval [9,19) [v2:10.20.193.109:6802/3895160025,v1:10.20.193.109:6803/3895160025] [v2:10.20.193.109:6804/3895160025,v1:10.20.193.109:6805/3895160025] exists,up 4c3afd2a-70ca-4a51-8063-7f991469117c', 'osd.1 up in weight 1 up_from 28 up_thru 31 down_at 21 last_clean_interval [9,19) [v2:10.20.193.109:6810/2658053127,v1:10.20.193.109:6811/2658053127] [v2:10.20.193.109:6812/2658053127,v1:10.20.193.109:6813/2658053127] exists,up 03ab0fe1-da71-4b96-987a-5cfb0998c0c2', 'osd.2 down in weight 1 up_from 8 up_thru 17 down_at 22 last_clean_interval [0,0) [v2:10.20.193.109:6810/3812957209,v1:10.20.193.109:6811/3812957209] [v2:10.20.193.109:6812/3812957209,v1:10.20.193.109:6813/3812957209] exists 7b10d72c-c96d-4a1e-8a86-90968a898435'] 2026-02-17T11:16:23.368 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-17T11:16:23.513 INFO:teuthology.orchestra.run.trial109.stdout:epoch 39 2026-02-17T11:16:23.513 INFO:teuthology.orchestra.run.trial109.stdout:fsid 145943f2-efc8-4ce6-8d3c-254689d8dfe1 2026-02-17T11:16:23.513 INFO:teuthology.orchestra.run.trial109.stdout:created 2026-02-17T11:14:40.071089+0000 2026-02-17T11:16:23.513 INFO:teuthology.orchestra.run.trial109.stdout:modified 2026-02-17T11:16:16.033058+0000 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:flags nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:crush_version 8 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:full_ratio 0.95 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:backfillfull_ratio 0.9 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:nearfull_ratio 0.85 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:require_min_compat_client luminous 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:min_compat_client jewel 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:require_osd_release squid 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:stretch_mode_enabled false 2026-02-17T11:16:23.514 INFO:teuthology.orchestra.run.trial109.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 13 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.88 2026-02-17T11:16:23.515 INFO:teuthology.orchestra.run.trial109.stdout:pool 2 'foo' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 read_balance_score 2.99 2026-02-17T11:16:23.515 INFO:teuthology.orchestra.run.trial109.stdout:max_osd 3 2026-02-17T11:16:23.515 INFO:teuthology.orchestra.run.trial109.stdout:osd.0 up in weight 1 up_from 26 up_thru 30 down_at 20 last_clean_interval [9,19) [v2:10.20.193.109:6802/3895160025,v1:10.20.193.109:6803/3895160025] [v2:10.20.193.109:6804/3895160025,v1:10.20.193.109:6805/3895160025] exists,up 4c3afd2a-70ca-4a51-8063-7f991469117c 2026-02-17T11:16:23.515 INFO:teuthology.orchestra.run.trial109.stdout:osd.1 up in weight 1 up_from 28 up_thru 38 down_at 21 last_clean_interval [9,19) [v2:10.20.193.109:6810/2658053127,v1:10.20.193.109:6811/2658053127] [v2:10.20.193.109:6812/2658053127,v1:10.20.193.109:6813/2658053127] exists,up 03ab0fe1-da71-4b96-987a-5cfb0998c0c2 2026-02-17T11:16:23.515 INFO:teuthology.orchestra.run.trial109.stdout:osd.2 up in weight 1 up_from 37 up_thru 37 down_at 22 last_clean_interval [8,19) [v2:10.20.193.109:6818/853937174,v1:10.20.193.109:6819/853937174] [v2:10.20.193.109:6820/853937174,v1:10.20.193.109:6821/853937174] exists,up 7b10d72c-c96d-4a1e-8a86-90968a898435 2026-02-17T11:16:23.524 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 26 up_thru 30 down_at 20 last_clean_interval [9,19) [v2:10.20.193.109:6802/3895160025,v1:10.20.193.109:6803/3895160025] [v2:10.20.193.109:6804/3895160025,v1:10.20.193.109:6805/3895160025] exists,up 4c3afd2a-70ca-4a51-8063-7f991469117c', 'osd.1 up in weight 1 up_from 28 up_thru 38 down_at 21 last_clean_interval [9,19) [v2:10.20.193.109:6810/2658053127,v1:10.20.193.109:6811/2658053127] [v2:10.20.193.109:6812/2658053127,v1:10.20.193.109:6813/2658053127] exists,up 03ab0fe1-da71-4b96-987a-5cfb0998c0c2', 'osd.2 up in weight 1 up_from 37 up_thru 37 down_at 22 last_clean_interval [8,19) [v2:10.20.193.109:6818/853937174,v1:10.20.193.109:6819/853937174] [v2:10.20.193.109:6820/853937174,v1:10.20.193.109:6821/853937174] exists,up 7b10d72c-c96d-4a1e-8a86-90968a898435'] 2026-02-17T11:16:23.524 INFO:tasks.divergent_priors2:wait for peering 2026-02-17T11:16:23.524 INFO:tasks.util.rados:rados -p foo put foo /etc/fstab 2026-02-17T11:16:23.524 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo put foo /etc/fstab 2026-02-17T11:16:23.550 INFO:tasks.divergent_priors2:killing divergent 2 2026-02-17T11:16:23.551 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T11:16:23.551 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:16:25.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T11:16:29.653 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T11:16:29.653 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --log-file=/var/log/ceph/objectstore_tool.$$.log --op export-remove --pgid 2.0 --file /home/ubuntu/cephtest/exp.29854.out 2026-02-17T11:16:30.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-17T11:16:31.203 INFO:teuthology.orchestra.run.trial109.stderr:Exporting 2.0 info 2.0( v 39'102 lc 0'0 (19'95,39'102] local-lis/les=37/38 n=101 ec=17/17 lis/c=37/17 les/c/f=38/18/0 sis=37) 2026-02-17T11:16:31.211 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:023dd3d2:::existing_12:head# 2026-02-17T11:16:31.211 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:04c40a0c:::existing_93:head# 2026-02-17T11:16:31.211 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:064ff5fb:::existing_36:head# 2026-02-17T11:16:31.212 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:091f9f1d:::existing_94:head# 2026-02-17T11:16:31.212 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:0a865a93:::existing_54:head# 2026-02-17T11:16:31.212 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:0fed513c:::existing_41:head# 2026-02-17T11:16:31.212 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:13b9e0b8:::existing_92:head# 2026-02-17T11:16:31.217 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:169157fa:::existing_81:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:17731382:::existing_58:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:18a45a39:::existing_43:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:1c160f01:::existing_66:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:1dd6c249:::existing_97:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:23e1b063:::existing_59:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:28566edb:::existing_78:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:2a101182:::existing_20:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:2d1519da:::existing_96:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:3078b87a:::existing_86:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:30bde01b:::existing_15:head# 2026-02-17T11:16:31.218 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:317a7e19:::existing_56:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:38b9c7fa:::existing_33:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:3e16d84b:::existing_48:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:45fe8203:::existing_75:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:4e82c9ba:::existing_50:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:5298dcdb:::existing_57:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:52ebaa44:::existing_32:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:5b7e2de6:::existing_84:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:5da0255c:::existing_13:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:5da2dab8:::existing_53:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:5ee3514b:::existing_30:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:602f83fe:::foo:head# 2026-02-17T11:16:31.219 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:60426cc7:::existing_62:head# 2026-02-17T11:16:31.220 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:628918ca:::existing_79:head# 2026-02-17T11:16:31.220 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:63f8ab2d:::existing_77:head# 2026-02-17T11:16:31.220 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:67e1780f:::existing_27:head# 2026-02-17T11:16:31.220 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:68143ca1:::existing_71:head# 2026-02-17T11:16:31.220 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:6bac9509:::existing_29:head# 2026-02-17T11:16:31.220 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:6bbec798:::existing_45:head# 2026-02-17T11:16:31.220 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:6cb23a40:::existing_65:head# 2026-02-17T11:16:31.229 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:7055ec5e:::existing_83:head# 2026-02-17T11:16:31.229 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:70a54e2b:::existing_87:head# 2026-02-17T11:16:31.229 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:750ace21:::existing_19:head# 2026-02-17T11:16:31.229 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:79881152:::existing_63:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:7a80c0d5:::existing_99:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:81490677:::existing_76:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:85ec8e5d:::existing_85:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:8e2abbf0:::existing_49:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:8ee0fe0f:::existing_52:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:92731e71:::existing_89:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:928205cf:::existing_82:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:93be2267:::existing_24:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:99ceda2c:::existing_44:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:9dd917ee:::existing_26:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:a28805a6:::existing_72:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:a294a8f6:::existing_16:head# 2026-02-17T11:16:31.230 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:a2f5473a:::existing_42:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:a504a533:::existing_90:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:a691337e:::existing_61:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:a6e8d7ac:::existing_28:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:a9fde86e:::existing_18:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:aa309faa:::existing_68:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:ae40b0ed:::existing_31:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:b279b1fe:::existing_10:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:b343e277:::existing_88:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:b7130e90:::existing_80:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:bc6f7309:::existing_70:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:be8489b7:::existing_38:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:beb4e5e3:::existing_47:head# 2026-02-17T11:16:31.231 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:bebec877:::existing_74:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:c04347d8:::existing_60:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:c3e6ebe4:::existing_17:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:c6c5a7c2:::existing_39:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:cc1d0abf:::existing_95:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:ccb3865b:::existing_73:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:cd84e19e:::existing_40:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:d2cd64ce:::existing_37:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:d41a25c9:::existing_22:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:d7f088da:::existing_91:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:d9cbd1d6:::existing_64:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:dcc4ff82:::existing_98:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:dd677bd3:::existing_35:head# 2026-02-17T11:16:31.232 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:dd6d90e7:::existing_46:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:e0e22077:::existing_21:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:e255b710:::existing_55:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:eff1d5db:::existing_14:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:f1b156bf:::existing_23:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:f5ce4199:::existing_34:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:f6809456:::existing_11:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:f699a2a9:::existing_67:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:f9baac43:::existing_25:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:fb76688e:::existing_51:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Read #2:fbb92eec:::existing_69:head# 2026-02-17T11:16:31.233 INFO:teuthology.orchestra.run.trial109.stderr:Export successful 2026-02-17T11:16:31.234 INFO:teuthology.orchestra.run.trial109.stdout: marking collection for removal 2026-02-17T11:16:31.234 INFO:teuthology.orchestra.run.trial109.stdout:setting '_remove' omap key 2026-02-17T11:16:31.234 INFO:teuthology.orchestra.run.trial109.stdout:finish_remove_pgs 2.0_head removing 2.0 2026-02-17T11:16:31.234 INFO:teuthology.orchestra.run.trial109.stderr:Remove successful 2026-02-17T11:16:31.767 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --log-file=/var/log/ceph/objectstore_tool.$$.log --op import --file /home/ubuntu/cephtest/exp.29854.out 2026-02-17T11:16:33.243 INFO:teuthology.orchestra.run.trial109.stdout:get_pg_num_history pg_num_history pg_num_history(e39 pg_nums {1={10=8},2={17=1}} deleted_pools ) 2026-02-17T11:16:33.243 INFO:teuthology.orchestra.run.trial109.stdout:Importing pgid 2.0 2026-02-17T11:16:33.249 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:023dd3d2:::existing_12:head# 2026-02-17T11:16:33.249 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.249 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:04c40a0c:::existing_93:head# 2026-02-17T11:16:33.249 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.249 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:064ff5fb:::existing_36:head# 2026-02-17T11:16:33.250 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.252 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:091f9f1d:::existing_94:head# 2026-02-17T11:16:33.252 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.252 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:0a865a93:::existing_54:head# 2026-02-17T11:16:33.252 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.252 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:0fed513c:::existing_41:head# 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:13b9e0b8:::existing_92:head# 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:169157fa:::existing_81:head# 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:17731382:::existing_58:head# 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:18a45a39:::existing_43:head# 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:1c160f01:::existing_66:head# 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.253 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:1dd6c249:::existing_97:head# 2026-02-17T11:16:33.254 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.254 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:23e1b063:::existing_59:head# 2026-02-17T11:16:33.254 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.254 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:28566edb:::existing_78:head# 2026-02-17T11:16:33.254 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.254 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:2a101182:::existing_20:head# 2026-02-17T11:16:33.254 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.259 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:2d1519da:::existing_96:head# 2026-02-17T11:16:33.259 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.259 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:3078b87a:::existing_86:head# 2026-02-17T11:16:33.259 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.259 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:30bde01b:::existing_15:head# 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:317a7e19:::existing_56:head# 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:38b9c7fa:::existing_33:head# 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:3e16d84b:::existing_48:head# 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:45fe8203:::existing_75:head# 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:4e82c9ba:::existing_50:head# 2026-02-17T11:16:33.260 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:5298dcdb:::existing_57:head# 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:52ebaa44:::existing_32:head# 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:5b7e2de6:::existing_84:head# 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:5da0255c:::existing_13:head# 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:5da2dab8:::existing_53:head# 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:5ee3514b:::existing_30:head# 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.261 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:602f83fe:::foo:head# 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:60426cc7:::existing_62:head# 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:628918ca:::existing_79:head# 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:63f8ab2d:::existing_77:head# 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:67e1780f:::existing_27:head# 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:68143ca1:::existing_71:head# 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:6bac9509:::existing_29:head# 2026-02-17T11:16:33.262 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.263 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:6bbec798:::existing_45:head# 2026-02-17T11:16:33.263 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.275 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:6cb23a40:::existing_65:head# 2026-02-17T11:16:33.276 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.276 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:7055ec5e:::existing_83:head# 2026-02-17T11:16:33.276 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.276 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:70a54e2b:::existing_87:head# 2026-02-17T11:16:33.276 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.276 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:750ace21:::existing_19:head# 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:79881152:::existing_63:head# 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:7a80c0d5:::existing_99:head# 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:81490677:::existing_76:head# 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.277 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:85ec8e5d:::existing_85:head# 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:8e2abbf0:::existing_49:head# 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:8ee0fe0f:::existing_52:head# 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:92731e71:::existing_89:head# 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.278 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:928205cf:::existing_82:head# 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:93be2267:::existing_24:head# 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:99ceda2c:::existing_44:head# 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:9dd917ee:::existing_26:head# 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.279 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:a28805a6:::existing_72:head# 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:a294a8f6:::existing_16:head# 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:a2f5473a:::existing_42:head# 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:a504a533:::existing_90:head# 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:a691337e:::existing_61:head# 2026-02-17T11:16:33.280 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:a6e8d7ac:::existing_28:head# 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:a9fde86e:::existing_18:head# 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:aa309faa:::existing_68:head# 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:ae40b0ed:::existing_31:head# 2026-02-17T11:16:33.281 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:b279b1fe:::existing_10:head# 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:b343e277:::existing_88:head# 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:b7130e90:::existing_80:head# 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:bc6f7309:::existing_70:head# 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.282 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:be8489b7:::existing_38:head# 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:beb4e5e3:::existing_47:head# 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:bebec877:::existing_74:head# 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:c04347d8:::existing_60:head# 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:c3e6ebe4:::existing_17:head# 2026-02-17T11:16:33.283 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:c6c5a7c2:::existing_39:head# 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:cc1d0abf:::existing_95:head# 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:ccb3865b:::existing_73:head# 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:cd84e19e:::existing_40:head# 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.284 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:d2cd64ce:::existing_37:head# 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:d41a25c9:::existing_22:head# 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:d7f088da:::existing_91:head# 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:d9cbd1d6:::existing_64:head# 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:dcc4ff82:::existing_98:head# 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.285 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:dd677bd3:::existing_35:head# 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:dd6d90e7:::existing_46:head# 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:e0e22077:::existing_21:head# 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:e255b710:::existing_55:head# 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:eff1d5db:::existing_14:head# 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.286 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:f1b156bf:::existing_23:head# 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:f5ce4199:::existing_34:head# 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:f6809456:::existing_11:head# 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:f699a2a9:::existing_67:head# 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:f9baac43:::existing_25:head# 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:fb76688e:::existing_51:head# 2026-02-17T11:16:33.287 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.288 INFO:teuthology.orchestra.run.trial109.stdout:Write #2:fbb92eec:::existing_69:head# 2026-02-17T11:16:33.288 INFO:teuthology.orchestra.run.trial109.stdout:snapset 0=[]:{} 2026-02-17T11:16:33.288 INFO:teuthology.orchestra.run.trial109.stdout:write_pg epoch 39 info 2.0( v 39'102 lc 0'0 (19'95,39'102] local-lis/les=37/38 n=101 ec=17/17 lis/c=37/17 les/c/f=38/18/0 sis=37) 2026-02-17T11:16:33.288 INFO:teuthology.orchestra.run.trial109.stdout:Import successful 2026-02-17T11:16:33.811 INFO:tasks.divergent_priors2:reviving divergent 2 2026-02-17T11:16:33.811 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:16:33.812 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T11:16:33.813 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:16:33.814 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T11:16:33.872 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:16:33.872 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:16:33.872 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:16:33.872 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:16:33.872 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:16:33.872 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:16:33.872 INFO:teuthology.orchestra.run.trial109.stderr:config diff 2026-02-17T11:16:33.873 INFO:teuthology.orchestra.run.trial109.stderr:config diff get 2026-02-17T11:16:33.873 INFO:teuthology.orchestra.run.trial109.stderr:config get 2026-02-17T11:16:33.873 INFO:teuthology.orchestra.run.trial109.stderr:config help [] 2026-02-17T11:16:33.873 INFO:teuthology.orchestra.run.trial109.stderr:config set ... 2026-02-17T11:16:33.873 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:16:33.874 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:16:33.875 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-17T11:16:35.116 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:35.147+0000 7fd18ac478c0 -1 Falling back to public interface 2026-02-17T11:16:38.876 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T11:16:38.945 INFO:teuthology.orchestra.run.trial109.stderr:no valid command found; 10 closest matches: 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:0 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:1 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:2 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:abort 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:assert 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator dump block 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator fragmentation block 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator fragmentation histogram block [] [] 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:bluestore allocator score block 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:config diff 2026-02-17T11:16:38.946 INFO:teuthology.orchestra.run.trial109.stderr:admin_socket: invalid command 2026-02-17T11:16:38.947 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T11:16:38.948 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-17T11:16:38.988 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:39.019+0000 7fd18ac478c0 -1 osd.2 39 log_to_monitors true 2026-02-17T11:16:39.195 INFO:tasks.ceph.osd.2.trial109.stderr:2026-02-17T11:16:39.227+0000 7fd182a2b640 -1 osd.2 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:16:43.949 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T11:16:44.021 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:16:44.021 INFO:teuthology.orchestra.run.trial109.stdout: "ops": [], 2026-02-17T11:16:44.021 INFO:teuthology.orchestra.run.trial109.stdout: "num_ops": 0 2026-02-17T11:16:44.021 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:16:44.028 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T11:16:44.089 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:16:44.089 INFO:teuthology.orchestra.run.trial109.stdout: "ops": [], 2026-02-17T11:16:44.089 INFO:teuthology.orchestra.run.trial109.stdout: "num_ops": 0 2026-02-17T11:16:44.089 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:17:04.098 INFO:tasks.divergent_priors2:allowing recovery 2026-02-17T11:17:04.098 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 debug kick_recovery_wq ' 0' 2026-02-17T11:17:04.172 INFO:teuthology.orchestra.run.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:17:04.180 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 debug kick_recovery_wq ' 0' 2026-02-17T11:17:04.260 INFO:teuthology.orchestra.run.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:17:04.268 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 debug kick_recovery_wq ' 0' 2026-02-17T11:17:04.347 INFO:teuthology.orchestra.run.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:17:04.357 INFO:tasks.divergent_priors2:reading divergent objects 2026-02-17T11:17:04.357 INFO:tasks.util.rados:rados -p foo get existing_0 /tmp/existing 2026-02-17T11:17:04.357 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_0 /tmp/existing 2026-02-17T11:17:04.382 INFO:tasks.util.rados:rados -p foo get existing_1 /tmp/existing 2026-02-17T11:17:04.383 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_1 /tmp/existing 2026-02-17T11:17:04.447 INFO:tasks.util.rados:rados -p foo get existing_2 /tmp/existing 2026-02-17T11:17:04.448 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_2 /tmp/existing 2026-02-17T11:17:04.515 INFO:tasks.util.rados:rados -p foo get existing_3 /tmp/existing 2026-02-17T11:17:04.515 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_3 /tmp/existing 2026-02-17T11:17:04.586 INFO:tasks.util.rados:rados -p foo get existing_4 /tmp/existing 2026-02-17T11:17:04.587 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_4 /tmp/existing 2026-02-17T11:17:04.650 INFO:tasks.util.rados:rados -p foo get existing_5 /tmp/existing 2026-02-17T11:17:04.650 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_5 /tmp/existing 2026-02-17T11:17:04.715 INFO:tasks.util.rados:rados -p foo get existing_6 /tmp/existing 2026-02-17T11:17:04.715 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_6 /tmp/existing 2026-02-17T11:17:04.778 INFO:tasks.util.rados:rados -p foo get existing_7 /tmp/existing 2026-02-17T11:17:04.778 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_7 /tmp/existing 2026-02-17T11:17:04.842 INFO:tasks.util.rados:rados -p foo get existing_8 /tmp/existing 2026-02-17T11:17:04.842 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_8 /tmp/existing 2026-02-17T11:17:04.906 INFO:tasks.util.rados:rados -p foo get existing_9 /tmp/existing 2026-02-17T11:17:04.907 DEBUG:teuthology.orchestra.run.trial109:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p foo get existing_9 /tmp/existing 2026-02-17T11:17:04.969 DEBUG:teuthology.orchestra.run.trial109:> rm /home/ubuntu/cephtest/exp.29854.out 2026-02-17T11:17:05.019 INFO:tasks.divergent_priors2:success 2026-02-17T11:17:05.019 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T11:17:05.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:17:05.034 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:17:05.203 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:17:05.204 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:17:05.215 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2026-02-17T11:17:04.160660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70486,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93848,"kb_used_data":1872,"kb_used_omap":20,"kb_used_meta":91883,"kb_avail":283021672,"statfs":{"total":289910292480,"available":289814192128,"internally_reserved":0,"allocated":1916928,"data_stored":525575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21034,"internal_metadata":94088662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000939"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235766+0000","last_change":"2026-02-17T11:16:42.235766+0000","last_active":"2026-02-17T11:16:42.235766+0000","last_peered":"2026-02-17T11:16:42.235766+0000","last_clean":"2026-02-17T11:16:42.235766+0000","last_became_active":"2026-02-17T11:16:42.235401+0000","last_became_peered":"2026-02-17T11:16:42.235401+0000","last_unstale":"2026-02-17T11:16:42.235766+0000","last_undegraded":"2026-02-17T11:16:42.235766+0000","last_fullsized":"2026-02-17T11:16:42.235766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:29:22.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233996+0000","last_change":"2026-02-17T11:15:55.253185+0000","last_active":"2026-02-17T11:16:42.233996+0000","last_peered":"2026-02-17T11:16:42.233996+0000","last_clean":"2026-02-17T11:16:42.233996+0000","last_became_active":"2026-02-17T11:15:55.252526+0000","last_became_peered":"2026-02-17T11:15:55.252526+0000","last_unstale":"2026-02-17T11:16:42.233996+0000","last_undegraded":"2026-02-17T11:16:42.233996+0000","last_fullsized":"2026-02-17T11:16:42.233996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:20:44.246266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235887+0000","last_change":"2026-02-17T11:16:42.235887+0000","last_active":"2026-02-17T11:16:42.235887+0000","last_peered":"2026-02-17T11:16:42.235887+0000","last_clean":"2026-02-17T11:16:42.235887+0000","last_became_active":"2026-02-17T11:16:42.235283+0000","last_became_peered":"2026-02-17T11:16:42.235283+0000","last_unstale":"2026-02-17T11:16:42.235887+0000","last_undegraded":"2026-02-17T11:16:42.235887+0000","last_fullsized":"2026-02-17T11:16:42.235887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:47:20.445266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233974+0000","last_change":"2026-02-17T11:15:55.253261+0000","last_active":"2026-02-17T11:16:42.233974+0000","last_peered":"2026-02-17T11:16:42.233974+0000","last_clean":"2026-02-17T11:16:42.233974+0000","last_became_active":"2026-02-17T11:15:55.252575+0000","last_became_peered":"2026-02-17T11:15:55.252575+0000","last_unstale":"2026-02-17T11:16:42.233974+0000","last_undegraded":"2026-02-17T11:16:42.233974+0000","last_fullsized":"2026-02-17T11:16:42.233974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:00:54.457443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'102","reported_seq":170,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.247745+0000","last_change":"2026-02-17T11:16:42.247745+0000","last_active":"2026-02-17T11:16:42.247745+0000","last_peered":"2026-02-17T11:16:42.247745+0000","last_clean":"2026-02-17T11:16:42.247745+0000","last_became_active":"2026-02-17T11:16:42.235714+0000","last_became_peered":"2026-02-17T11:16:42.235714+0000","last_unstale":"2026-02-17T11:16:42.247745+0000","last_undegraded":"2026-02-17T11:16:42.247745+0000","last_fullsized":"2026-02-17T11:16:42.247745+0000","mapping_epoch":42,"log_start":"19'95","ondisk_log_start":"19'95","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":95,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:52:26.939010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":67,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235775+0000","last_change":"2026-02-17T11:16:42.235775+0000","last_active":"2026-02-17T11:16:42.235775+0000","last_peered":"2026-02-17T11:16:42.235775+0000","last_clean":"2026-02-17T11:16:42.235775+0000","last_became_active":"2026-02-17T11:16:42.235420+0000","last_became_peered":"2026-02-17T11:16:42.235420+0000","last_unstale":"2026-02-17T11:16:42.235775+0000","last_undegraded":"2026-02-17T11:16:42.235775+0000","last_fullsized":"2026-02-17T11:16:42.235775+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:48:53.035653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":58,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233061+0000","last_change":"2026-02-17T11:15:54.252471+0000","last_active":"2026-02-17T11:16:42.233061+0000","last_peered":"2026-02-17T11:16:42.233061+0000","last_clean":"2026-02-17T11:16:42.233061+0000","last_became_active":"2026-02-17T11:15:54.252044+0000","last_became_peered":"2026-02-17T11:15:54.252044+0000","last_unstale":"2026-02-17T11:16:42.233061+0000","last_undegraded":"2026-02-17T11:16:42.233061+0000","last_fullsized":"2026-02-17T11:16:42.233061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:41:28.720036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235310+0000","last_change":"2026-02-17T11:16:42.235310+0000","last_active":"2026-02-17T11:16:42.235310+0000","last_peered":"2026-02-17T11:16:42.235310+0000","last_clean":"2026-02-17T11:16:42.235310+0000","last_became_active":"2026-02-17T11:16:42.234976+0000","last_became_peered":"2026-02-17T11:16:42.234976+0000","last_unstale":"2026-02-17T11:16:42.235310+0000","last_undegraded":"2026-02-17T11:16:42.235310+0000","last_fullsized":"2026-02-17T11:16:42.235310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:00:18.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233846+0000","last_change":"2026-02-17T11:15:55.252985+0000","last_active":"2026-02-17T11:16:42.233846+0000","last_peered":"2026-02-17T11:16:42.233846+0000","last_clean":"2026-02-17T11:16:42.233846+0000","last_became_active":"2026-02-17T11:15:55.252520+0000","last_became_peered":"2026-02-17T11:15:55.252520+0000","last_unstale":"2026-02-17T11:16:42.233846+0000","last_undegraded":"2026-02-17T11:16:42.233846+0000","last_fullsized":"2026-02-17T11:16:42.233846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:16:30.769184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":140934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":28,"seq":120259084304,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":760,"kb_used_omap":4,"kb_used_meta":31547,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":778240,"data_stored":198687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4434,"internal_metadata":32304814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149714,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":356,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":364544,"data_stored":128220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626437,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29512,"kb_used_data":756,"kb_used_omap":11,"kb_used_meta":28724,"kb_avail":94342328,"statfs":{"total":96636764160,"available":96606543872,"internally_reserved":0,"allocated":774144,"data_stored":198668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12165,"internal_metadata":29413499},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0}]}} 2026-02-17T11:17:05.216 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:17:05.369 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:17:05.369 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:17:05.378 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2026-02-17T11:17:04.160660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70486,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93848,"kb_used_data":1872,"kb_used_omap":20,"kb_used_meta":91883,"kb_avail":283021672,"statfs":{"total":289910292480,"available":289814192128,"internally_reserved":0,"allocated":1916928,"data_stored":525575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21034,"internal_metadata":94088662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000939"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235766+0000","last_change":"2026-02-17T11:16:42.235766+0000","last_active":"2026-02-17T11:16:42.235766+0000","last_peered":"2026-02-17T11:16:42.235766+0000","last_clean":"2026-02-17T11:16:42.235766+0000","last_became_active":"2026-02-17T11:16:42.235401+0000","last_became_peered":"2026-02-17T11:16:42.235401+0000","last_unstale":"2026-02-17T11:16:42.235766+0000","last_undegraded":"2026-02-17T11:16:42.235766+0000","last_fullsized":"2026-02-17T11:16:42.235766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:29:22.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233996+0000","last_change":"2026-02-17T11:15:55.253185+0000","last_active":"2026-02-17T11:16:42.233996+0000","last_peered":"2026-02-17T11:16:42.233996+0000","last_clean":"2026-02-17T11:16:42.233996+0000","last_became_active":"2026-02-17T11:15:55.252526+0000","last_became_peered":"2026-02-17T11:15:55.252526+0000","last_unstale":"2026-02-17T11:16:42.233996+0000","last_undegraded":"2026-02-17T11:16:42.233996+0000","last_fullsized":"2026-02-17T11:16:42.233996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:20:44.246266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235887+0000","last_change":"2026-02-17T11:16:42.235887+0000","last_active":"2026-02-17T11:16:42.235887+0000","last_peered":"2026-02-17T11:16:42.235887+0000","last_clean":"2026-02-17T11:16:42.235887+0000","last_became_active":"2026-02-17T11:16:42.235283+0000","last_became_peered":"2026-02-17T11:16:42.235283+0000","last_unstale":"2026-02-17T11:16:42.235887+0000","last_undegraded":"2026-02-17T11:16:42.235887+0000","last_fullsized":"2026-02-17T11:16:42.235887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:47:20.445266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233974+0000","last_change":"2026-02-17T11:15:55.253261+0000","last_active":"2026-02-17T11:16:42.233974+0000","last_peered":"2026-02-17T11:16:42.233974+0000","last_clean":"2026-02-17T11:16:42.233974+0000","last_became_active":"2026-02-17T11:15:55.252575+0000","last_became_peered":"2026-02-17T11:15:55.252575+0000","last_unstale":"2026-02-17T11:16:42.233974+0000","last_undegraded":"2026-02-17T11:16:42.233974+0000","last_fullsized":"2026-02-17T11:16:42.233974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:00:54.457443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'102","reported_seq":170,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.247745+0000","last_change":"2026-02-17T11:16:42.247745+0000","last_active":"2026-02-17T11:16:42.247745+0000","last_peered":"2026-02-17T11:16:42.247745+0000","last_clean":"2026-02-17T11:16:42.247745+0000","last_became_active":"2026-02-17T11:16:42.235714+0000","last_became_peered":"2026-02-17T11:16:42.235714+0000","last_unstale":"2026-02-17T11:16:42.247745+0000","last_undegraded":"2026-02-17T11:16:42.247745+0000","last_fullsized":"2026-02-17T11:16:42.247745+0000","mapping_epoch":42,"log_start":"19'95","ondisk_log_start":"19'95","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":95,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:52:26.939010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":67,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235775+0000","last_change":"2026-02-17T11:16:42.235775+0000","last_active":"2026-02-17T11:16:42.235775+0000","last_peered":"2026-02-17T11:16:42.235775+0000","last_clean":"2026-02-17T11:16:42.235775+0000","last_became_active":"2026-02-17T11:16:42.235420+0000","last_became_peered":"2026-02-17T11:16:42.235420+0000","last_unstale":"2026-02-17T11:16:42.235775+0000","last_undegraded":"2026-02-17T11:16:42.235775+0000","last_fullsized":"2026-02-17T11:16:42.235775+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:48:53.035653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":58,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233061+0000","last_change":"2026-02-17T11:15:54.252471+0000","last_active":"2026-02-17T11:16:42.233061+0000","last_peered":"2026-02-17T11:16:42.233061+0000","last_clean":"2026-02-17T11:16:42.233061+0000","last_became_active":"2026-02-17T11:15:54.252044+0000","last_became_peered":"2026-02-17T11:15:54.252044+0000","last_unstale":"2026-02-17T11:16:42.233061+0000","last_undegraded":"2026-02-17T11:16:42.233061+0000","last_fullsized":"2026-02-17T11:16:42.233061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:41:28.720036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235310+0000","last_change":"2026-02-17T11:16:42.235310+0000","last_active":"2026-02-17T11:16:42.235310+0000","last_peered":"2026-02-17T11:16:42.235310+0000","last_clean":"2026-02-17T11:16:42.235310+0000","last_became_active":"2026-02-17T11:16:42.234976+0000","last_became_peered":"2026-02-17T11:16:42.234976+0000","last_unstale":"2026-02-17T11:16:42.235310+0000","last_undegraded":"2026-02-17T11:16:42.235310+0000","last_fullsized":"2026-02-17T11:16:42.235310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:00:18.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233846+0000","last_change":"2026-02-17T11:15:55.252985+0000","last_active":"2026-02-17T11:16:42.233846+0000","last_peered":"2026-02-17T11:16:42.233846+0000","last_clean":"2026-02-17T11:16:42.233846+0000","last_became_active":"2026-02-17T11:15:55.252520+0000","last_became_peered":"2026-02-17T11:15:55.252520+0000","last_unstale":"2026-02-17T11:16:42.233846+0000","last_undegraded":"2026-02-17T11:16:42.233846+0000","last_fullsized":"2026-02-17T11:16:42.233846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:16:30.769184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":140934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":28,"seq":120259084304,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":760,"kb_used_omap":4,"kb_used_meta":31547,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":778240,"data_stored":198687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4434,"internal_metadata":32304814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149714,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":356,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":364544,"data_stored":128220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626437,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29512,"kb_used_data":756,"kb_used_omap":11,"kb_used_meta":28724,"kb_avail":94342328,"statfs":{"total":96636764160,"available":96606543872,"internally_reserved":0,"allocated":774144,"data_stored":198668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12165,"internal_metadata":29413499},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0}]}} 2026-02-17T11:17:05.379 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:17:05.379 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:17:05.521 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:17:05.521 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:17:05.530 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2026-02-17T11:17:04.160660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70486,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93848,"kb_used_data":1872,"kb_used_omap":20,"kb_used_meta":91883,"kb_avail":283021672,"statfs":{"total":289910292480,"available":289814192128,"internally_reserved":0,"allocated":1916928,"data_stored":525575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21034,"internal_metadata":94088662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000939"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235766+0000","last_change":"2026-02-17T11:16:42.235766+0000","last_active":"2026-02-17T11:16:42.235766+0000","last_peered":"2026-02-17T11:16:42.235766+0000","last_clean":"2026-02-17T11:16:42.235766+0000","last_became_active":"2026-02-17T11:16:42.235401+0000","last_became_peered":"2026-02-17T11:16:42.235401+0000","last_unstale":"2026-02-17T11:16:42.235766+0000","last_undegraded":"2026-02-17T11:16:42.235766+0000","last_fullsized":"2026-02-17T11:16:42.235766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:29:22.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233996+0000","last_change":"2026-02-17T11:15:55.253185+0000","last_active":"2026-02-17T11:16:42.233996+0000","last_peered":"2026-02-17T11:16:42.233996+0000","last_clean":"2026-02-17T11:16:42.233996+0000","last_became_active":"2026-02-17T11:15:55.252526+0000","last_became_peered":"2026-02-17T11:15:55.252526+0000","last_unstale":"2026-02-17T11:16:42.233996+0000","last_undegraded":"2026-02-17T11:16:42.233996+0000","last_fullsized":"2026-02-17T11:16:42.233996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:20:44.246266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235887+0000","last_change":"2026-02-17T11:16:42.235887+0000","last_active":"2026-02-17T11:16:42.235887+0000","last_peered":"2026-02-17T11:16:42.235887+0000","last_clean":"2026-02-17T11:16:42.235887+0000","last_became_active":"2026-02-17T11:16:42.235283+0000","last_became_peered":"2026-02-17T11:16:42.235283+0000","last_unstale":"2026-02-17T11:16:42.235887+0000","last_undegraded":"2026-02-17T11:16:42.235887+0000","last_fullsized":"2026-02-17T11:16:42.235887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:47:20.445266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233974+0000","last_change":"2026-02-17T11:15:55.253261+0000","last_active":"2026-02-17T11:16:42.233974+0000","last_peered":"2026-02-17T11:16:42.233974+0000","last_clean":"2026-02-17T11:16:42.233974+0000","last_became_active":"2026-02-17T11:15:55.252575+0000","last_became_peered":"2026-02-17T11:15:55.252575+0000","last_unstale":"2026-02-17T11:16:42.233974+0000","last_undegraded":"2026-02-17T11:16:42.233974+0000","last_fullsized":"2026-02-17T11:16:42.233974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:00:54.457443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'102","reported_seq":170,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.247745+0000","last_change":"2026-02-17T11:16:42.247745+0000","last_active":"2026-02-17T11:16:42.247745+0000","last_peered":"2026-02-17T11:16:42.247745+0000","last_clean":"2026-02-17T11:16:42.247745+0000","last_became_active":"2026-02-17T11:16:42.235714+0000","last_became_peered":"2026-02-17T11:16:42.235714+0000","last_unstale":"2026-02-17T11:16:42.247745+0000","last_undegraded":"2026-02-17T11:16:42.247745+0000","last_fullsized":"2026-02-17T11:16:42.247745+0000","mapping_epoch":42,"log_start":"19'95","ondisk_log_start":"19'95","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":95,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:52:26.939010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":67,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235775+0000","last_change":"2026-02-17T11:16:42.235775+0000","last_active":"2026-02-17T11:16:42.235775+0000","last_peered":"2026-02-17T11:16:42.235775+0000","last_clean":"2026-02-17T11:16:42.235775+0000","last_became_active":"2026-02-17T11:16:42.235420+0000","last_became_peered":"2026-02-17T11:16:42.235420+0000","last_unstale":"2026-02-17T11:16:42.235775+0000","last_undegraded":"2026-02-17T11:16:42.235775+0000","last_fullsized":"2026-02-17T11:16:42.235775+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:48:53.035653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":58,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233061+0000","last_change":"2026-02-17T11:15:54.252471+0000","last_active":"2026-02-17T11:16:42.233061+0000","last_peered":"2026-02-17T11:16:42.233061+0000","last_clean":"2026-02-17T11:16:42.233061+0000","last_became_active":"2026-02-17T11:15:54.252044+0000","last_became_peered":"2026-02-17T11:15:54.252044+0000","last_unstale":"2026-02-17T11:16:42.233061+0000","last_undegraded":"2026-02-17T11:16:42.233061+0000","last_fullsized":"2026-02-17T11:16:42.233061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:41:28.720036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235310+0000","last_change":"2026-02-17T11:16:42.235310+0000","last_active":"2026-02-17T11:16:42.235310+0000","last_peered":"2026-02-17T11:16:42.235310+0000","last_clean":"2026-02-17T11:16:42.235310+0000","last_became_active":"2026-02-17T11:16:42.234976+0000","last_became_peered":"2026-02-17T11:16:42.234976+0000","last_unstale":"2026-02-17T11:16:42.235310+0000","last_undegraded":"2026-02-17T11:16:42.235310+0000","last_fullsized":"2026-02-17T11:16:42.235310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:00:18.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233846+0000","last_change":"2026-02-17T11:15:55.252985+0000","last_active":"2026-02-17T11:16:42.233846+0000","last_peered":"2026-02-17T11:16:42.233846+0000","last_clean":"2026-02-17T11:16:42.233846+0000","last_became_active":"2026-02-17T11:15:55.252520+0000","last_became_peered":"2026-02-17T11:15:55.252520+0000","last_unstale":"2026-02-17T11:16:42.233846+0000","last_undegraded":"2026-02-17T11:16:42.233846+0000","last_fullsized":"2026-02-17T11:16:42.233846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:16:30.769184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":140934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":28,"seq":120259084304,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":760,"kb_used_omap":4,"kb_used_meta":31547,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":778240,"data_stored":198687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4434,"internal_metadata":32304814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149714,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":356,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":364544,"data_stored":128220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626437,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29512,"kb_used_data":756,"kb_used_omap":11,"kb_used_meta":28724,"kb_avail":94342328,"statfs":{"total":96636764160,"available":96606543872,"internally_reserved":0,"allocated":774144,"data_stored":198668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12165,"internal_metadata":29413499},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0}]}} 2026-02-17T11:17:05.532 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:17:05.682 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:17:05.682 INFO:teuthology.orchestra.run.trial109.stdout:{"epoch":43,"fsid":"145943f2-efc8-4ce6-8d3c-254689d8dfe1","created":"2026-02-17T11:14:40.071089+0000","modified":"2026-02-17T11:16:42.230439+0000","last_up_change":"2026-02-17T11:16:41.228061+0000","last_in_change":"2026-02-17T11:15:53.245803+0000","flags":"nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800384,"flags_set":["nodown","noin","noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T11:14:54.449014+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"foo","create_time":"2026-02-17T11:15:07.522714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c3afd2a-70ca-4a51-8063-7f991469117c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":26,"up_thru":41,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6802","nonce":3895160025},{"type":"v1","addr":"10.20.193.109:6803","nonce":3895160025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6804","nonce":3895160025},{"type":"v1","addr":"10.20.193.109:6805","nonce":3895160025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6808","nonce":3895160025},{"type":"v1","addr":"10.20.193.109:6809","nonce":3895160025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6806","nonce":3895160025},{"type":"v1","addr":"10.20.193.109:6807","nonce":3895160025}]},"public_addr":"10.20.193.109:6803/3895160025","cluster_addr":"10.20.193.109:6805/3895160025","heartbeat_back_addr":"10.20.193.109:6809/3895160025","heartbeat_front_addr":"10.20.193.109:6807/3895160025","state":["exists","up"]},{"osd":1,"uuid":"03ab0fe1-da71-4b96-987a-5cfb0998c0c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":28,"up_thru":42,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6810","nonce":2658053127},{"type":"v1","addr":"10.20.193.109:6811","nonce":2658053127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6812","nonce":2658053127},{"type":"v1","addr":"10.20.193.109:6813","nonce":2658053127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6816","nonce":2658053127},{"type":"v1","addr":"10.20.193.109:6817","nonce":2658053127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6814","nonce":2658053127},{"type":"v1","addr":"10.20.193.109:6815","nonce":2658053127}]},"public_addr":"10.20.193.109:6811/2658053127","cluster_addr":"10.20.193.109:6813/2658053127","heartbeat_back_addr":"10.20.193.109:6817/2658053127","heartbeat_front_addr":"10.20.193.109:6815/2658053127","state":["exists","up"]},{"osd":2,"uuid":"7b10d72c-c96d-4a1e-8a86-90968a898435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":39,"up_from":42,"up_thru":42,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6818","nonce":3934698030},{"type":"v1","addr":"10.20.193.109:6819","nonce":3934698030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6820","nonce":3934698030},{"type":"v1","addr":"10.20.193.109:6821","nonce":3934698030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6824","nonce":3934698030},{"type":"v1","addr":"10.20.193.109:6825","nonce":3934698030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.109:6822","nonce":3934698030},{"type":"v1","addr":"10.20.193.109:6823","nonce":3934698030}]},"public_addr":"10.20.193.109:6819/3934698030","cluster_addr":"10.20.193.109:6821/3934698030","heartbeat_back_addr":"10.20.193.109:6825/3934698030","heartbeat_front_addr":"10.20.193.109:6823/3934698030","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-17T11:15:27.596246+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:14:47.278043+0000","dead_epoch":0},{"osd":1,"down_stamp":"2026-02-17T11:15:28.599672+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:14:47.843294+0000","dead_epoch":0},{"osd":2,"down_stamp":"2026-02-17T11:16:40.226582+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:14:47.135884+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:17:06.693 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T11:17:06.694 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:17:06.767 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:17:06.767 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:17:06.767 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:17:06.776 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T11:17:06.921 INFO:teuthology.orchestra.run.trial109.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T11:17:06.933 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T11:17:06.933 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:17:07.015 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:17:07.015 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:17:07.015 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:17:07.025 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T11:17:07.179 INFO:teuthology.orchestra.run.trial109.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T11:17:07.192 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T11:17:07.192 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:17:07.273 INFO:teuthology.orchestra.run.trial109.stdout:{ 2026-02-17T11:17:07.274 INFO:teuthology.orchestra.run.trial109.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:17:07.274 INFO:teuthology.orchestra.run.trial109.stdout:} 2026-02-17T11:17:07.283 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T11:17:07.426 INFO:teuthology.orchestra.run.trial109.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T11:17:07.437 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:17:07.590 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:17:07.590 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:17:07.601 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2026-02-17T11:17:06.160849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70486,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93848,"kb_used_data":1872,"kb_used_omap":20,"kb_used_meta":91883,"kb_avail":283021672,"statfs":{"total":289910292480,"available":289814192128,"internally_reserved":0,"allocated":1916928,"data_stored":525575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21034,"internal_metadata":94088662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000977"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235766+0000","last_change":"2026-02-17T11:16:42.235766+0000","last_active":"2026-02-17T11:16:42.235766+0000","last_peered":"2026-02-17T11:16:42.235766+0000","last_clean":"2026-02-17T11:16:42.235766+0000","last_became_active":"2026-02-17T11:16:42.235401+0000","last_became_peered":"2026-02-17T11:16:42.235401+0000","last_unstale":"2026-02-17T11:16:42.235766+0000","last_undegraded":"2026-02-17T11:16:42.235766+0000","last_fullsized":"2026-02-17T11:16:42.235766+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:29:22.075064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233996+0000","last_change":"2026-02-17T11:15:55.253185+0000","last_active":"2026-02-17T11:16:42.233996+0000","last_peered":"2026-02-17T11:16:42.233996+0000","last_clean":"2026-02-17T11:16:42.233996+0000","last_became_active":"2026-02-17T11:15:55.252526+0000","last_became_peered":"2026-02-17T11:15:55.252526+0000","last_unstale":"2026-02-17T11:16:42.233996+0000","last_undegraded":"2026-02-17T11:16:42.233996+0000","last_fullsized":"2026-02-17T11:16:42.233996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:20:44.246266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235887+0000","last_change":"2026-02-17T11:16:42.235887+0000","last_active":"2026-02-17T11:16:42.235887+0000","last_peered":"2026-02-17T11:16:42.235887+0000","last_clean":"2026-02-17T11:16:42.235887+0000","last_became_active":"2026-02-17T11:16:42.235283+0000","last_became_peered":"2026-02-17T11:16:42.235283+0000","last_unstale":"2026-02-17T11:16:42.235887+0000","last_undegraded":"2026-02-17T11:16:42.235887+0000","last_fullsized":"2026-02-17T11:16:42.235887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:47:20.445266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233974+0000","last_change":"2026-02-17T11:15:55.253261+0000","last_active":"2026-02-17T11:16:42.233974+0000","last_peered":"2026-02-17T11:16:42.233974+0000","last_clean":"2026-02-17T11:16:42.233974+0000","last_became_active":"2026-02-17T11:15:55.252575+0000","last_became_peered":"2026-02-17T11:15:55.252575+0000","last_unstale":"2026-02-17T11:16:42.233974+0000","last_undegraded":"2026-02-17T11:16:42.233974+0000","last_fullsized":"2026-02-17T11:16:42.233974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:00:54.457443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'102","reported_seq":170,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.247745+0000","last_change":"2026-02-17T11:16:42.247745+0000","last_active":"2026-02-17T11:16:42.247745+0000","last_peered":"2026-02-17T11:16:42.247745+0000","last_clean":"2026-02-17T11:16:42.247745+0000","last_became_active":"2026-02-17T11:16:42.235714+0000","last_became_peered":"2026-02-17T11:16:42.235714+0000","last_unstale":"2026-02-17T11:16:42.247745+0000","last_undegraded":"2026-02-17T11:16:42.247745+0000","last_fullsized":"2026-02-17T11:16:42.247745+0000","mapping_epoch":42,"log_start":"19'95","ondisk_log_start":"19'95","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:15:08.031948+0000","last_clean_scrub_stamp":"2026-02-17T11:15:08.031948+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":95,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:52:26.939010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":67,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235775+0000","last_change":"2026-02-17T11:16:42.235775+0000","last_active":"2026-02-17T11:16:42.235775+0000","last_peered":"2026-02-17T11:16:42.235775+0000","last_clean":"2026-02-17T11:16:42.235775+0000","last_became_active":"2026-02-17T11:16:42.235420+0000","last_became_peered":"2026-02-17T11:16:42.235420+0000","last_unstale":"2026-02-17T11:16:42.235775+0000","last_undegraded":"2026-02-17T11:16:42.235775+0000","last_fullsized":"2026-02-17T11:16:42.235775+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:48:53.035653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":58,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233061+0000","last_change":"2026-02-17T11:15:54.252471+0000","last_active":"2026-02-17T11:16:42.233061+0000","last_peered":"2026-02-17T11:16:42.233061+0000","last_clean":"2026-02-17T11:16:42.233061+0000","last_became_active":"2026-02-17T11:15:54.252044+0000","last_became_peered":"2026-02-17T11:15:54.252044+0000","last_unstale":"2026-02-17T11:16:42.233061+0000","last_undegraded":"2026-02-17T11:16:42.233061+0000","last_fullsized":"2026-02-17T11:16:42.233061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:41:28.720036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.235310+0000","last_change":"2026-02-17T11:16:42.235310+0000","last_active":"2026-02-17T11:16:42.235310+0000","last_peered":"2026-02-17T11:16:42.235310+0000","last_clean":"2026-02-17T11:16:42.235310+0000","last_became_active":"2026-02-17T11:16:42.234976+0000","last_became_peered":"2026-02-17T11:16:42.234976+0000","last_unstale":"2026-02-17T11:16:42.235310+0000","last_undegraded":"2026-02-17T11:16:42.235310+0000","last_fullsized":"2026-02-17T11:16:42.235310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:00:18.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:16:42.233846+0000","last_change":"2026-02-17T11:15:55.252985+0000","last_active":"2026-02-17T11:16:42.233846+0000","last_peered":"2026-02-17T11:16:42.233846+0000","last_clean":"2026-02-17T11:16:42.233846+0000","last_became_active":"2026-02-17T11:15:55.252520+0000","last_became_peered":"2026-02-17T11:15:55.252520+0000","last_unstale":"2026-02-17T11:16:42.233846+0000","last_undegraded":"2026-02-17T11:16:42.233846+0000","last_fullsized":"2026-02-17T11:16:42.233846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:14:55.159870+0000","last_clean_scrub_stamp":"2026-02-17T11:14:55.159870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:16:30.769184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":140934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":28,"seq":120259084304,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":760,"kb_used_omap":4,"kb_used_meta":31547,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":778240,"data_stored":198687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4434,"internal_metadata":32304814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149714,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":356,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":364544,"data_stored":128220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626438,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29512,"kb_used_data":756,"kb_used_omap":11,"kb_used_meta":28724,"kb_avail":94342328,"statfs":{"total":96636764160,"available":96606543872,"internally_reserved":0,"allocated":774144,"data_stored":198668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12165,"internal_metadata":29413499},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0}]}} 2026-02-17T11:17:07.606 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.607 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.607 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.607 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.607 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T11:15:08.031948+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=15, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.607 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.608 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.608 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.608 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T11:14:55.159870+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=14, tm_sec=55, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=11, tm_min=17, tm_sec=5, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T11:17:07.608 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T11:17:27.609 DEBUG:teuthology.orchestra.run.trial109:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:17:27.766 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-17T11:17:27.766 INFO:teuthology.orchestra.run.trial109.stderr:dumped all 2026-02-17T11:17:27.777 INFO:teuthology.orchestra.run.trial109.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-02-17T11:17:26.125666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70486,"num_objects":103,"num_object_clones":0,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":104,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93824,"kb_used_data":1872,"kb_used_omap":20,"kb_used_meta":91883,"kb_avail":283021696,"statfs":{"total":289910292480,"available":289814216704,"internally_reserved":0,"allocated":1916928,"data_stored":525575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21034,"internal_metadata":94088662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.963885"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:10.904705+0000","last_change":"2026-02-17T11:17:10.904732+0000","last_active":"2026-02-17T11:17:10.904705+0000","last_peered":"2026-02-17T11:17:10.904705+0000","last_clean":"2026-02-17T11:17:10.904705+0000","last_became_active":"2026-02-17T11:16:42.235401+0000","last_became_peered":"2026-02-17T11:16:42.235401+0000","last_unstale":"2026-02-17T11:17:10.904705+0000","last_undegraded":"2026-02-17T11:17:10.904705+0000","last_fullsized":"2026-02-17T11:17:10.904705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:17:10.904631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:17:10.904631+0000","last_clean_scrub_stamp":"2026-02-17T11:17:10.904631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:25:08.933191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058893499999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":63,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:08.944541+0000","last_change":"2026-02-17T11:17:08.944555+0000","last_active":"2026-02-17T11:17:08.944541+0000","last_peered":"2026-02-17T11:17:08.944541+0000","last_clean":"2026-02-17T11:17:08.944541+0000","last_became_active":"2026-02-17T11:15:55.252526+0000","last_became_peered":"2026-02-17T11:15:55.252526+0000","last_unstale":"2026-02-17T11:17:08.944541+0000","last_undegraded":"2026-02-17T11:17:08.944541+0000","last_fullsized":"2026-02-17T11:17:08.944541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:17:08.944490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:17:08.944490+0000","last_clean_scrub_stamp":"2026-02-17T11:17:08.944490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:56:37.919809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063426900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:08.929442+0000","last_change":"2026-02-17T11:17:08.929457+0000","last_active":"2026-02-17T11:17:08.929442+0000","last_peered":"2026-02-17T11:17:08.929442+0000","last_clean":"2026-02-17T11:17:08.929442+0000","last_became_active":"2026-02-17T11:16:42.235283+0000","last_became_peered":"2026-02-17T11:16:42.235283+0000","last_unstale":"2026-02-17T11:17:08.929442+0000","last_undegraded":"2026-02-17T11:17:08.929442+0000","last_fullsized":"2026-02-17T11:17:08.929442+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:17:08.929398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:17:08.929398+0000","last_clean_scrub_stamp":"2026-02-17T11:17:08.929398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:35:33.651676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":63,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:09.939219+0000","last_change":"2026-02-17T11:17:09.939238+0000","last_active":"2026-02-17T11:17:09.939219+0000","last_peered":"2026-02-17T11:17:09.939219+0000","last_clean":"2026-02-17T11:17:09.939219+0000","last_became_active":"2026-02-17T11:15:55.252575+0000","last_became_peered":"2026-02-17T11:15:55.252575+0000","last_unstale":"2026-02-17T11:17:09.939219+0000","last_undegraded":"2026-02-17T11:17:09.939219+0000","last_fullsized":"2026-02-17T11:17:09.939219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:17:09.939162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:17:09.939162+0000","last_clean_scrub_stamp":"2026-02-17T11:17:09.939162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:42:59.679718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072130899999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"43'203","reported_seq":296,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:09.935878+0000","last_change":"2026-02-17T11:17:09.935899+0000","last_active":"2026-02-17T11:17:09.935878+0000","last_peered":"2026-02-17T11:17:09.935878+0000","last_clean":"2026-02-17T11:17:09.935878+0000","last_became_active":"2026-02-17T11:16:42.235714+0000","last_became_peered":"2026-02-17T11:16:42.235714+0000","last_unstale":"2026-02-17T11:17:09.935878+0000","last_undegraded":"2026-02-17T11:17:09.935878+0000","last_fullsized":"2026-02-17T11:17:09.935878+0000","mapping_epoch":42,"log_start":"19'95","ondisk_log_start":"19'95","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'203","last_scrub_stamp":"2026-02-17T11:17:09.935827+0000","last_deep_scrub":"43'203","last_deep_scrub_stamp":"2026-02-17T11:17:09.935827+0000","last_clean_scrub_stamp":"2026-02-17T11:17:09.935827+0000","objects_scrubbed":101,"log_size":108,"log_dups_size":95,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:41:39.192275+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"43'2","reported_seq":77,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:11.915125+0000","last_change":"2026-02-17T11:17:11.915145+0000","last_active":"2026-02-17T11:17:11.915125+0000","last_peered":"2026-02-17T11:17:11.915125+0000","last_clean":"2026-02-17T11:17:11.915125+0000","last_became_active":"2026-02-17T11:16:42.235420+0000","last_became_peered":"2026-02-17T11:16:42.235420+0000","last_unstale":"2026-02-17T11:17:11.915125+0000","last_undegraded":"2026-02-17T11:17:11.915125+0000","last_fullsized":"2026-02-17T11:17:11.915125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'2","last_scrub_stamp":"2026-02-17T11:17:11.915076+0000","last_deep_scrub":"43'2","last_deep_scrub_stamp":"2026-02-17T11:17:11.915076+0000","last_clean_scrub_stamp":"2026-02-17T11:17:11.915076+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:08:47.331656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00032480900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"43'3","reported_seq":68,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:07.580757+0000","last_change":"2026-02-17T11:17:07.580778+0000","last_active":"2026-02-17T11:17:07.580757+0000","last_peered":"2026-02-17T11:17:07.580757+0000","last_clean":"2026-02-17T11:17:07.580757+0000","last_became_active":"2026-02-17T11:15:54.252044+0000","last_became_peered":"2026-02-17T11:15:54.252044+0000","last_unstale":"2026-02-17T11:17:07.580757+0000","last_undegraded":"2026-02-17T11:17:07.580757+0000","last_fullsized":"2026-02-17T11:17:07.580757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3","last_scrub_stamp":"2026-02-17T11:17:07.580706+0000","last_deep_scrub":"43'3","last_deep_scrub_stamp":"2026-02-17T11:17:07.580706+0000","last_clean_scrub_stamp":"2026-02-17T11:17:07.580706+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:23:04.456775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060682800000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:07.945984+0000","last_change":"2026-02-17T11:17:07.946004+0000","last_active":"2026-02-17T11:17:07.945984+0000","last_peered":"2026-02-17T11:17:07.945984+0000","last_clean":"2026-02-17T11:17:07.945984+0000","last_became_active":"2026-02-17T11:16:42.234976+0000","last_became_peered":"2026-02-17T11:16:42.234976+0000","last_unstale":"2026-02-17T11:17:07.945984+0000","last_undegraded":"2026-02-17T11:17:07.945984+0000","last_fullsized":"2026-02-17T11:17:07.945984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:17:07.945932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:17:07.945932+0000","last_clean_scrub_stamp":"2026-02-17T11:17:07.945932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:54:59.174538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:17:07.923213+0000","last_change":"2026-02-17T11:17:07.923236+0000","last_active":"2026-02-17T11:17:07.923213+0000","last_peered":"2026-02-17T11:17:07.923213+0000","last_clean":"2026-02-17T11:17:07.923213+0000","last_became_active":"2026-02-17T11:15:55.252520+0000","last_became_peered":"2026-02-17T11:15:55.252520+0000","last_unstale":"2026-02-17T11:17:07.923213+0000","last_undegraded":"2026-02-17T11:17:07.923213+0000","last_fullsized":"2026-02-17T11:17:07.923213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:17:07.923152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:17:07.923152+0000","last_clean_scrub_stamp":"2026-02-17T11:17:07.923152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:56:02.541151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000310933,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":70467,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":102,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":7917,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":140934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":28,"seq":120259084308,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":760,"kb_used_omap":4,"kb_used_meta":31547,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":778240,"data_stored":198687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4434,"internal_metadata":32304814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":356,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":364544,"data_stored":128220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626442,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29508,"kb_used_data":756,"kb_used_omap":11,"kb_used_meta":28724,"kb_avail":94342332,"statfs":{"total":96636764160,"available":96606547968,"internally_reserved":0,"allocated":774144,"data_stored":198668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12165,"internal_metadata":29413499},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":70467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6084,"internal_metadata":0}]}} 2026-02-17T11:17:27.779 DEBUG:teuthology.orchestra.run.trial109:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T11:17:27.936 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T11:17:27.936 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T11:17:27.936 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T11:17:27.937 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:17:28.012 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T11:17:28.012 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T11:17:28.013 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:17:28.096 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T11:17:28.097 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T11:17:28.097 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:17:28.167 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T11:17:28.167 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T11:17:28.167 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T11:17:28.167 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:17:28.193 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T11:17:28.193 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T11:17:28.193 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:17:28.193 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:17:28.246 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:17:28.246 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T11:17:28.246 DEBUG:teuthology.orchestra.run.trial109:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(OBJECT_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(MON_DOWN\)' | head -n 1 2026-02-17T11:17:28.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:17:28.298 DEBUG:teuthology.orchestra.run.trial109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T11:17:28.355 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:17:28.355 DEBUG:teuthology.orchestra.run.trial109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T11:17:28.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:17:28.405 DEBUG:teuthology.orchestra.run.trial109:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T11:17:28.457 INFO:tasks.ceph:Archiving mon data... 2026-02-17T11:17:28.458 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51274/data/mon.a.tgz 2026-02-17T11:17:28.459 DEBUG:teuthology.orchestra.run.trial109:> mktemp 2026-02-17T11:17:28.502 INFO:teuthology.orchestra.run.trial109.stdout:/tmp/tmp.yXHNIzUfpD 2026-02-17T11:17:28.502 DEBUG:teuthology.orchestra.run.trial109:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yXHNIzUfpD 2026-02-17T11:17:28.572 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod 0666 /tmp/tmp.yXHNIzUfpD 2026-02-17T11:17:28.671 DEBUG:teuthology.orchestra.remote:trial109:/tmp/tmp.yXHNIzUfpD is 177KB 2026-02-17T11:17:28.679 DEBUG:teuthology.orchestra.run.trial109:> rm -fr /tmp/tmp.yXHNIzUfpD 2026-02-17T11:17:28.682 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T11:17:28.682 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:17:28.775 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T11:17:28.775 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T11:17:28.777 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51274/remote/trial109/crash 2026-02-17T11:17:28.779 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:17:28.823 INFO:tasks.ceph:Compressing logs... 2026-02-17T11:17:28.824 DEBUG:teuthology.orchestra.run.trial109:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:17:28.876 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20495.log 2026-02-17T11:17:28.877 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27639.log 2026-02-17T11:17:28.877 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20495.log.gz 2026-02-17T11:17:28.877 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21997.log 2026-02-17T11:17:28.878 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15526.log 2026-02-17T11:17:28.878 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27639.log: /var/log/ceph/ceph-client.admin.21997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21997.log.gz 2026-02-17T11:17:28.878 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21617.log 2026-02-17T11:17:28.879 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27639.log.gz 2026-02-17T11:17:28.879 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20385.log 2026-02-17T11:17:28.879 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.15526.log: /var/log/ceph/ceph-client.admin.21617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15526.log.gz 2026-02-17T11:17:28.879 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21617.log.gz 2026-02-17T11:17:28.879 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19637.log 2026-02-17T11:17:28.879 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23873.log 2026-02-17T11:17:28.880 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20385.log: /var/log/ceph/ceph-client.admin.19637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20385.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19637.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21871.log 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18965.log 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23873.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21871.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21023.log 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27418.log 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18965.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21023.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20407.log 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21868.log 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27418.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20407.log.gz 2026-02-17T11:17:28.881 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20341.log 2026-02-17T11:17:28.883 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21868.log.gz 2026-02-17T11:17:28.883 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19945.log 2026-02-17T11:17:28.883 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27665.log 2026-02-17T11:17:28.883 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20341.log.gz 2026-02-17T11:17:28.883 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21265.log/var/log/ceph/ceph-client.admin.19945.log: 2026-02-17T11:17:28.883 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19945.log.gz 2026-02-17T11:17:28.883 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21111.log 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27665.log.gz 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20913.log 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21265.log.gz 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19116.log 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21111.log.gz 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20913.log.gz 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19967.log 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18966.log 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19116.log.gz 2026-02-17T11:17:28.884 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21221.log 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19967.log.gz 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18966.log.gz 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21573.log 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23821.log 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21221.log.gz 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21485.log 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21573.log: /var/log/ceph/ceph-client.admin.23821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21573.log.gz 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21067.log 2026-02-17T11:17:28.886 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23821.log.gz 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21485.log.gz 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21463.log 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20825.log 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21067.log.gz 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20187.log 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21463.log.gz 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21441.log 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20825.log.gz 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19296.log 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20187.log.gz 2026-02-17T11:17:28.887 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21441.log.gz 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21721.log 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23847.log 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19296.log.gz 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27485.log 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21721.log.gz 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23847.log.gz 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20517.log 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19244.log 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27485.log.gz 2026-02-17T11:17:28.889 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21309.log 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20517.log.gz 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27691.log 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19244.log.gz 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23985.log 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21309.log.gz 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19461.log 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27691.log.gz 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23985.log.gz 2026-02-17T11:17:28.890 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18906.log 2026-02-17T11:17:28.892 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21199.log 2026-02-17T11:17:28.892 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19461.log.gz 2026-02-17T11:17:28.892 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21089.log 2026-02-17T11:17:28.892 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18906.log.gz 2026-02-17T11:17:28.892 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21199.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23951.log 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21089.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19043.log 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18703.log 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23951.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20121.log 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19043.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18461.log 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18703.log: /var/log/ceph/ceph-client.admin.20121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18703.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20121.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24996.log 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18461.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19879.log 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.24996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24996.log.gz 2026-02-17T11:17:28.893 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19593.log 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19571.log 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19879.log.gz 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18227.log 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19593.log.gz 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19571.log.gz 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21177.log 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18227.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18227.log.gz 2026-02-17T11:17:28.895 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19835.log 2026-02-17T11:17:28.896 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21177.log.gz 2026-02-17T11:17:28.896 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27529.log 2026-02-17T11:17:28.896 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19218.log 2026-02-17T11:17:28.896 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19835.log.gz 2026-02-17T11:17:28.896 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20957.log 2026-02-17T11:17:28.896 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27529.log.gz 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27769.log 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19218.log.gz 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21133.log 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20957.log.gz 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24973.log 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27769.log.gz 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18513.log 2026-02-17T11:17:28.898 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21133.log.gz 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.24973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23773.log 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24973.log.gz 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18513.log.gz 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18801.log 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27821.log 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23773.log.gz 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20055.log 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18801.log.gz 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27821.log.gz 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20693.log 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20055.log.gz 2026-02-17T11:17:28.899 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21045.log 2026-02-17T11:17:28.901 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T11:17:28.901 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20693.log: /var/log/ceph/ceph-client.admin.21045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21419.log 2026-02-17T11:17:28.901 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21045.log.gz 2026-02-17T11:17:28.901 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20693.log.gz 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27847.log 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20473.log 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21419.log.gz 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21742.log 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27847.log.gz 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20429.log 0.0% 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr: -- replaced with /var/log/ceph/ceph-client.admin.20473.log.gz 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21742.log.gz 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18487.log 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27392.log 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20429.log.gz 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18487.log.gz 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19725.log 2026-02-17T11:17:28.902 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19483.log 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27392.log.gz 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18441.log 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19725.log.gz 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19483.log.gz 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18617.log 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18441.log.gz 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18545.log 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18617.log.gz 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18773.log 2026-02-17T11:17:28.904 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21397.log 2026-02-17T11:17:28.905 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18545.log.gz 2026-02-17T11:17:28.905 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18773.log.gz 2026-02-17T11:17:28.905 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19170.log 2026-02-17T11:17:28.905 INFO:teuthology.orchestra.run.trial109.stderr:gzip/var/log/ceph/ceph-client.admin.21397.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.18416.log 2026-02-17T11:17:28.905 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21397.log.gz 2026-02-17T11:17:28.905 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19438.log 2026-02-17T11:17:28.905 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19170.log.gz 2026-02-17T11:17:28.906 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18416.log.gz 2026-02-17T11:17:28.906 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18702.log 2026-02-17T11:17:28.906 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21690.log 2026-02-17T11:17:28.906 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19438.log.gz 2026-02-17T11:17:28.906 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18702.log.gz 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19923.log 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20979.log 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21690.log.gz 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19923.log.gz 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27595.log 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20979.log.gz 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18851.log 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27595.log.gz 2026-02-17T11:17:28.907 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11833.log 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20671.log 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18851.log.gz 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph.tmp-client.admin.11833.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11833.log.gz 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20737.log 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21551.log 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20671.log.gz 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21779.log 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20737.log: /var/log/ceph/ceph-client.admin.21551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20737.log.gz 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21551.log.gz 2026-02-17T11:17:28.908 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19989.log 2026-02-17T11:17:28.909 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21779.log.gz 2026-02-17T11:17:28.909 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19549.log 2026-02-17T11:17:28.909 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18624.log 2026-02-17T11:17:28.909 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19989.log.gz 2026-02-17T11:17:28.909 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19549.log.gz 2026-02-17T11:17:28.909 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18391.log 2026-02-17T11:17:28.909 INFO:teuthology.orchestra.run.trial109.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27366.log 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18624.log.gz 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21822.log 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18391.log.gz 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27366.log.gz 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21844.log 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20781.log 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21822.log.gz 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21844.log.gz 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20231.log 2026-02-17T11:17:28.911 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18877.log 2026-02-17T11:17:28.912 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20781.log.gz 2026-02-17T11:17:28.912 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20231.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.25769.log 2026-02-17T11:17:28.912 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20231.log.gz 2026-02-17T11:17:28.912 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20297.log 2026-02-17T11:17:28.912 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18877.log.gz 2026-02-17T11:17:28.912 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18932.log 2026-02-17T11:17:28.912 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/objectstore_tool.25769.log: /var/log/ceph/ceph-client.admin.20297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20297.log.gz 2026-02-17T11:17:28.913 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21529.log 2026-02-17T11:17:28.913 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20253.log 2026-02-17T11:17:28.913 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18932.log.gz 2026-02-17T11:17:28.913 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21529.log.gz 2026-02-17T11:17:28.913 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27463.log 2026-02-17T11:17:28.913 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20253.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T11:17:28.914 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20253.log.gz 2026-02-17T11:17:28.914 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19348.log 2026-02-17T11:17:28.914 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27463.log.gz 2026-02-17T11:17:28.914 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20847.log 2026-02-17T11:17:28.915 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.19348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19348.log.gz 2026-02-17T11:17:28.915 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19118.log 2026-02-17T11:17:28.915 INFO:teuthology.orchestra.run.trial109.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T11:17:28.915 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27873.log 2026-02-17T11:17:28.915 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20847.log: /var/log/ceph/ceph-client.admin.19118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20847.log.gz 2026-02-17T11:17:28.915 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19118.log.gz 2026-02-17T11:17:28.915 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27573.log 2026-02-17T11:17:28.916 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21595.log 2026-02-17T11:17:28.916 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27873.log.gz 2026-02-17T11:17:28.916 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27573.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T11:17:28.916 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27573.log.gz 2026-02-17T11:17:28.916 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19505.log 2026-02-17T11:17:28.916 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21595.log.gz 2026-02-17T11:17:28.916 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22049.log 2026-02-17T11:17:28.917 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18777.log 2026-02-17T11:17:28.917 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19505.log.gz 2026-02-17T11:17:28.917 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.22049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22049.log.gz 2026-02-17T11:17:28.917 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24920.log 2026-02-17T11:17:28.918 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19044.log 2026-02-17T11:17:28.918 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18777.log.gz 2026-02-17T11:17:28.918 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.24920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24920.log.gz 2026-02-17T11:17:28.918 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20715.log 2026-02-17T11:17:28.918 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19270.log 2026-02-17T11:17:28.918 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19044.log.gz 2026-02-17T11:17:28.919 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27975.log 2026-02-17T11:17:28.919 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20715.log.gz 2026-02-17T11:17:28.919 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19412.log 2026-02-17T11:17:28.919 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19270.log.gz 2026-02-17T11:17:28.919 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27975.log.gz 2026-02-17T11:17:28.919 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21866.log 2026-02-17T11:17:28.920 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19791.log 2026-02-17T11:17:28.920 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19412.log.gz 2026-02-17T11:17:28.920 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21866.log.gz 2026-02-17T11:17:28.920 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T11:17:28.920 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27507.log 2026-02-17T11:17:28.920 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19791.log.gz 2026-02-17T11:17:28.921 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20759.log 2026-02-17T11:17:28.921 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27507.log.gz 2026-02-17T11:17:28.921 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21800.log 2026-02-17T11:17:28.921 INFO:teuthology.orchestra.run.trial109.stderr: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T11:17:28.922 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20649.log 2026-02-17T11:17:28.922 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20759.log.gz 2026-02-17T11:17:28.922 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21800.log.gz 2026-02-17T11:17:28.922 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21001.log 2026-02-17T11:17:28.922 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21331.log 2026-02-17T11:17:28.923 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20649.log.gz 2026-02-17T11:17:28.923 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21001.log.gz 2026-02-17T11:17:28.923 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18964.log 2026-02-17T11:17:28.923 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21331.log.gz 2026-02-17T11:17:28.923 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27551.log 2026-02-17T11:17:28.923 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27925.log 2026-02-17T11:17:28.923 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18964.log.gz 2026-02-17T11:17:28.924 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15675.log 2026-02-17T11:17:28.924 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27551.log.gz 2026-02-17T11:17:28.924 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27925.log.gz 2026-02-17T11:17:28.924 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15409.log 2026-02-17T11:17:28.924 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.15675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20561.log 2026-02-17T11:17:28.925 INFO:teuthology.orchestra.run.trial109.stderr: 26.9% -- replaced with /var/log/ceph/ceph-client.admin.15675.log.gz 2026-02-17T11:17:28.925 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.15409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20165.log 2026-02-17T11:17:28.925 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15409.log.gz 2026-02-17T11:17:28.925 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20561.log: 94.2% -- replaced with /var/log/ceph/objectstore_tool.25769.log.gz 2026-02-17T11:17:28.925 INFO:teuthology.orchestra.run.trial109.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.20561.log.gz 2026-02-17T11:17:28.925 INFO:teuthology.orchestra.run.trial109.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.19769.log 2026-02-17T11:17:28.926 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20605.log 2026-02-17T11:17:28.926 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20165.log.gz 2026-02-17T11:17:28.926 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23747.log 2026-02-17T11:17:28.926 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19769.log.gz 2026-02-17T11:17:28.926 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20605.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.19703.log -- replaced with /var/log/ceph/ceph-client.admin.20605.log.gz 2026-02-17T11:17:28.927 INFO:teuthology.orchestra.run.trial109.stderr: 2026-02-17T11:17:28.927 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20539.log 2026-02-17T11:17:28.927 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23747.log.gz 2026-02-17T11:17:28.927 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19659.log 2026-02-17T11:17:28.927 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19703.log.gz 2026-02-17T11:17:28.928 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27951.log 2026-02-17T11:17:28.928 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20539.log.gz 2026-02-17T11:17:28.928 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19659.log.gz 2026-02-17T11:17:28.928 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21971.log 2026-02-17T11:17:28.929 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27899.log 2026-02-17T11:17:28.929 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27951.log.gz 2026-02-17T11:17:28.929 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21971.log.gz 2026-02-17T11:17:28.929 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19042.log 2026-02-17T11:17:28.929 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21664.log 2026-02-17T11:17:28.929 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27899.log.gz 2026-02-17T11:17:28.930 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15609.log 2026-02-17T11:17:28.930 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19042.log.gz 2026-02-17T11:17:28.930 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21664.log.gz 2026-02-17T11:17:28.930 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21764.log 2026-02-17T11:17:28.931 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21287.log 2026-02-17T11:17:28.931 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.15609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15609.log.gz 2026-02-17T11:17:28.931 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21764.log.gz 2026-02-17T11:17:28.931 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19747.log 2026-02-17T11:17:28.931 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21287.log.gz 2026-02-17T11:17:28.931 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19901.log 2026-02-17T11:17:28.931 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18547.log 2026-02-17T11:17:28.932 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19747.log.gz 2026-02-17T11:17:28.932 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19901.log.gz 2026-02-17T11:17:28.932 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15574.log 2026-02-17T11:17:28.932 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19166.log 2026-02-17T11:17:28.932 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18547.log.gz 2026-02-17T11:17:28.932 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.15574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20011.log 2026-02-17T11:17:28.932 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15574.log.gz 2026-02-17T11:17:28.933 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19166.log.gz 2026-02-17T11:17:28.933 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19681.log 2026-02-17T11:17:28.933 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20011.log.gz 2026-02-17T11:17:28.933 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20451.log 2026-02-17T11:17:28.934 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18695.log 2026-02-17T11:17:28.934 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19681.log.gz 2026-02-17T11:17:28.934 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20451.log.gz 2026-02-17T11:17:28.934 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20935.log 2026-02-17T11:17:28.934 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21507.log 2026-02-17T11:17:28.934 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18695.log: /var/log/ceph/ceph-client.admin.20935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18695.log.gz 2026-02-17T11:17:28.935 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20935.log.gz 2026-02-17T11:17:28.935 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19813.log 2026-02-17T11:17:28.935 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23796.log 2026-02-17T11:17:28.935 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21507.log.gz 2026-02-17T11:17:28.935 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20363.log 2026-02-17T11:17:28.935 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19813.log.gz 2026-02-17T11:17:28.936 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20869.log 2026-02-17T11:17:28.936 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23796.log.gz 2026-02-17T11:17:28.936 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20363.log.gz 2026-02-17T11:17:28.936 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23899.log 2026-02-17T11:17:28.936 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15550.log 2026-02-17T11:17:28.937 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20869.log.gz 2026-02-17T11:17:28.937 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23899.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T11:17:28.937 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23899.log.gz 2026-02-17T11:17:28.938 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.15550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20209.log 2026-02-17T11:17:28.938 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15550.log.gz 2026-02-17T11:17:28.938 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20099.log 2026-02-17T11:17:28.938 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21375.log 2026-02-17T11:17:28.938 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20209.log.gz 2026-02-17T11:17:28.938 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20099.log.gz 2026-02-17T11:17:28.938 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20803.log 2026-02-17T11:17:28.939 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21375.log.gz 2026-02-17T11:17:28.939 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20891.log 2026-02-17T11:17:28.939 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20803.log.gz 2026-02-17T11:17:28.939 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27717.log 2026-02-17T11:17:28.939 INFO:teuthology.orchestra.run.trial109.stderr:gzip/var/log/ceph/ceph-client.admin.20891.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24946.log 2026-02-17T11:17:28.939 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20891.log.gz 2026-02-17T11:17:28.939 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27717.log.gz 2026-02-17T11:17:28.940 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27617.log 2026-02-17T11:17:28.940 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.24946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27743.log 2026-02-17T11:17:28.940 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24946.log.gz 2026-02-17T11:17:28.940 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27617.log.gz 2026-02-17T11:17:28.940 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19615.log 2026-02-17T11:17:28.941 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19322.log 2026-02-17T11:17:28.941 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27743.log.gz 2026-02-17T11:17:28.941 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19615.log.gz 2026-02-17T11:17:28.941 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21945.log 2026-02-17T11:17:28.941 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21353.log 2026-02-17T11:17:28.942 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19322.log.gz 2026-02-17T11:17:28.942 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20275.log 2026-02-17T11:17:28.942 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21945.log.gz 2026-02-17T11:17:28.942 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20143.log 2026-02-17T11:17:28.942 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21353.log.gz 2026-02-17T11:17:28.943 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20077.log 2026-02-17T11:17:28.943 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20275.log.gz 2026-02-17T11:17:28.943 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15475.log 2026-02-17T11:17:28.943 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20143.log.gz 2026-02-17T11:17:28.943 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21155.log 2026-02-17T11:17:28.944 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20077.log.gz 2026-02-17T11:17:28.944 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.15475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15475.log.gz 2026-02-17T11:17:28.944 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T11:17:28.944 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21155.log.gz 2026-02-17T11:17:28.944 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20627.log 2026-02-17T11:17:28.944 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.21639.log 2026-02-17T11:17:28.945 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20627.log.gz 2026-02-17T11:17:28.945 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20583.log 2026-02-17T11:17:28.945 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23925.log 2026-02-17T11:17:28.945 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21639.log.gz 2026-02-17T11:17:28.946 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18625.log 2026-02-17T11:17:28.946 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20583.log.gz 2026-02-17T11:17:28.946 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.23925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21243.log 2026-02-17T11:17:28.946 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23925.log.gz 2026-02-17T11:17:28.946 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18625.log.gz 2026-02-17T11:17:28.947 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27795.log 2026-02-17T11:17:28.947 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.21243.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.25018.log 2026-02-17T11:17:28.947 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21243.log.gz 2026-02-17T11:17:28.947 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27795.log.gz 2026-02-17T11:17:28.947 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22023.log 2026-02-17T11:17:28.948 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/objectstore_tool.25018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19857.log 2026-02-17T11:17:28.948 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.22023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22023.log.gz 2026-02-17T11:17:28.948 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18546.log 2026-02-17T11:17:28.948 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19857.log.gz 2026-02-17T11:17:28.949 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27441.log 2026-02-17T11:17:28.949 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.18546.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.20319.log -- replaced with /var/log/ceph/ceph-client.admin.18546.log.gz 2026-02-17T11:17:28.949 INFO:teuthology.orchestra.run.trial109.stderr: 2026-02-17T11:17:28.949 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.27441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20033.log 2026-02-17T11:17:28.949 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27441.log.gz 2026-02-17T11:17:28.950 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19527.log 2026-02-17T11:17:28.950 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20319.log.gz 2026-02-17T11:17:28.950 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.20033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20033.log.gz 2026-02-17T11:17:28.951 INFO:teuthology.orchestra.run.trial109.stderr:/var/log/ceph/ceph-client.admin.19527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19527.log.gz 2026-02-17T11:17:28.963 INFO:teuthology.orchestra.run.trial109.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T11:17:28.980 INFO:teuthology.orchestra.run.trial109.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.25018.log.gz 2026-02-17T11:17:29.263 INFO:teuthology.orchestra.run.trial109.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T11:17:29.284 INFO:teuthology.orchestra.run.trial109.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T11:17:29.294 INFO:teuthology.orchestra.run.trial109.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T11:17:29.295 INFO:teuthology.orchestra.run.trial109.stderr: 2026-02-17T11:17:29.295 INFO:teuthology.orchestra.run.trial109.stderr:real 0m0.424s 2026-02-17T11:17:29.295 INFO:teuthology.orchestra.run.trial109.stderr:user 0m1.242s 2026-02-17T11:17:29.295 INFO:teuthology.orchestra.run.trial109.stderr:sys 0m0.119s 2026-02-17T11:17:29.295 INFO:tasks.ceph:Archiving logs... 2026-02-17T11:17:29.295 DEBUG:teuthology.misc:Transferring archived files from trial109:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51274/remote/trial109/log 2026-02-17T11:17:29.297 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:17:29.633 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T11:17:29.646 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T11:17:29.647 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:17:29.724 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T11:17:29.736 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T11:17:29.736 DEBUG:teuthology.orchestra.run.trial109:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:17:29.796 INFO:teuthology.orchestra.run.trial109.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T11:17:29.796 INFO:teuthology.orchestra.run.trial109.stdout:============================================================================== 2026-02-17T11:17:29.796 INFO:teuthology.orchestra.run.trial109.stdout: sensei.ruselabs 38.6.228.170 2 u 7 64 1 68.364 +3.209 0.000 2026-02-17T11:17:29.797 INFO:teuthology.orchestra.run.trial109.stdout: 23.157.160.168 129.6.15.28 2 u 9 64 1 3.413 +0.959 0.000 2026-02-17T11:17:29.797 INFO:teuthology.orchestra.run.trial109.stdout: 198.137.202.32 .STEP. 16 u 720 64 0 0.000 +0.000 0.000 2026-02-17T11:17:29.797 INFO:teuthology.orchestra.run.trial109.stdout: mail.puresignal .GPS. 1 u 9 64 1 8.959 +2.430 0.000 2026-02-17T11:17:29.797 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T11:17:29.809 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T11:17:29.810 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T11:17:29.822 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T11:17:29.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T11:17:29.858 INFO:teuthology.task.internal:Duration was 362.752427 seconds 2026-02-17T11:17:29.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T11:17:29.873 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T11:17:29.873 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:17:29.898 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T11:17:29.898 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial109.front.sepia.ceph.com 2026-02-17T11:17:29.899 DEBUG:teuthology.orchestra.run.trial109:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:17:29.945 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T11:17:29.945 DEBUG:teuthology.orchestra.run.trial109:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:17:30.141 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T11:17:30.142 DEBUG:teuthology.orchestra.run.trial109:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:17:30.153 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:17:30.154 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:17:30.154 INFO:teuthology.orchestra.run.trial109.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:17:30.154 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:17:30.154 INFO:teuthology.orchestra.run.trial109.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:17:30.199 INFO:teuthology.orchestra.run.trial109.stderr: 81.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:17:30.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T11:17:30.217 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T11:17:30.217 DEBUG:teuthology.orchestra.run.trial109:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:17:30.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T11:17:30.276 DEBUG:teuthology.orchestra.run.trial109:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:17:30.314 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern = core 2026-02-17T11:17:30.323 DEBUG:teuthology.orchestra.run.trial109:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:17:30.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:17:30.375 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T11:17:30.391 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T11:17:30.391 DEBUG:teuthology.misc:Transferring archived files from trial109:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51274/remote/trial109 2026-02-17T11:17:30.392 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:17:30.435 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T11:17:30.435 DEBUG:teuthology.orchestra.run.trial109:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:17:30.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T11:17:30.493 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T11:17:30.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T11:17:30.506 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T11:17:30.506 DEBUG:teuthology.orchestra.run.trial109:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:17:30.519 INFO:teuthology.orchestra.run.trial109.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:17 /home/ubuntu/cephtest 2026-02-17T11:17:30.520 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T11:17:30.532 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T11:17:30.562 INFO:teuthology.run:Summary data: description: rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} duration: 362.75242733955383 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T11:17:30.562 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:17:30.705 INFO:teuthology.run:pass