2026-02-17T10:50:58.945 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T10:50:58.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T10:50:59.035 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51233' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOn+dFaLEtL+7I0B2v2HbtHKrSawaMHGFq2XOSODFSWVdb7zNb58g36om5v3nYmhF3ooRS3V352qn/sFRaHeEtw= tasks: - install: null - ceph: config: client: debug ms: 1 debug objecter: 20 debug rados: 20 global: osd pool default min size: 1 log-ignorelist: - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(OBJECT_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - watch_notify_same_primary: clients: - client.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T10:50:59.035 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T10:50:59.036 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T10:50:59.036 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T10:50:59.037 INFO:teuthology.task.internal:Checking packages... 2026-02-17T10:50:59.037 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T10:50:59.037 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T10:50:59.037 INFO:teuthology.packaging:ref: None 2026-02-17T10:50:59.037 INFO:teuthology.packaging:tag: None 2026-02-17T10:50:59.037 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T10:50:59.037 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T10:50:59.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T10:50:59.153 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T10:50:59.155 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T10:50:59.166 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T10:50:59.166 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T10:50:59.180 INFO:teuthology.task.internal:Saving configuration 2026-02-17T10:50:59.191 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T10:50:59.202 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T10:50:59.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial196.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 10:47:35.685116', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOdkhYH95XxFxzupow0bf4U9QEiwFtk8erSLHj8OWFsI'} 2026-02-17T10:50:59.279 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T10:50:59.292 INFO:teuthology.task.internal:roles: ubuntu@trial196.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T10:50:59.292 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T10:50:59.369 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7dc50cdabec0>, signals=[15]) 2026-02-17T10:50:59.370 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T10:50:59.380 INFO:teuthology.task.internal:Opening connections... 2026-02-17T10:50:59.380 DEBUG:teuthology.task.internal:connecting to ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:50:59.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:50:59.442 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T10:50:59.454 DEBUG:teuthology.orchestra.run.trial196:> uname -m 2026-02-17T10:50:59.518 INFO:teuthology.orchestra.run.trial196.stdout:x86_64 2026-02-17T10:50:59.519 DEBUG:teuthology.orchestra.run.trial196:> cat /etc/os-release 2026-02-17T10:50:59.564 INFO:teuthology.orchestra.run.trial196.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T10:50:59.564 INFO:teuthology.orchestra.run.trial196.stdout:NAME="Ubuntu" 2026-02-17T10:50:59.564 INFO:teuthology.orchestra.run.trial196.stdout:VERSION_ID="22.04" 2026-02-17T10:50:59.564 INFO:teuthology.orchestra.run.trial196.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T10:50:59.564 INFO:teuthology.orchestra.run.trial196.stdout:VERSION_CODENAME=jammy 2026-02-17T10:50:59.564 INFO:teuthology.orchestra.run.trial196.stdout:ID=ubuntu 2026-02-17T10:50:59.565 INFO:teuthology.orchestra.run.trial196.stdout:ID_LIKE=debian 2026-02-17T10:50:59.565 INFO:teuthology.orchestra.run.trial196.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T10:50:59.565 INFO:teuthology.orchestra.run.trial196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T10:50:59.565 INFO:teuthology.orchestra.run.trial196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T10:50:59.565 INFO:teuthology.orchestra.run.trial196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T10:50:59.565 INFO:teuthology.orchestra.run.trial196.stdout:UBUNTU_CODENAME=jammy 2026-02-17T10:50:59.565 INFO:teuthology.lock.ops:Updating trial196.front.sepia.ceph.com on lock server 2026-02-17T10:50:59.655 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T10:50:59.667 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T10:50:59.677 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T10:50:59.678 DEBUG:teuthology.orchestra.run.trial196:> test '!' -e /home/ubuntu/cephtest 2026-02-17T10:50:59.681 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T10:50:59.692 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T10:50:59.692 DEBUG:teuthology.orchestra.run.trial196:> test -z $(ls -A /var/lib/ceph) 2026-02-17T10:50:59.729 INFO:teuthology.orchestra.run.trial196.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T10:50:59.730 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T10:50:59.826 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T10:50:59.845 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T10:50:59.845 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T10:50:59.845 DEBUG:teuthology.orchestra.run.trial196:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T10:50:59.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:50:59.848 DEBUG:teuthology.orchestra.run.trial196:> uname -r 2026-02-17T10:50:59.892 INFO:teuthology.orchestra.run.trial196.stdout:5.15.0-164-generic 2026-02-17T10:50:59.892 INFO:teuthology.task.kernel:Running kernel on trial196: 5.15.0-164-generic 2026-02-17T10:50:59.893 DEBUG:teuthology.orchestra.run.trial196:> sudo apt-get clean 2026-02-17T10:50:59.951 DEBUG:teuthology.orchestra.run.trial196:> sudo apt-get update 2026-02-17T10:51:00.705 INFO:teuthology.orchestra.run.trial196.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T10:51:00.808 INFO:teuthology.orchestra.run.trial196.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T10:51:01.239 INFO:teuthology.orchestra.run.trial196.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T10:51:01.394 INFO:teuthology.orchestra.run.trial196.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T10:51:01.536 INFO:teuthology.orchestra.run.trial196.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3236 kB] 2026-02-17T10:51:01.939 INFO:teuthology.orchestra.run.trial196.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T10:51:01.951 INFO:teuthology.orchestra.run.trial196.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T10:51:01.952 INFO:teuthology.orchestra.run.trial196.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T10:51:01.987 INFO:teuthology.orchestra.run.trial196.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T10:51:01.994 INFO:teuthology.orchestra.run.trial196.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T10:51:01.995 INFO:teuthology.orchestra.run.trial196.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T10:51:02.150 INFO:teuthology.orchestra.run.trial196.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T10:51:02.173 INFO:teuthology.orchestra.run.trial196.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T10:51:02.259 INFO:teuthology.orchestra.run.trial196.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T10:51:02.268 INFO:teuthology.orchestra.run.trial196.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T10:51:02.271 INFO:teuthology.orchestra.run.trial196.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T10:51:02.302 INFO:teuthology.orchestra.run.trial196.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T10:51:02.310 INFO:teuthology.orchestra.run.trial196.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T10:51:02.311 INFO:teuthology.orchestra.run.trial196.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T10:51:02.458 INFO:teuthology.orchestra.run.trial196.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T10:51:05.736 INFO:teuthology.orchestra.run.trial196.stdout:Fetched 22.7 MB in 3s (6968 kB/s) 2026-02-17T10:51:06.259 INFO:teuthology.orchestra.run.trial196.stdout:Reading package lists... 2026-02-17T10:51:06.273 DEBUG:teuthology.orchestra.run.trial196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T10:51:06.346 INFO:teuthology.orchestra.run.trial196.stdout:Reading package lists... 2026-02-17T10:51:06.452 INFO:teuthology.orchestra.run.trial196.stdout:Building dependency tree... 2026-02-17T10:51:06.452 INFO:teuthology.orchestra.run.trial196.stdout:Reading state information... 2026-02-17T10:51:06.538 INFO:teuthology.orchestra.run.trial196.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T10:51:06.538 INFO:teuthology.orchestra.run.trial196.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout: sg3-utils-udev 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout:The following additional packages will be installed: 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout:Suggested packages: 2026-02-17T10:51:06.539 INFO:teuthology.orchestra.run.trial196.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T10:51:06.553 INFO:teuthology.orchestra.run.trial196.stdout:The following NEW packages will be installed: 2026-02-17T10:51:06.553 INFO:teuthology.orchestra.run.trial196.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T10:51:06.553 INFO:teuthology.orchestra.run.trial196.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T10:51:06.553 INFO:teuthology.orchestra.run.trial196.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T10:51:06.553 INFO:teuthology.orchestra.run.trial196.stdout:The following packages will be upgraded: 2026-02-17T10:51:06.554 INFO:teuthology.orchestra.run.trial196.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T10:51:06.648 INFO:teuthology.orchestra.run.trial196.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T10:51:06.648 INFO:teuthology.orchestra.run.trial196.stdout:Need to get 113 MB of archives. 2026-02-17T10:51:06.649 INFO:teuthology.orchestra.run.trial196.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T10:51:06.649 INFO:teuthology.orchestra.run.trial196.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T10:51:06.815 INFO:teuthology.orchestra.run.trial196.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T10:51:06.858 INFO:teuthology.orchestra.run.trial196.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T10:51:07.103 INFO:teuthology.orchestra.run.trial196.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T10:51:07.103 INFO:teuthology.orchestra.run.trial196.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T10:51:07.104 INFO:teuthology.orchestra.run.trial196.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T10:51:07.152 INFO:teuthology.orchestra.run.trial196.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T10:51:07.162 INFO:teuthology.orchestra.run.trial196.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T10:51:07.363 INFO:teuthology.orchestra.run.trial196.stdout:Fetched 113 MB in 1s (187 MB/s) 2026-02-17T10:51:07.384 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T10:51:07.549 INFO:teuthology.orchestra.run.trial196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T10:51:07.551 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T10:51:07.552 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:07.899 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T10:51:07.906 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T10:51:07.927 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:07.967 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T10:51:07.974 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T10:51:07.974 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:09.076 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T10:51:09.076 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T10:51:09.098 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T10:51:09.099 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T10:51:09.115 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T10:51:09.122 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T10:51:09.122 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T10:51:10.509 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T10:51:10.522 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T10:51:10.522 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:11.121 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T10:51:11.121 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T10:51:11.146 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T10:51:11.147 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:11.148 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T10:51:11.149 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:11.920 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:12.739 INFO:teuthology.orchestra.run.trial196.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T10:51:12.739 INFO:teuthology.orchestra.run.trial196.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T10:51:12.747 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:13.536 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T10:51:13.537 INFO:teuthology.orchestra.run.trial196.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T10:51:13.538 INFO:teuthology.orchestra.run.trial196.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T10:51:13.543 INFO:teuthology.orchestra.run.trial196.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T10:51:13.544 INFO:teuthology.orchestra.run.trial196.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T10:51:20.574 INFO:teuthology.orchestra.run.trial196.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T10:51:27.218 INFO:teuthology.orchestra.run.trial196.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T10:51:27.218 INFO:teuthology.orchestra.run.trial196.stdout:Sourcing file `/etc/default/grub' 2026-02-17T10:51:27.238 INFO:teuthology.orchestra.run.trial196.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T10:51:27.239 INFO:teuthology.orchestra.run.trial196.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T10:51:27.242 INFO:teuthology.orchestra.run.trial196.stdout:Generating grub configuration file ... 2026-02-17T10:51:27.322 INFO:teuthology.orchestra.run.trial196.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T10:51:27.329 INFO:teuthology.orchestra.run.trial196.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T10:51:27.501 INFO:teuthology.orchestra.run.trial196.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T10:51:27.507 INFO:teuthology.orchestra.run.trial196.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T10:51:27.579 INFO:teuthology.orchestra.run.trial196.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T10:51:27.579 INFO:teuthology.orchestra.run.trial196.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T10:51:27.579 INFO:teuthology.orchestra.run.trial196.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T10:51:27.581 INFO:teuthology.orchestra.run.trial196.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T10:51:27.590 INFO:teuthology.orchestra.run.trial196.stdout:done 2026-02-17T10:51:27.999 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:27.999 INFO:teuthology.orchestra.run.trial196.stdout:Pending kernel upgrade! 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout:Running kernel version: 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout: 5.15.0-164-generic 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout:Diagnostics: 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout:The processor microcode seems to be up-to-date. 2026-02-17T10:51:28.000 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.001 INFO:teuthology.orchestra.run.trial196.stdout:No services need to be restarted. 2026-02-17T10:51:28.001 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.001 INFO:teuthology.orchestra.run.trial196.stdout:No containers need to be restarted. 2026-02-17T10:51:28.001 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.001 INFO:teuthology.orchestra.run.trial196.stdout:No user sessions are running outdated binaries. 2026-02-17T10:51:28.001 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:51:28.001 INFO:teuthology.orchestra.run.trial196.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T10:51:28.652 DEBUG:teuthology.orchestra.run.trial196:> dpkg -s linux-image-generic 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Package: linux-image-generic 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Status: install ok installed 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Priority: optional 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Section: kernel 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Installed-Size: 21 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Architecture: amd64 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Source: linux-meta 2026-02-17T10:51:28.663 INFO:teuthology.orchestra.run.trial196.stdout:Version: 5.15.0.170.159 2026-02-17T10:51:28.664 INFO:teuthology.orchestra.run.trial196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T10:51:28.664 INFO:teuthology.orchestra.run.trial196.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T10:51:28.664 INFO:teuthology.orchestra.run.trial196.stdout:Recommends: thermald 2026-02-17T10:51:28.664 INFO:teuthology.orchestra.run.trial196.stdout:Description: Generic Linux kernel image 2026-02-17T10:51:28.664 INFO:teuthology.orchestra.run.trial196.stdout: This package will always depend on the latest generic kernel image 2026-02-17T10:51:28.664 INFO:teuthology.orchestra.run.trial196.stdout: available. 2026-02-17T10:51:28.664 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T10:51:28.664 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T10:51:28.665 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T10:51:28.665 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T10:51:28.665 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial196.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T10:51:28.665 DEBUG:teuthology.orchestra.run.trial196:> sudo apt-get clean 2026-02-17T10:51:28.745 DEBUG:teuthology.orchestra.run.trial196:> sudo apt-get update 2026-02-17T10:51:28.921 INFO:teuthology.orchestra.run.trial196.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T10:51:28.925 INFO:teuthology.orchestra.run.trial196.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T10:51:28.934 INFO:teuthology.orchestra.run.trial196.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T10:51:28.943 INFO:teuthology.orchestra.run.trial196.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T10:51:29.788 INFO:teuthology.orchestra.run.trial196.stdout:Reading package lists... 2026-02-17T10:51:29.803 DEBUG:teuthology.orchestra.run.trial196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T10:51:29.837 INFO:teuthology.orchestra.run.trial196.stdout:Reading package lists... 2026-02-17T10:51:29.952 INFO:teuthology.orchestra.run.trial196.stdout:Building dependency tree... 2026-02-17T10:51:29.953 INFO:teuthology.orchestra.run.trial196.stdout:Reading state information... 2026-02-17T10:51:30.042 INFO:teuthology.orchestra.run.trial196.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T10:51:30.042 INFO:teuthology.orchestra.run.trial196.stdout:linux-image-generic set to manually installed. 2026-02-17T10:51:30.043 INFO:teuthology.orchestra.run.trial196.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T10:51:30.043 INFO:teuthology.orchestra.run.trial196.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T10:51:30.043 INFO:teuthology.orchestra.run.trial196.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T10:51:30.043 INFO:teuthology.orchestra.run.trial196.stdout: sg3-utils-udev 2026-02-17T10:51:30.043 INFO:teuthology.orchestra.run.trial196.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T10:51:30.063 INFO:teuthology.orchestra.run.trial196.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T10:51:30.065 DEBUG:teuthology.orchestra.run.trial196:> dpkg -s linux-image-generic 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Package: linux-image-generic 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Status: install ok installed 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Priority: optional 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Section: kernel 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Installed-Size: 21 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Architecture: amd64 2026-02-17T10:51:30.115 INFO:teuthology.orchestra.run.trial196.stdout:Source: linux-meta 2026-02-17T10:51:30.116 INFO:teuthology.orchestra.run.trial196.stdout:Version: 5.15.0.170.159 2026-02-17T10:51:30.116 INFO:teuthology.orchestra.run.trial196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T10:51:30.116 INFO:teuthology.orchestra.run.trial196.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T10:51:30.116 INFO:teuthology.orchestra.run.trial196.stdout:Recommends: thermald 2026-02-17T10:51:30.116 INFO:teuthology.orchestra.run.trial196.stdout:Description: Generic Linux kernel image 2026-02-17T10:51:30.116 INFO:teuthology.orchestra.run.trial196.stdout: This package will always depend on the latest generic kernel image 2026-02-17T10:51:30.116 INFO:teuthology.orchestra.run.trial196.stdout: available. 2026-02-17T10:51:30.117 DEBUG:teuthology.orchestra.run.trial196:> mktemp 2026-02-17T10:51:30.161 INFO:teuthology.orchestra.run.trial196.stdout:/tmp/tmp.21zNk1OScr 2026-02-17T10:51:30.162 DEBUG:teuthology.orchestra.run.trial196:> sudo cp /boot/grub/grub.cfg /tmp/tmp.21zNk1OScr 2026-02-17T10:51:30.210 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0666 /tmp/tmp.21zNk1OScr 2026-02-17T10:51:30.316 DEBUG:teuthology.orchestra.remote:trial196:/tmp/tmp.21zNk1OScr is 7KB 2026-02-17T10:51:30.324 DEBUG:teuthology.orchestra.run.trial196:> rm -fr /tmp/tmp.21zNk1OScr 2026-02-17T10:51:30.328 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T10:51:30.377 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:51:30.377 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T10:51:30.377 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T10:51:30.431 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T10:51:30.431 DEBUG:teuthology.orchestra.run.trial196:> sudo update-grub 2026-02-17T10:51:30.677 INFO:teuthology.orchestra.run.trial196.stderr:Sourcing file `/etc/default/grub' 2026-02-17T10:51:30.695 INFO:teuthology.orchestra.run.trial196.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T10:51:30.696 INFO:teuthology.orchestra.run.trial196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T10:51:30.698 INFO:teuthology.orchestra.run.trial196.stderr:Generating grub configuration file ... 2026-02-17T10:51:30.778 INFO:teuthology.orchestra.run.trial196.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T10:51:30.784 INFO:teuthology.orchestra.run.trial196.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T10:51:30.956 INFO:teuthology.orchestra.run.trial196.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T10:51:30.962 INFO:teuthology.orchestra.run.trial196.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T10:51:31.032 INFO:teuthology.orchestra.run.trial196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T10:51:31.032 INFO:teuthology.orchestra.run.trial196.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T10:51:31.032 INFO:teuthology.orchestra.run.trial196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T10:51:31.034 INFO:teuthology.orchestra.run.trial196.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T10:51:31.041 INFO:teuthology.orchestra.run.trial196.stderr:done 2026-02-17T10:51:31.043 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial196 2026-02-17T10:51:31.044 DEBUG:teuthology.orchestra.run.trial196:> sudo bash -c ' 2026-02-17T10:51:31.044 DEBUG:teuthology.orchestra.run.trial196:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T10:51:31.044 DEBUG:teuthology.orchestra.run.trial196:> ' 2026-02-17T10:52:01.046 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T10:52:01.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T10:52:01.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:53:01.103 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T10:53:10.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T10:53:10.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:53:10.243 DEBUG:teuthology.orchestra.run.trial196:> true 2026-02-17T10:53:10.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T10:53:10.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T10:53:10.628 DEBUG:teuthology.orchestra.run.trial196:> uname -r 2026-02-17T10:53:10.672 INFO:teuthology.orchestra.run.trial196.stdout:5.15.0-170-generic 2026-02-17T10:53:10.673 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T10:53:10.673 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T10:53:10.673 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T10:53:11.674 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T10:53:11.674 DEBUG:teuthology.orchestra.run.trial196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T10:53:11.687 INFO:teuthology.orchestra.run.trial196.stdout:ttyS1 2026-02-17T10:53:11.711 DEBUG:teuthology.parallel:result is None 2026-02-17T10:53:11.711 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T10:53:11.724 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T10:53:11.725 DEBUG:teuthology.orchestra.run.trial196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T10:53:11.756 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T10:53:11.767 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T10:53:11.780 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T10:53:11.780 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T10:53:11.807 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T10:53:11.818 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T10:53:11.818 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T10:53:11.856 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:53:11.863 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T10:53:11.864 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T10:53:11.876 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T10:53:11.877 DEBUG:teuthology.orchestra.run.trial196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T10:53:11.912 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T10:53:11.926 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T10:53:11.926 DEBUG:teuthology.orchestra.run.trial196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T10:53:11.956 DEBUG:teuthology.orchestra.run.trial196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:53:11.999 DEBUG:teuthology.orchestra.run.trial196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:53:12.044 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:53:12.044 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T10:53:12.092 DEBUG:teuthology.orchestra.run.trial196:> sudo service rsyslog restart 2026-02-17T10:53:12.149 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T10:53:12.163 INFO:teuthology.task.internal:Starting timer... 2026-02-17T10:53:12.164 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T10:53:12.186 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T10:53:12.205 DEBUG:teuthology.task.selinux:Excluding trial196: OS 'ubuntu' does not support SELinux 2026-02-17T10:53:12.206 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T10:53:12.206 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T10:53:12.206 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T10:53:12.206 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T10:53:12.222 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T10:53:12.235 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T10:53:12.236 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T10:55:36.282 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial196.front.sepia.ceph.com')] 2026-02-17T10:55:36.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T10:55:36.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T10:55:36.397 DEBUG:teuthology.orchestra.run.trial196:> true 2026-02-17T10:55:36.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-17T10:55:36.647 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T10:55:36.665 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T10:55:36.665 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T10:55:36.667 DEBUG:teuthology.orchestra.run.trial196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T10:55:36.710 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T10:55:36.710 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Command line: ntpd -gq 2026-02-17T10:55:36.710 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: ---------------------------------------------------- 2026-02-17T10:55:36.710 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T10:55:36.710 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: corporation. Support and training for ntp-4 are 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: available at https://www.nwtime.org/support 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: ---------------------------------------------------- 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: proto: precision = 0.020 usec (-25) 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: basedate set to 2022-02-04 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: gps base set to 2022-02-06 (week 2196) 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T10:55:36.711 INFO:teuthology.orchestra.run.trial196.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Listen normally on 3 enp1s0f0 10.20.193.196:123 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Listen normally on 4 lo [::1]:123 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:61ea%2]:123 2026-02-17T10:55:36.712 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:36 ntpd[8780]: Listening on routing socket on fd #22 for interface updates 2026-02-17T10:55:37.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:37 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:37.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:37 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:37.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:37 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:37.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:37 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:37.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:37 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:37.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:37 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:39.710 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:39.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:39.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:39.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:39.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:39.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:39.714 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:39.714 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:39.714 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:39.714 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:39.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:39.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:39.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:39.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:39.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:39.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:39.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:39.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:39 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:41.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.712 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.712 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.712 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.712 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.712 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.712 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.712 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.715 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.715 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.715 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:41.715 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:41.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.739 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.739 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:41.739 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:41.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:41.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:41.783 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:41.784 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:41.784 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:41.784 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:41 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:43.711 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:43.716 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:43.716 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:43.716 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:43.716 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:43.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:43.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:43.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:43.738 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:43.779 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T10:55:43.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T10:55:43.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T10:55:43.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T10:55:43.780 INFO:teuthology.orchestra.run.trial196.stdout:17 Feb 10:55:43 ntpd[8780]: ntpd: time set -0.133580 s 2026-02-17T10:55:43.780 INFO:teuthology.orchestra.run.trial196.stdout:ntpd: time set -0.133580s 2026-02-17T10:55:43.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T10:55:43.780 INFO:teuthology.orchestra.run.trial196.stderr:17 Feb 10:55:43 ntpd[8780]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T10:55:43.842 INFO:teuthology.orchestra.run.trial196.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T10:55:43.842 INFO:teuthology.orchestra.run.trial196.stdout:============================================================================== 2026-02-17T10:55:43.842 INFO:teuthology.orchestra.run.trial196.stdout: ip229.ip-51-81- .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T10:55:43.842 INFO:teuthology.orchestra.run.trial196.stdout: ntp.maxhost.io .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T10:55:43.842 INFO:teuthology.orchestra.run.trial196.stdout: chi2.us.ntp.li .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T10:55:43.842 INFO:teuthology.orchestra.run.trial196.stdout: chi3.us.ntp.li .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T10:55:43.843 INFO:teuthology.run_tasks:Running task install... 2026-02-17T10:55:43.858 DEBUG:teuthology.task.install:project ceph 2026-02-17T10:55:43.858 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T10:55:43.858 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T10:55:43.858 INFO:teuthology.task.install:Using flavor: default 2026-02-17T10:55:43.861 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T10:55:43.861 INFO:teuthology.task.install:extra packages: [] 2026-02-17T10:55:43.861 DEBUG:teuthology.orchestra.run.trial196:> sudo apt-key list | grep Ceph 2026-02-17T10:55:43.934 INFO:teuthology.orchestra.run.trial196.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T10:55:43.964 INFO:teuthology.orchestra.run.trial196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T10:55:43.965 INFO:teuthology.orchestra.run.trial196.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T10:55:43.965 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T10:55:43.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T10:55:44.129 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default/ 2026-02-17T10:55:44.130 INFO:teuthology.task.install.deb:Package version is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T10:55:44.273 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:55:44.273 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T10:55:44.283 DEBUG:teuthology.orchestra.run.trial196:> sudo apt-get update 2026-02-17T10:55:44.440 INFO:teuthology.orchestra.run.trial196.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T10:55:44.451 INFO:teuthology.orchestra.run.trial196.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-17T10:55:44.463 INFO:teuthology.orchestra.run.trial196.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T10:55:44.474 INFO:teuthology.orchestra.run.trial196.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T10:55:44.803 INFO:teuthology.orchestra.run.trial196.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T10:55:44.889 INFO:teuthology.orchestra.run.trial196.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T10:55:44.981 INFO:teuthology.orchestra.run.trial196.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T10:55:45.073 INFO:teuthology.orchestra.run.trial196.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T10:55:45.218 INFO:teuthology.orchestra.run.trial196.stdout:Fetched 25.8 kB in 1s (33.1 kB/s) 2026-02-17T10:55:45.744 INFO:teuthology.orchestra.run.trial196.stdout:Reading package lists... 2026-02-17T10:55:45.759 DEBUG:teuthology.orchestra.run.trial196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-705-g04cf6dd4-1jammy cephadm=19.2.3-705-g04cf6dd4-1jammy ceph-mds=19.2.3-705-g04cf6dd4-1jammy ceph-mgr=19.2.3-705-g04cf6dd4-1jammy ceph-common=19.2.3-705-g04cf6dd4-1jammy ceph-fuse=19.2.3-705-g04cf6dd4-1jammy ceph-test=19.2.3-705-g04cf6dd4-1jammy ceph-volume=19.2.3-705-g04cf6dd4-1jammy radosgw=19.2.3-705-g04cf6dd4-1jammy python3-rados=19.2.3-705-g04cf6dd4-1jammy python3-rgw=19.2.3-705-g04cf6dd4-1jammy python3-cephfs=19.2.3-705-g04cf6dd4-1jammy python3-rbd=19.2.3-705-g04cf6dd4-1jammy libcephfs2=19.2.3-705-g04cf6dd4-1jammy libcephfs-dev=19.2.3-705-g04cf6dd4-1jammy librados2=19.2.3-705-g04cf6dd4-1jammy librbd1=19.2.3-705-g04cf6dd4-1jammy rbd-fuse=19.2.3-705-g04cf6dd4-1jammy 2026-02-17T10:55:45.793 INFO:teuthology.orchestra.run.trial196.stdout:Reading package lists... 2026-02-17T10:55:45.904 INFO:teuthology.orchestra.run.trial196.stdout:Building dependency tree... 2026-02-17T10:55:45.904 INFO:teuthology.orchestra.run.trial196.stdout:Reading state information... 2026-02-17T10:55:46.000 INFO:teuthology.orchestra.run.trial196.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T10:55:46.000 INFO:teuthology.orchestra.run.trial196.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T10:55:46.000 INFO:teuthology.orchestra.run.trial196.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T10:55:46.001 INFO:teuthology.orchestra.run.trial196.stdout: sg3-utils-udev 2026-02-17T10:55:46.001 INFO:teuthology.orchestra.run.trial196.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T10:55:46.001 INFO:teuthology.orchestra.run.trial196.stdout:The following additional packages will be installed: 2026-02-17T10:55:46.001 INFO:teuthology.orchestra.run.trial196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T10:55:46.001 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T10:55:46.001 INFO:teuthology.orchestra.run.trial196.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T10:55:46.001 INFO:teuthology.orchestra.run.trial196.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T10:55:46.002 INFO:teuthology.orchestra.run.trial196.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout:Suggested packages: 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T10:55:46.003 INFO:teuthology.orchestra.run.trial196.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T10:55:46.004 INFO:teuthology.orchestra.run.trial196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T10:55:46.004 INFO:teuthology.orchestra.run.trial196.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T10:55:46.004 INFO:teuthology.orchestra.run.trial196.stdout:Recommended packages: 2026-02-17T10:55:46.004 INFO:teuthology.orchestra.run.trial196.stdout: btrfs-tools 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout:The following NEW packages will be installed: 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T10:55:46.034 INFO:teuthology.orchestra.run.trial196.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T10:55:46.035 INFO:teuthology.orchestra.run.trial196.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T10:55:46.036 INFO:teuthology.orchestra.run.trial196.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T10:55:46.036 INFO:teuthology.orchestra.run.trial196.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T10:55:46.036 INFO:teuthology.orchestra.run.trial196.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T10:55:46.036 INFO:teuthology.orchestra.run.trial196.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T10:55:46.036 INFO:teuthology.orchestra.run.trial196.stdout: xmlstarlet zip 2026-02-17T10:55:46.131 INFO:teuthology.orchestra.run.trial196.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T10:55:46.131 INFO:teuthology.orchestra.run.trial196.stdout:Need to get 178 MB of archives. 2026-02-17T10:55:46.131 INFO:teuthology.orchestra.run.trial196.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T10:55:46.131 INFO:teuthology.orchestra.run.trial196.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-705-g04cf6dd4-1jammy [3593 kB] 2026-02-17T10:55:46.240 INFO:teuthology.orchestra.run.trial196.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-705-g04cf6dd4-1jammy [3257 kB] 2026-02-17T10:55:46.284 INFO:teuthology.orchestra.run.trial196.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-705-g04cf6dd4-1jammy [979 kB] 2026-02-17T10:55:46.300 INFO:teuthology.orchestra.run.trial196.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-705-g04cf6dd4-1jammy [357 kB] 2026-02-17T10:55:46.306 INFO:teuthology.orchestra.run.trial196.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-705-g04cf6dd4-1jammy [32.9 kB] 2026-02-17T10:55:46.306 INFO:teuthology.orchestra.run.trial196.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-705-g04cf6dd4-1jammy [184 kB] 2026-02-17T10:55:46.309 INFO:teuthology.orchestra.run.trial196.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-705-g04cf6dd4-1jammy [74.1 kB] 2026-02-17T10:55:46.310 INFO:teuthology.orchestra.run.trial196.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-705-g04cf6dd4-1jammy [337 kB] 2026-02-17T10:55:46.315 INFO:teuthology.orchestra.run.trial196.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-705-g04cf6dd4-1jammy [6935 kB] 2026-02-17T10:55:46.395 INFO:teuthology.orchestra.run.trial196.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T10:55:46.431 INFO:teuthology.orchestra.run.trial196.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-705-g04cf6dd4-1jammy [112 kB] 2026-02-17T10:55:46.432 INFO:teuthology.orchestra.run.trial196.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-705-g04cf6dd4-1jammy [470 kB] 2026-02-17T10:55:46.438 INFO:teuthology.orchestra.run.trial196.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-705-g04cf6dd4-1jammy [26.5 MB] 2026-02-17T10:55:46.732 INFO:teuthology.orchestra.run.trial196.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T10:55:46.743 INFO:teuthology.orchestra.run.trial196.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T10:55:46.812 INFO:teuthology.orchestra.run.trial196.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T10:55:46.878 INFO:teuthology.orchestra.run.trial196.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-705-g04cf6dd4-1jammy [5178 kB] 2026-02-17T10:55:46.958 INFO:teuthology.orchestra.run.trial196.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-705-g04cf6dd4-1jammy [248 kB] 2026-02-17T10:55:46.962 INFO:teuthology.orchestra.run.trial196.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-705-g04cf6dd4-1jammy [125 kB] 2026-02-17T10:55:46.964 INFO:teuthology.orchestra.run.trial196.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-705-g04cf6dd4-1jammy [1081 kB] 2026-02-17T10:55:46.981 INFO:teuthology.orchestra.run.trial196.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-705-g04cf6dd4-1jammy [6239 kB] 2026-02-17T10:55:47.013 INFO:teuthology.orchestra.run.trial196.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T10:55:47.023 INFO:teuthology.orchestra.run.trial196.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T10:55:47.052 INFO:teuthology.orchestra.run.trial196.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T10:55:47.058 INFO:teuthology.orchestra.run.trial196.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T10:55:47.061 INFO:teuthology.orchestra.run.trial196.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T10:55:47.062 INFO:teuthology.orchestra.run.trial196.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T10:55:47.063 INFO:teuthology.orchestra.run.trial196.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T10:55:47.080 INFO:teuthology.orchestra.run.trial196.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T10:55:47.085 INFO:teuthology.orchestra.run.trial196.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T10:55:47.085 INFO:teuthology.orchestra.run.trial196.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-705-g04cf6dd4-1jammy [23.0 MB] 2026-02-17T10:55:47.088 INFO:teuthology.orchestra.run.trial196.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T10:55:47.160 INFO:teuthology.orchestra.run.trial196.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T10:55:47.160 INFO:teuthology.orchestra.run.trial196.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T10:55:47.166 INFO:teuthology.orchestra.run.trial196.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T10:55:47.170 INFO:teuthology.orchestra.run.trial196.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T10:55:47.171 INFO:teuthology.orchestra.run.trial196.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T10:55:47.171 INFO:teuthology.orchestra.run.trial196.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T10:55:47.172 INFO:teuthology.orchestra.run.trial196.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T10:55:47.172 INFO:teuthology.orchestra.run.trial196.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T10:55:47.244 INFO:teuthology.orchestra.run.trial196.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T10:55:47.244 INFO:teuthology.orchestra.run.trial196.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T10:55:47.245 INFO:teuthology.orchestra.run.trial196.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T10:55:47.245 INFO:teuthology.orchestra.run.trial196.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T10:55:47.316 INFO:teuthology.orchestra.run.trial196.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T10:55:47.316 INFO:teuthology.orchestra.run.trial196.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T10:55:47.322 INFO:teuthology.orchestra.run.trial196.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T10:55:47.322 INFO:teuthology.orchestra.run.trial196.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T10:55:47.323 INFO:teuthology.orchestra.run.trial196.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T10:55:47.325 INFO:teuthology.orchestra.run.trial196.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T10:55:47.390 INFO:teuthology.orchestra.run.trial196.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T10:55:47.390 INFO:teuthology.orchestra.run.trial196.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T10:55:47.391 INFO:teuthology.orchestra.run.trial196.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T10:55:47.392 INFO:teuthology.orchestra.run.trial196.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T10:55:47.463 INFO:teuthology.orchestra.run.trial196.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T10:55:47.464 INFO:teuthology.orchestra.run.trial196.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-705-g04cf6dd4-1jammy [14.2 kB] 2026-02-17T10:55:47.464 INFO:teuthology.orchestra.run.trial196.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [1173 kB] 2026-02-17T10:55:47.477 INFO:teuthology.orchestra.run.trial196.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T10:55:47.478 INFO:teuthology.orchestra.run.trial196.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T10:55:47.478 INFO:teuthology.orchestra.run.trial196.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T10:55:47.478 INFO:teuthology.orchestra.run.trial196.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T10:55:47.479 INFO:teuthology.orchestra.run.trial196.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T10:55:47.480 INFO:teuthology.orchestra.run.trial196.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-705-g04cf6dd4-1jammy [2503 kB] 2026-02-17T10:55:47.520 INFO:teuthology.orchestra.run.trial196.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-705-g04cf6dd4-1jammy [798 kB] 2026-02-17T10:55:47.534 INFO:teuthology.orchestra.run.trial196.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-705-g04cf6dd4-1jammy [157 kB] 2026-02-17T10:55:47.536 INFO:teuthology.orchestra.run.trial196.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T10:55:47.536 INFO:teuthology.orchestra.run.trial196.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-705-g04cf6dd4-1jammy [2396 kB] 2026-02-17T10:55:47.538 INFO:teuthology.orchestra.run.trial196.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T10:55:47.541 INFO:teuthology.orchestra.run.trial196.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T10:55:47.541 INFO:teuthology.orchestra.run.trial196.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T10:55:47.575 INFO:teuthology.orchestra.run.trial196.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-705-g04cf6dd4-1jammy [8625 kB] 2026-02-17T10:55:47.610 INFO:teuthology.orchestra.run.trial196.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T10:55:47.634 INFO:teuthology.orchestra.run.trial196.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T10:55:47.639 INFO:teuthology.orchestra.run.trial196.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T10:55:47.639 INFO:teuthology.orchestra.run.trial196.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T10:55:47.712 INFO:teuthology.orchestra.run.trial196.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T10:55:47.713 INFO:teuthology.orchestra.run.trial196.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T10:55:47.713 INFO:teuthology.orchestra.run.trial196.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T10:55:47.714 INFO:teuthology.orchestra.run.trial196.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T10:55:47.714 INFO:teuthology.orchestra.run.trial196.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T10:55:47.714 INFO:teuthology.orchestra.run.trial196.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T10:55:47.718 INFO:teuthology.orchestra.run.trial196.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-705-g04cf6dd4-1jammy [14.3 kB] 2026-02-17T10:55:47.718 INFO:teuthology.orchestra.run.trial196.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-705-g04cf6dd4-1jammy [52.1 MB] 2026-02-17T10:55:47.754 INFO:teuthology.orchestra.run.trial196.stdout:Get:84 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T10:55:47.761 INFO:teuthology.orchestra.run.trial196.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T10:55:47.762 INFO:teuthology.orchestra.run.trial196.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T10:55:47.827 INFO:teuthology.orchestra.run.trial196.stdout:Get:87 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T10:55:47.834 INFO:teuthology.orchestra.run.trial196.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T10:55:47.836 INFO:teuthology.orchestra.run.trial196.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T10:55:47.837 INFO:teuthology.orchestra.run.trial196.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T10:55:47.837 INFO:teuthology.orchestra.run.trial196.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T10:55:47.841 INFO:teuthology.orchestra.run.trial196.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T10:55:47.841 INFO:teuthology.orchestra.run.trial196.stdout:Get:93 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T10:55:47.901 INFO:teuthology.orchestra.run.trial196.stdout:Get:94 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T10:55:47.901 INFO:teuthology.orchestra.run.trial196.stdout:Get:95 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T10:55:47.902 INFO:teuthology.orchestra.run.trial196.stdout:Get:96 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T10:55:47.975 INFO:teuthology.orchestra.run.trial196.stdout:Get:97 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T10:55:47.981 INFO:teuthology.orchestra.run.trial196.stdout:Get:98 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T10:55:47.983 INFO:teuthology.orchestra.run.trial196.stdout:Get:99 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T10:55:48.006 INFO:teuthology.orchestra.run.trial196.stdout:Get:100 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T10:55:48.008 INFO:teuthology.orchestra.run.trial196.stdout:Get:101 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T10:55:48.008 INFO:teuthology.orchestra.run.trial196.stdout:Get:102 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T10:55:48.017 INFO:teuthology.orchestra.run.trial196.stdout:Get:103 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T10:55:48.049 INFO:teuthology.orchestra.run.trial196.stdout:Get:104 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T10:55:48.580 INFO:teuthology.orchestra.run.trial196.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-705-g04cf6dd4-1jammy [135 kB] 2026-02-17T10:55:48.581 INFO:teuthology.orchestra.run.trial196.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-705-g04cf6dd4-1jammy [41.0 kB] 2026-02-17T10:55:48.581 INFO:teuthology.orchestra.run.trial196.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-705-g04cf6dd4-1jammy [13.7 MB] 2026-02-17T10:55:48.801 INFO:teuthology.orchestra.run.trial196.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [92.1 kB] 2026-02-17T10:55:49.124 INFO:teuthology.orchestra.run.trial196.stdout:Fetched 178 MB in 3s (64.2 MB/s) 2026-02-17T10:55:49.141 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T10:55:49.295 INFO:teuthology.orchestra.run.trial196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T10:55:49.297 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T10:55:49.297 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T10:55:49.317 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T10:55:49.330 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T10:55:49.330 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T10:55:49.347 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T10:55:49.359 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T10:55:49.360 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T10:55:49.379 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T10:55:49.387 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T10:55:49.393 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T10:55:49.426 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T10:55:49.436 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T10:55:49.436 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T10:55:49.453 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T10:55:49.461 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T10:55:49.462 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T10:55:49.482 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T10:55:49.490 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T10:55:49.490 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T10:55:49.507 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package librados2. 2026-02-17T10:55:49.515 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../007-librados2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:49.516 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.555 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libnbd0. 2026-02-17T10:55:49.563 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T10:55:49.564 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T10:55:49.578 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package librbd1. 2026-02-17T10:55:49.586 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../009-librbd1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:49.587 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.627 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T10:55:49.635 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:49.636 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.655 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-rados. 2026-02-17T10:55:49.664 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../011-python3-rados_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:49.664 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.681 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T10:55:49.689 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:49.690 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.704 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T10:55:49.712 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:49.713 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.728 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T10:55:49.736 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:49.736 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.754 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T10:55:49.762 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T10:55:49.763 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T10:55:49.779 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T10:55:49.787 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T10:55:49.787 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T10:55:49.802 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T10:55:49.810 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:49.810 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:49.826 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T10:55:49.835 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T10:55:49.835 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T10:55:49.853 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T10:55:49.861 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T10:55:49.861 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T10:55:49.878 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T10:55:49.887 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T10:55:49.887 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T10:55:49.905 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package lua5.1. 2026-02-17T10:55:49.913 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T10:55:49.913 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T10:55:49.933 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package lua-any. 2026-02-17T10:55:49.941 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T10:55:49.941 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T10:55:49.955 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package zip. 2026-02-17T10:55:49.963 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T10:55:49.964 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T10:55:49.981 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package unzip. 2026-02-17T10:55:49.989 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T10:55:49.990 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T10:55:50.007 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package luarocks. 2026-02-17T10:55:50.014 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T10:55:50.014 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T10:55:50.052 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package librgw2. 2026-02-17T10:55:50.061 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../026-librgw2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:50.061 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:50.153 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T10:55:50.161 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:50.161 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:50.178 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T10:55:50.186 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T10:55:50.187 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T10:55:50.201 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T10:55:50.209 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:50.209 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:50.228 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-common. 2026-02-17T10:55:50.236 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../030-ceph-common_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:50.236 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:50.439 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-base. 2026-02-17T10:55:50.448 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../031-ceph-base_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:50.452 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:50.515 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T10:55:50.524 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T10:55:50.524 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T10:55:50.538 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T10:55:50.546 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T10:55:50.547 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T10:55:50.564 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T10:55:50.573 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T10:55:50.573 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T10:55:50.588 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T10:55:50.596 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T10:55:50.597 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T10:55:50.610 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T10:55:50.619 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T10:55:50.619 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T10:55:50.634 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T10:55:50.642 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T10:55:50.642 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T10:55:50.657 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-portend. 2026-02-17T10:55:50.666 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T10:55:50.666 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T10:55:50.680 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T10:55:50.689 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T10:55:50.689 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T10:55:50.703 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T10:55:50.712 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T10:55:50.712 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T10:55:50.735 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T10:55:50.744 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T10:55:50.744 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T10:55:50.761 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T10:55:50.769 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T10:55:50.769 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T10:55:50.784 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-mako. 2026-02-17T10:55:50.791 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T10:55:50.791 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T10:55:50.807 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T10:55:50.816 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T10:55:50.816 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T10:55:50.830 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T10:55:50.838 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T10:55:50.839 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T10:55:50.856 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-webob. 2026-02-17T10:55:50.865 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T10:55:50.865 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T10:55:50.882 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T10:55:50.890 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T10:55:50.892 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T10:55:50.908 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T10:55:50.916 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T10:55:50.917 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T10:55:50.932 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-paste. 2026-02-17T10:55:50.940 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T10:55:50.940 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T10:55:50.967 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T10:55:50.976 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T10:55:50.977 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T10:55:50.990 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T10:55:50.998 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T10:55:50.998 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T10:55:51.014 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T10:55:51.022 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T10:55:51.023 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T10:55:51.037 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T10:55:51.046 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T10:55:51.046 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T10:55:51.071 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T10:55:51.079 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T10:55:51.080 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T10:55:51.099 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T10:55:51.107 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:51.107 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.135 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T10:55:51.144 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.144 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.159 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T10:55:51.167 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.167 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.190 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T10:55:51.198 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.198 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.257 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T10:55:51.266 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T10:55:51.266 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T10:55:51.282 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T10:55:51.291 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.291 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.441 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph. 2026-02-17T10:55:51.450 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../061-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.451 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.464 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T10:55:51.472 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.472 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.495 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T10:55:51.504 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.504 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.537 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package cephadm. 2026-02-17T10:55:51.545 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../064-cephadm_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:51.545 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.561 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T10:55:51.569 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T10:55:51.570 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T10:55:51.591 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T10:55:51.599 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:51.600 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.618 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T10:55:51.627 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T10:55:51.627 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T10:55:51.642 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-routes. 2026-02-17T10:55:51.650 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T10:55:51.650 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T10:55:51.669 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T10:55:51.678 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:51.678 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:51.886 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T10:55:51.895 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T10:55:51.895 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T10:55:51.933 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T10:55:51.941 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T10:55:51.942 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T10:55:51.969 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T10:55:51.978 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T10:55:51.978 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T10:55:51.993 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T10:55:52.002 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T10:55:52.002 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T10:55:52.085 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T10:55:52.094 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:52.095 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:52.258 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T10:55:52.268 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T10:55:52.268 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T10:55:52.282 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T10:55:52.291 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T10:55:52.291 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T10:55:52.308 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T10:55:52.317 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T10:55:52.317 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T10:55:52.334 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T10:55:52.343 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T10:55:52.343 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T10:55:52.357 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T10:55:52.366 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T10:55:52.366 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T10:55:52.383 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T10:55:52.392 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T10:55:52.393 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T10:55:52.485 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T10:55:52.494 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:52.494 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:52.508 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T10:55:52.516 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T10:55:52.523 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T10:55:52.538 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T10:55:52.547 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T10:55:52.547 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T10:55:52.561 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package jq. 2026-02-17T10:55:52.570 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T10:55:52.570 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T10:55:52.584 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package socat. 2026-02-17T10:55:52.593 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T10:55:52.593 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T10:55:52.613 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T10:55:52.621 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T10:55:52.622 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T10:55:52.656 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-test. 2026-02-17T10:55:52.664 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../087-ceph-test_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:52.665 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:53.144 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T10:55:53.153 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T10:55:53.153 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:53.176 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T10:55:53.184 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:53.184 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:53.198 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T10:55:53.208 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T10:55:53.208 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T10:55:53.229 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T10:55:53.237 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T10:55:53.238 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T10:55:53.254 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T10:55:53.263 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T10:55:53.264 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T10:55:53.294 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package pkg-config. 2026-02-17T10:55:53.302 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T10:55:53.303 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T10:55:53.318 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T10:55:53.327 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T10:55:53.327 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T10:55:53.356 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T10:55:53.365 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T10:55:53.365 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T10:55:53.380 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T10:55:53.388 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T10:55:53.389 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T10:55:53.407 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T10:55:53.416 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T10:55:53.416 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T10:55:53.432 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T10:55:53.440 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T10:55:53.441 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T10:55:53.459 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-py. 2026-02-17T10:55:53.468 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T10:55:53.468 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T10:55:53.489 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T10:55:53.497 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T10:55:53.497 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T10:55:53.540 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T10:55:53.548 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T10:55:53.549 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T10:55:53.564 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-toml. 2026-02-17T10:55:53.572 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T10:55:53.573 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T10:55:53.587 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T10:55:53.596 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T10:55:53.596 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T10:55:53.618 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T10:55:53.626 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T10:55:53.627 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T10:55:53.644 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T10:55:53.653 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T10:55:53.653 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T10:55:53.719 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package radosgw. 2026-02-17T10:55:53.727 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../106-radosgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:53.728 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:53.845 INFO:teuthology.orchestra.run.trial196.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T10:55:53.853 INFO:teuthology.orchestra.run.trial196.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T10:55:53.854 INFO:teuthology.orchestra.run.trial196.stdout:Unpacking rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:53.882 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T10:55:53.950 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T10:55:53.950 INFO:teuthology.orchestra.run.trial196.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T10:55:54.023 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T10:55:54.289 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T10:55:54.660 INFO:teuthology.orchestra.run.trial196.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T10:55:54.670 INFO:teuthology.orchestra.run.trial196.stdout:Setting up cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:54.715 INFO:teuthology.orchestra.run.trial196.stdout:Adding system user cephadm....done 2026-02-17T10:55:54.724 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T10:55:54.796 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T10:55:54.873 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T10:55:54.874 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T10:55:54.938 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T10:55:55.012 INFO:teuthology.orchestra.run.trial196.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T10:55:55.013 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T10:55:55.106 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T10:55:55.231 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T10:55:55.306 INFO:teuthology.orchestra.run.trial196.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T10:55:55.316 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T10:55:55.392 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T10:55:55.467 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:55.532 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T10:55:55.532 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T10:55:55.533 INFO:teuthology.orchestra.run.trial196.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T10:55:55.534 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T10:55:55.535 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T10:55:55.537 INFO:teuthology.orchestra.run.trial196.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T10:55:55.555 INFO:teuthology.orchestra.run.trial196.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T10:55:55.557 INFO:teuthology.orchestra.run.trial196.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T10:55:55.558 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T10:55:55.559 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T10:55:55.682 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T10:55:55.759 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T10:55:55.835 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T10:55:55.924 INFO:teuthology.orchestra.run.trial196.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T10:55:55.925 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T10:55:56.184 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T10:55:56.261 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T10:55:56.262 INFO:teuthology.orchestra.run.trial196.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T10:55:56.263 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T10:55:56.360 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T10:55:56.486 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T10:55:56.608 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T10:55:56.691 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T10:55:56.799 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T10:55:56.873 INFO:teuthology.orchestra.run.trial196.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T10:55:56.874 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:56.962 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T10:55:57.479 INFO:teuthology.orchestra.run.trial196.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T10:55:57.502 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T10:55:57.506 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T10:55:57.581 INFO:teuthology.orchestra.run.trial196.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T10:55:57.582 INFO:teuthology.orchestra.run.trial196.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T10:55:57.583 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T10:55:57.660 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T10:55:57.733 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T10:55:57.734 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T10:55:57.811 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T10:55:57.886 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T10:55:57.965 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T10:55:58.043 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T10:55:58.117 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T10:55:58.198 INFO:teuthology.orchestra.run.trial196.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T10:55:58.199 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T10:55:58.286 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T10:55:58.287 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T10:55:58.365 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T10:55:58.446 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T10:55:58.533 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T10:55:58.609 INFO:teuthology.orchestra.run.trial196.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T10:55:58.610 INFO:teuthology.orchestra.run.trial196.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T10:55:58.611 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T10:55:58.612 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T10:55:58.752 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T10:55:58.829 INFO:teuthology.orchestra.run.trial196.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T10:55:58.830 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T10:55:58.906 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T10:55:58.907 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T10:55:58.991 INFO:teuthology.orchestra.run.trial196.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T10:55:58.991 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T10:55:59.073 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T10:55:59.211 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T10:55:59.302 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T10:55:59.418 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T10:55:59.419 INFO:teuthology.orchestra.run.trial196.stdout:Setting up librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:59.420 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:59.421 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T10:55:59.943 INFO:teuthology.orchestra.run.trial196.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T10:55:59.955 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:59.956 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:59.957 INFO:teuthology.orchestra.run.trial196.stdout:Setting up librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:59.958 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:55:59.959 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.027 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T10:56:00.027 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T10:56:00.423 INFO:teuthology.orchestra.run.trial196.stdout:Setting up libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.423 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.425 INFO:teuthology.orchestra.run.trial196.stdout:Setting up librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.427 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.429 INFO:teuthology.orchestra.run.trial196.stdout:Setting up rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.430 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.431 INFO:teuthology.orchestra.run.trial196.stdout:Setting up python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.433 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:00.464 INFO:teuthology.orchestra.run.trial196.stdout:Adding group ceph....done 2026-02-17T10:56:00.500 INFO:teuthology.orchestra.run.trial196.stdout:Adding system user ceph....done 2026-02-17T10:56:00.510 INFO:teuthology.orchestra.run.trial196.stdout:Setting system user ceph properties....done 2026-02-17T10:56:00.515 INFO:teuthology.orchestra.run.trial196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T10:56:00.600 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T10:56:00.871 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T10:56:01.261 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:01.261 INFO:teuthology.orchestra.run.trial196.stdout:Setting up radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:01.507 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T10:56:01.507 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T10:56:01.887 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:02.008 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T10:56:02.363 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:02.421 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T10:56:02.422 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T10:56:02.779 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:02.859 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T10:56:02.859 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T10:56:03.246 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:03.335 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T10:56:03.335 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T10:56:03.719 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:03.720 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:03.730 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:03.801 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T10:56:03.801 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T10:56:04.142 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:04.153 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:04.154 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:04.165 INFO:teuthology.orchestra.run.trial196.stdout:Setting up ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T10:56:04.278 INFO:teuthology.orchestra.run.trial196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T10:56:04.285 INFO:teuthology.orchestra.run.trial196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T10:56:04.303 INFO:teuthology.orchestra.run.trial196.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T10:56:04.391 INFO:teuthology.orchestra.run.trial196.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T10:56:04.900 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:04.900 INFO:teuthology.orchestra.run.trial196.stdout:Running kernel seems to be up-to-date. 2026-02-17T10:56:04.900 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:04.900 INFO:teuthology.orchestra.run.trial196.stdout:The processor microcode seems to be up-to-date. 2026-02-17T10:56:04.900 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:04.900 INFO:teuthology.orchestra.run.trial196.stdout:No services need to be restarted. 2026-02-17T10:56:04.900 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:04.901 INFO:teuthology.orchestra.run.trial196.stdout:No containers need to be restarted. 2026-02-17T10:56:04.901 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:04.901 INFO:teuthology.orchestra.run.trial196.stdout:No user sessions are running outdated binaries. 2026-02-17T10:56:04.901 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:04.901 INFO:teuthology.orchestra.run.trial196.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T10:56:05.572 INFO:teuthology.orchestra.run.trial196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T10:56:05.579 DEBUG:teuthology.parallel:result is None 2026-02-17T10:56:05.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T10:56:05.749 DEBUG:teuthology.orchestra.run.trial196:> dpkg-query -W -f '${Version}' ceph 2026-02-17T10:56:05.760 INFO:teuthology.orchestra.run.trial196.stdout:19.2.3-705-g04cf6dd4-1jammy 2026-02-17T10:56:05.760 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T10:56:05.760 INFO:teuthology.task.install:The correct ceph version 19.2.3-705-g04cf6dd4-1jammy is installed. 2026-02-17T10:56:05.762 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T10:56:05.762 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:05.762 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T10:56:05.808 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T10:56:05.808 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:05.808 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T10:56:05.860 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T10:56:05.907 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T10:56:05.907 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:05.907 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T10:56:05.956 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T10:56:06.004 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T10:56:06.005 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:06.005 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T10:56:06.052 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T10:56:06.099 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T10:56:06.177 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T10:56:06.177 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 777 /var/log/ceph 2026-02-17T10:56:06.185 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T10:56:06.185 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T10:56:06.235 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T10:56:06.235 DEBUG:teuthology.orchestra.run.trial196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T10:56:06.293 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T10:56:06.293 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T10:56:06.293 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51233', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOn+dFaLEtL+7I0B2v2HbtHKrSawaMHGFq2XOSODFSWVdb7zNb58g36om5v3nYmhF3ooRS3V352qn/sFRaHeEtw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'config': {'client': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'osd pool default min size': 1}}, 'log-ignorelist': ['objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'cluster': 'ceph'}}, {'watch_notify_same_primary': {'clients': ['client.0']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T10:56:06.293 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T10:56:06.328 DEBUG:teuthology.orchestra.run.trial196:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T10:56:06.377 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:06.377 DEBUG:teuthology.orchestra.run.trial196:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T10:56:06.424 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T10:56:06.425 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_1 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout:Device: 5h/5d Inode: 905 Links: 1 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 10:55:24.137278632 +0000 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 10:55:23.969283985 +0000 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 10:55:23.969283985 +0000 2026-02-17T10:56:06.472 INFO:teuthology.orchestra.run.trial196.stdout: Birth: - 2026-02-17T10:56:06.473 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T10:56:06.523 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T10:56:06.523 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T10:56:06.523 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000184198 s, 2.8 MB/s 2026-02-17T10:56:06.523 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T10:56:06.569 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_2 2026-02-17T10:56:06.616 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T10:56:06.617 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:56:06.617 INFO:teuthology.orchestra.run.trial196.stdout:Device: 5h/5d Inode: 929 Links: 1 2026-02-17T10:56:06.617 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:56:06.617 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 10:55:24.469268053 +0000 2026-02-17T10:56:06.617 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 10:55:24.293273661 +0000 2026-02-17T10:56:06.617 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 10:55:24.293273661 +0000 2026-02-17T10:56:06.617 INFO:teuthology.orchestra.run.trial196.stdout: Birth: - 2026-02-17T10:56:06.618 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T10:56:06.667 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T10:56:06.667 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T10:56:06.668 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000182586 s, 2.8 MB/s 2026-02-17T10:56:06.668 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T10:56:06.717 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_3 2026-02-17T10:56:06.764 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T10:56:06.765 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:56:06.765 INFO:teuthology.orchestra.run.trial196.stdout:Device: 5h/5d Inode: 962 Links: 1 2026-02-17T10:56:06.765 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:56:06.765 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 10:55:24.637262700 +0000 2026-02-17T10:56:06.765 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 10:55:24.633262827 +0000 2026-02-17T10:56:06.765 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 10:55:24.633262827 +0000 2026-02-17T10:56:06.765 INFO:teuthology.orchestra.run.trial196.stdout: Birth: - 2026-02-17T10:56:06.766 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T10:56:06.815 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T10:56:06.816 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T10:56:06.816 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000182074 s, 2.8 MB/s 2026-02-17T10:56:06.817 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T10:56:06.866 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_4 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout:Device: 5h/5d Inode: 976 Links: 1 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-17 10:55:25.137246768 +0000 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-17 10:55:24.985251611 +0000 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-17 10:55:24.985251611 +0000 2026-02-17T10:56:06.911 INFO:teuthology.orchestra.run.trial196.stdout: Birth: - 2026-02-17T10:56:06.912 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T10:56:06.959 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-17T10:56:06.959 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-17T10:56:06.959 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000177466 s, 2.9 MB/s 2026-02-17T10:56:06.960 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T10:56:07.005 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:56:07.006 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial196.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T10:56:07.006 INFO:tasks.ceph:Generating config... 2026-02-17T10:56:07.007 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T10:56:07.008 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T10:56:07.008 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T10:56:07.008 INFO:tasks.ceph:[global] ms type = async 2026-02-17T10:56:07.008 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T10:56:07.008 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T10:56:07.008 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T10:56:07.008 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T10:56:07.008 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T10:56:07.008 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T10:56:07.008 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2026-02-17T10:56:07.008 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2026-02-17T10:56:07.008 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T10:56:07.008 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T10:56:07.008 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T10:56:07.009 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T10:56:07.010 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T10:56:07.010 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T10:56:07.010 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T10:56:07.064 INFO:teuthology.orchestra.run.trial196.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T10:56:07.067 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T10:56:07.127 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T10:56:07.176 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.196'), ('mon.b', '[v2:10.20.193.196:3301,v1:10.20.193.196:6790]'), ('mon.c', '[v2:10.20.193.196:3302,v1:10.20.193.196:6791]')] 2026-02-17T10:56:07.177 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.196,[v2:10.20.193.196:3301,v1:10.20.193.196:6790],[v2:10.20.193.196:3302,v1:10.20.193.196:6791]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-17T10:56:07.179 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:07.179 DEBUG:teuthology.orchestra.run.trial196:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T10:56:07.225 DEBUG:teuthology.orchestra.run.trial196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.196 --addv b '[v2:10.20.193.196:3301,v1:10.20.193.196:6790]' --addv c '[v2:10.20.193.196:3302,v1:10.20.193.196:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:56:07.287 INFO:teuthology.orchestra.run.trial196.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:56:07.287 INFO:teuthology.orchestra.run.trial196.stdout:monmaptool: generated fsid 633ea263-1a23-44b1-b719-26cb7ff8f4d8 2026-02-17T10:56:07.287 INFO:teuthology.orchestra.run.trial196.stdout:setting min_mon_release = quincy 2026-02-17T10:56:07.287 INFO:teuthology.orchestra.run.trial196.stdout:epoch 0 2026-02-17T10:56:07.287 INFO:teuthology.orchestra.run.trial196.stdout:fsid 633ea263-1a23-44b1-b719-26cb7ff8f4d8 2026-02-17T10:56:07.287 INFO:teuthology.orchestra.run.trial196.stdout:last_changed 2026-02-17T10:56:07.286018+0000 2026-02-17T10:56:07.288 INFO:teuthology.orchestra.run.trial196.stdout:created 2026-02-17T10:56:07.286018+0000 2026-02-17T10:56:07.288 INFO:teuthology.orchestra.run.trial196.stdout:min_mon_release 17 (quincy) 2026-02-17T10:56:07.288 INFO:teuthology.orchestra.run.trial196.stdout:election_strategy: 1 2026-02-17T10:56:07.288 INFO:teuthology.orchestra.run.trial196.stdout:0: [v2:10.20.193.196:3300/0,v1:10.20.193.196:6789/0] mon.a 2026-02-17T10:56:07.288 INFO:teuthology.orchestra.run.trial196.stdout:1: [v2:10.20.193.196:3301/0,v1:10.20.193.196:6790/0] mon.b 2026-02-17T10:56:07.288 INFO:teuthology.orchestra.run.trial196.stdout:2: [v2:10.20.193.196:3302/0,v1:10.20.193.196:6791/0] mon.c 2026-02-17T10:56:07.288 INFO:teuthology.orchestra.run.trial196.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T10:56:07.290 DEBUG:teuthology.orchestra.run.trial196:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T10:56:07.336 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 633ea263-1a23-44b1-b719-26cb7ff8f4d8... 2026-02-17T10:56:07.338 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T10:56:07.399 INFO:teuthology.orchestra.run.trial196.stdout:[global] 2026-02-17T10:56:07.399 INFO:teuthology.orchestra.run.trial196.stdout: chdir = "" 2026-02-17T10:56:07.399 INFO:teuthology.orchestra.run.trial196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T10:56:07.399 INFO:teuthology.orchestra.run.trial196.stdout: auth supported = cephx 2026-02-17T10:56:07.399 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.399 INFO:teuthology.orchestra.run.trial196.stdout: filestore xattr use omap = true 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon clock drift allowed = 1.000 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: osd crush chooseleaf type = 0 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: auth debug = true 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: ms die on old message = true 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: ms die on bug = true 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon pg warn max object skew = 0 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: osd pool default size = 2 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon osd allow primary affinity = true 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon osd allow pg remap = true 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on legacy crush tunables = false 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on crush straw calc version zero = false 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on no sortbitwise = false 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on osd down out interval zero = false 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on too few osds = false 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: mon_allow_pool_size_one = true 2026-02-17T10:56:07.400 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd default data pool replay window = 5 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: mon allow pool delete = true 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: mon cluster log file level = debug 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: debug asserts on shutdown = true 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: mon health detail to clog = false 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: mon host = "10.20.193.196,[v2:10.20.193.196:3301,v1:10.20.193.196:6790],[v2:10.20.193.196:3302,v1:10.20.193.196:6791]" 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: mon client directed command retry = 5 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: mon election default strategy = 1 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: ms inject socket failures = 5000 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: ms type = async 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: fsid = 633ea263-1a23-44b1-b719-26cb7ff8f4d8 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout:[osd] 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd journal size = 100 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd scrub load threshold = 5.0 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd scrub max interval = 600 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd mclock profile = high_recovery_ops 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd recover clone overlap = true 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd recovery max chunk = 1048576 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd debug shutdown = true 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd debug op order = true 2026-02-17T10:56:07.401 INFO:teuthology.orchestra.run.trial196.stdout: osd debug verify stray on activate = true 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd debug trim objects = true 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd open classes on start = true 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd debug pg log writeout = true 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd deep scrub update digest min age = 30 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd map max advance = 10 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: journal zero on create = true 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: filestore ondisk finisher threads = 3 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: filestore apply finisher threads = 3 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: bdev debug aio = true 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd debug misdirected ops = true 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: bluefs allocator = hybrid 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: bluestore allocator = hybrid 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: bluestore block size = 96636764160 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: bluestore fsck on mount = True 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: bluestore zero block detection = True 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: debug bluefs = 20 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: debug bluestore = 20 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: debug ms = 1 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: debug osd = 20 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: debug rocksdb = 10 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: mon osd full ratio = 0.9 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: mon osd nearfull ratio = 0.8 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd debug verify cached snaps = True 2026-02-17T10:56:07.402 INFO:teuthology.orchestra.run.trial196.stdout: osd debug verify missing on start = True 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: osd failsafe full ratio = 0.95 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: osd mclock override recovery settings = True 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: osd objectstore = bluestore 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: osd op queue = debug_random 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: osd op queue cut off = debug_random 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout:[mgr] 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug ms = 1 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug mgr = 20 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug mon = 20 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug auth = 20 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min pgs per osd = 4 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min bytes per osd = 10 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mgr/telemetry/nag = false 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout:[mon] 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug ms = 1 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug mon = 20 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug paxos = 20 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: debug auth = 20 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon data avail warn = 5 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon mgr mkfs grace = 240 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min pgs per osd = 4 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon osd reporter subtree level = osd 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon osd prime pg temp = true 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min bytes per osd = 10 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T10:56:07.403 INFO:teuthology.orchestra.run.trial196.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: # 1m isn't quite enough 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: mon_down_mkfs_grace = 2m 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_filestore_osds = false 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: mon scrub interval = 300 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout:[client] 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: rgw cache enabled = true 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: rgw enable ops log = true 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: rgw enable usage log = true 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout:[mon.a] 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout:[mon.b] 2026-02-17T10:56:07.404 INFO:teuthology.orchestra.run.trial196.stdout:[mon.c] 2026-02-17T10:56:07.407 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T10:56:07.407 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T10:56:07.470 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T10:56:07.471 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:07.471 DEBUG:teuthology.orchestra.run.trial196:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T10:56:07.521 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:07.521 DEBUG:teuthology.orchestra.run.trial196:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T10:56:07.569 INFO:tasks.ceph:Sending monmap to node ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:56:07.569 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:07.569 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T10:56:07.569 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T10:56:07.626 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:07.627 DEBUG:teuthology.orchestra.run.trial196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:56:07.673 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T10:56:07.673 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T10:56:07.673 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T10:56:07.743 INFO:teuthology.orchestra.run.trial196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T10:56:07.746 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T10:56:07.746 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T10:56:07.747 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T10:56:07.810 INFO:teuthology.orchestra.run.trial196.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T10:56:07.818 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T10:56:07.819 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial196.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T10:56:07.819 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T10:56:07.868 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:56:07.868 INFO:tasks.ceph:role: osd.0 2026-02-17T10:56:07.869 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:56:07.869 DEBUG:teuthology.orchestra.run.trial196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T10:56:07.922 INFO:teuthology.orchestra.run.trial196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T10:56:07.922 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T10:56:07.922 INFO:teuthology.orchestra.run.trial196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T10:56:07.922 INFO:teuthology.orchestra.run.trial196.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T10:56:07.923 INFO:teuthology.orchestra.run.trial196.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T10:56:07.923 INFO:teuthology.orchestra.run.trial196.stdout: = sunit=0 swidth=0 blks 2026-02-17T10:56:07.923 INFO:teuthology.orchestra.run.trial196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T10:56:07.923 INFO:teuthology.orchestra.run.trial196.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T10:56:07.923 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T10:56:07.923 INFO:teuthology.orchestra.run.trial196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T10:56:08.497 INFO:teuthology.orchestra.run.trial196.stdout:Discarding blocks...Done. 2026-02-17T10:56:08.498 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial196.front.sepia.ceph.com -o noatime 2026-02-17T10:56:08.499 DEBUG:teuthology.orchestra.run.trial196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T10:56:08.556 DEBUG:teuthology.orchestra.run.trial196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T10:56:08.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:56:08.607 INFO:teuthology.orchestra.run.trial196.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T10:56:08.607 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T10:56:08.657 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:56:08.657 INFO:tasks.ceph:role: osd.1 2026-02-17T10:56:08.657 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:56:08.657 DEBUG:teuthology.orchestra.run.trial196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T10:56:08.711 INFO:teuthology.orchestra.run.trial196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T10:56:08.711 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T10:56:08.711 INFO:teuthology.orchestra.run.trial196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T10:56:08.711 INFO:teuthology.orchestra.run.trial196.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T10:56:08.711 INFO:teuthology.orchestra.run.trial196.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T10:56:08.712 INFO:teuthology.orchestra.run.trial196.stdout: = sunit=0 swidth=0 blks 2026-02-17T10:56:08.712 INFO:teuthology.orchestra.run.trial196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T10:56:08.712 INFO:teuthology.orchestra.run.trial196.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T10:56:08.712 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T10:56:08.712 INFO:teuthology.orchestra.run.trial196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T10:56:09.282 INFO:teuthology.orchestra.run.trial196.stdout:Discarding blocks...Done. 2026-02-17T10:56:09.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial196.front.sepia.ceph.com -o noatime 2026-02-17T10:56:09.284 DEBUG:teuthology.orchestra.run.trial196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T10:56:09.337 DEBUG:teuthology.orchestra.run.trial196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T10:56:09.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:56:09.387 INFO:teuthology.orchestra.run.trial196.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T10:56:09.387 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T10:56:09.436 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T10:56:09.437 INFO:tasks.ceph:role: osd.2 2026-02-17T10:56:09.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:56:09.437 DEBUG:teuthology.orchestra.run.trial196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T10:56:09.490 INFO:teuthology.orchestra.run.trial196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T10:56:09.490 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T10:56:09.490 INFO:teuthology.orchestra.run.trial196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T10:56:09.491 INFO:teuthology.orchestra.run.trial196.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T10:56:09.491 INFO:teuthology.orchestra.run.trial196.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T10:56:09.491 INFO:teuthology.orchestra.run.trial196.stdout: = sunit=0 swidth=0 blks 2026-02-17T10:56:09.491 INFO:teuthology.orchestra.run.trial196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T10:56:09.491 INFO:teuthology.orchestra.run.trial196.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T10:56:09.491 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T10:56:09.491 INFO:teuthology.orchestra.run.trial196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T10:56:10.051 INFO:teuthology.orchestra.run.trial196.stdout:Discarding blocks...Done. 2026-02-17T10:56:10.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial196.front.sepia.ceph.com -o noatime 2026-02-17T10:56:10.053 DEBUG:teuthology.orchestra.run.trial196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T10:56:10.109 DEBUG:teuthology.orchestra.run.trial196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T10:56:10.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:56:10.159 INFO:teuthology.orchestra.run.trial196.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T10:56:10.160 DEBUG:teuthology.orchestra.run.trial196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:56:10.223 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:10.218+0000 7f02129e38c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T10:56:10.224 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:10.218+0000 7f02129e38c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T10:56:10.224 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:10.218+0000 7f02129e38c0 -1 bdev(0x564b0aa9b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T10:56:10.224 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:10.218+0000 7f02129e38c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T10:56:13.324 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T10:56:13.373 DEBUG:teuthology.orchestra.run.trial196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:56:13.438 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:13.434+0000 7fbac3e3a8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T10:56:13.438 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:13.434+0000 7fbac3e3a8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T10:56:13.439 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:13.434+0000 7fbac3e3a8c0 -1 bdev(0x556f913c7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T10:56:13.439 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:13.434+0000 7fbac3e3a8c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T10:56:16.534 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T10:56:16.585 DEBUG:teuthology.orchestra.run.trial196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:56:16.649 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:16.646+0000 7fa6c4e208c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T10:56:16.650 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:16.646+0000 7fa6c4e208c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T10:56:16.650 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:16.646+0000 7fa6c4e208c0 -1 bdev(0x560fe73bb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T10:56:16.650 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-17T10:56:16.646+0000 7fa6c4e208c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T10:56:19.769 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T10:56:19.817 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T10:56:19.817 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:19.817 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T10:56:19.869 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:19.869 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T10:56:19.922 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:19.922 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T10:56:19.975 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:19.975 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T10:56:20.026 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:20.027 DEBUG:teuthology.orchestra.run.trial196:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T10:56:20.074 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T10:56:20.074 DEBUG:teuthology.orchestra.run.trial196:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T10:56:20.123 INFO:teuthology.orchestra.run.trial196.stdout:[mgr.x] 2026-02-17T10:56:20.123 INFO:teuthology.orchestra.run.trial196.stdout: key = AQBHSZRp2ipFLBAA+z2DqJfs6K8xSgdXBvsxlw== 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout:[osd.0] 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout: key = AQBKSZRpN949DRAAwqFRwTBto+sDe+S69SJD2Q== 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout:[osd.1] 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout: key = AQBNSZRpFYYLGhAAo8/ysY0U+u2ao4spJAhn1g== 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout:[osd.2] 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout: key = AQBQSZRpD8emJhAAMGOVU3FQovRtlmBvsbG1tg== 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout:[client.0] 2026-02-17T10:56:20.124 INFO:teuthology.orchestra.run.trial196.stdout: key = AQBHSZRpz3JFMBAA/10tznTm81ptr/9VqQRG3A== 2026-02-17T10:56:20.125 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T10:56:20.190 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T10:56:20.253 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T10:56:20.316 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T10:56:20.378 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T10:56:20.442 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T10:56:20.442 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T10:56:20.493 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T10:56:20.563 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T10:56:20.613 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T10:56:20.661 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T10:56:20.730 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T10:56:20.780 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T10:56:20.832 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T10:56:20.899 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T10:56:20.948 DEBUG:teuthology.orchestra.run.trial196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T10:56:20.991 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T10:56:20.991 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T10:56:20.992 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T10:56:21.034 INFO:tasks.ceph.mon.a:Started 2026-02-17T10:56:21.034 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T10:56:21.035 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T10:56:21.037 INFO:tasks.ceph.mon.b:Started 2026-02-17T10:56:21.037 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T10:56:21.037 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T10:56:21.039 INFO:tasks.ceph.mon.c:Started 2026-02-17T10:56:21.039 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T10:56:21.753 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T10:56:21.753 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T10:56:21.754 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T10:56:21.755 INFO:tasks.ceph.mgr.x:Started 2026-02-17T10:56:21.756 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T10:56:21.756 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T10:56:21.863 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:21.858+0000 7f449ed5c280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T10:56:21.863 INFO:teuthology.orchestra.run.trial196.stderr:adjusted tunables profile to default 2026-02-17T10:56:21.873 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T10:56:21.873 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T10:56:21.873 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:21.873 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T10:56:21.881 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:21.881 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T10:56:21.888 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:21.882+0000 7f449ed5c280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T10:56:21.896 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-17T10:56:21.896 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T10:56:21.925 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:21.918+0000 7f449ed5c280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T10:56:21.933 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd new b3a8607d-2fc0-42fa-8964-003c712fec74 0 2026-02-17T10:56:22.012 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.006+0000 7f449ed5c280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T10:56:22.090 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.086+0000 7f449ed5c280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T10:56:22.092 INFO:teuthology.orchestra.run.trial196.stdout:0 2026-02-17T10:56:22.101 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd new b0942728-26e3-4493-99f1-621bb3dfbdcb 1 2026-02-17T10:56:22.127 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.122+0000 7f449ed5c280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T10:56:22.201 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.198+0000 7f449ed5c280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T10:56:22.226 INFO:teuthology.orchestra.run.trial196.stdout:1 2026-02-17T10:56:22.235 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd new 26c3f205-be95-44ed-9981-c15935c8bb25 2 2026-02-17T10:56:22.335 INFO:teuthology.orchestra.run.trial196.stdout:2 2026-02-17T10:56:22.345 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T10:56:22.345 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T10:56:22.347 INFO:tasks.ceph.osd.0:Started 2026-02-17T10:56:22.347 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T10:56:22.347 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T10:56:22.349 INFO:tasks.ceph.osd.1:Started 2026-02-17T10:56:22.349 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T10:56:22.349 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T10:56:22.351 INFO:tasks.ceph.osd.2:Started 2026-02-17T10:56:22.351 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:56:22.375 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.370+0000 7f449ed5c280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T10:56:22.443 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:22.444 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":5,"fsid":"633ea263-1a23-44b1-b719-26cb7ff8f4d8","created":"2026-02-17T10:56:21.359007+0000","modified":"2026-02-17T10:56:22.332426+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T10:56:22.332426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3a8607d-2fc0-42fa-8964-003c712fec74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0942728-26e3-4493-99f1-621bb3dfbdcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26c3f205-be95-44ed-9981-c15935c8bb25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:56:22.454 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T10:56:22.454 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T10:56:22.683 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.678+0000 7f449ed5c280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T10:56:22.756 DEBUG:teuthology.orchestra.run.trial196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T10:56:22.774 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.770+0000 7f449ed5c280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T10:56:22.801 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.798+0000 7f449ed5c280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T10:56:22.832 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.826+0000 7f449ed5c280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T10:56:22.844 INFO:teuthology.misc.health.trial196.stdout: 2026-02-17T10:56:22.845 INFO:teuthology.misc.health.trial196.stdout:{"epoch":5,"fsid":"633ea263-1a23-44b1-b719-26cb7ff8f4d8","created":"2026-02-17T10:56:21.359007+0000","modified":"2026-02-17T10:56:22.332426+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T10:56:22.332426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3a8607d-2fc0-42fa-8964-003c712fec74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0942728-26e3-4493-99f1-621bb3dfbdcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26c3f205-be95-44ed-9981-c15935c8bb25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:56:22.853 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T10:56:22.876 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.870+0000 7f449ed5c280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T10:56:22.979 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:22.974+0000 7f449ed5c280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T10:56:23.175 INFO:tasks.ceph.mgr.x.trial196.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-17T10:56:23.351 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.346+0000 7f449ed5c280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T10:56:23.383 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.378+0000 7f449ed5c280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T10:56:23.478 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.474+0000 7f449ed5c280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T10:56:23.502 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.498+0000 7f449ed5c280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T10:56:23.529 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.522+0000 7f449ed5c280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T10:56:23.556 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.550+0000 7f449ed5c280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T10:56:23.681 INFO:tasks.ceph.mgr.x.trial196.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T10:56:23.681 INFO:tasks.ceph.mgr.x.trial196.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T10:56:23.681 INFO:tasks.ceph.mgr.x.trial196.stderr: from numpy import show_config as show_numpy_config 2026-02-17T10:56:23.688 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.682+0000 7f449ed5c280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T10:56:23.713 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.710+0000 7f449ed5c280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T10:56:23.752 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:23.746+0000 7f449ed5c280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T10:56:23.922 INFO:tasks.ceph.osd.0.trial196.stderr:2026-02-17T10:56:23.918+0000 7f03df9008c0 -1 Falling back to public interface 2026-02-17T10:56:23.923 INFO:tasks.ceph.osd.1.trial196.stderr:2026-02-17T10:56:23.918+0000 7fe3a00fb8c0 -1 Falling back to public interface 2026-02-17T10:56:23.958 INFO:tasks.ceph.osd.2.trial196.stderr:2026-02-17T10:56:23.954+0000 7f6b85c548c0 -1 Falling back to public interface 2026-02-17T10:56:24.779 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:24.774+0000 7f43bd7a9640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T10:56:24.982 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-17T10:56:24.978+0000 7f43bd7a9640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T10:56:27.743 INFO:tasks.ceph.osd.1.trial196.stderr:2026-02-17T10:56:27.738+0000 7fe3a00fb8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T10:56:27.796 INFO:tasks.ceph.osd.0.trial196.stderr:2026-02-17T10:56:27.790+0000 7f03df9008c0 -1 osd.0 0 log_to_monitors true 2026-02-17T10:56:27.892 INFO:tasks.ceph.osd.2.trial196.stderr:2026-02-17T10:56:27.886+0000 7f6b85c548c0 -1 osd.2 0 log_to_monitors true 2026-02-17T10:56:28.787 INFO:tasks.ceph.osd.1.trial196.stderr:2026-02-17T10:56:28.782+0000 7fe39c0a4640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T10:56:28.818 INFO:tasks.ceph.osd.1.trial196.stderr:2026-02-17T10:56:28.814+0000 7fe397edf640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T10:56:29.155 DEBUG:teuthology.orchestra.run.trial196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T10:56:29.302 INFO:teuthology.misc.health.trial196.stdout: 2026-02-17T10:56:29.303 INFO:teuthology.misc.health.trial196.stdout:{"epoch":7,"fsid":"633ea263-1a23-44b1-b719-26cb7ff8f4d8","created":"2026-02-17T10:56:21.359007+0000","modified":"2026-02-17T10:56:28.779377+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T10:56:22.332426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3a8607d-2fc0-42fa-8964-003c712fec74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0942728-26e3-4493-99f1-621bb3dfbdcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"26c3f205-be95-44ed-9981-c15935c8bb25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:56:29.312 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T10:56:30.172 INFO:tasks.ceph.osd.2.trial196.stderr:2026-02-17T10:56:30.165+0000 7f6b81bfd640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T10:56:30.198 INFO:tasks.ceph.osd.2.trial196.stderr:2026-02-17T10:56:30.193+0000 7f6b79a30640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T10:56:30.206 INFO:tasks.ceph.osd.0.trial196.stderr:2026-02-17T10:56:30.201+0000 7f03db8a9640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T10:56:30.230 INFO:tasks.ceph.osd.0.trial196.stderr:2026-02-17T10:56:30.225+0000 7f03d36dc640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T10:56:35.614 DEBUG:teuthology.orchestra.run.trial196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T10:56:35.755 INFO:teuthology.misc.health.trial196.stdout: 2026-02-17T10:56:35.755 INFO:teuthology.misc.health.trial196.stdout:{"epoch":9,"fsid":"633ea263-1a23-44b1-b719-26cb7ff8f4d8","created":"2026-02-17T10:56:21.359007+0000","modified":"2026-02-17T10:56:31.206123+0000","last_up_change":"2026-02-17T10:56:31.206123+0000","last_in_change":"2026-02-17T10:56:22.332426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3a8607d-2fc0-42fa-8964-003c712fec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6804","nonce":1572439835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6808","nonce":1572439835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6814","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6816","nonce":1572439835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6812","nonce":1572439835}]},"public_addr":"10.20.193.196:6804/1572439835","cluster_addr":"10.20.193.196:6808/1572439835","heartbeat_back_addr":"10.20.193.196:6816/1572439835","heartbeat_front_addr":"10.20.193.196:6812/1572439835","state":["exists","up"]},{"osd":1,"uuid":"b0942728-26e3-4493-99f1-621bb3dfbdcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6803","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6805","nonce":4190182765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6807","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6809","nonce":4190182765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6815","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6817","nonce":4190182765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6811","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6813","nonce":4190182765}]},"public_addr":"10.20.193.196:6805/4190182765","cluster_addr":"10.20.193.196:6809/4190182765","heartbeat_back_addr":"10.20.193.196:6817/4190182765","heartbeat_front_addr":"10.20.193.196:6813/4190182765","state":["exists","up"]},{"osd":2,"uuid":"26c3f205-be95-44ed-9981-c15935c8bb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6818","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6819","nonce":1169028315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6820","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6821","nonce":1169028315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6824","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6825","nonce":1169028315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6822","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6823","nonce":1169028315}]},"public_addr":"10.20.193.196:6819/1169028315","cluster_addr":"10.20.193.196:6821/1169028315","heartbeat_back_addr":"10.20.193.196:6825/1169028315","heartbeat_front_addr":"10.20.193.196:6823/1169028315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:56:35.763 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T10:56:35.763 INFO:tasks.ceph:Creating RBD pool 2026-02-17T10:56:35.764 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T10:56:36.800 INFO:teuthology.orchestra.run.trial196.stderr:pool 'rbd' created 2026-02-17T10:56:36.814 DEBUG:teuthology.orchestra.run.trial196:> rbd --cluster ceph pool init rbd 2026-02-17T10:56:39.819 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T10:56:39.820 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T10:56:39.820 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T10:56:39.820 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T10:56:39.821 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T10:56:39.992 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:40.001 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":4,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6800","nonce":2337573599},{"type":"v1","addr":"10.20.193.196:6801","nonce":2337573599}]},"active_addr":"10.20.193.196:6801/2337573599","active_change":"2026-02-17T10:56:23.768707+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.196:0","nonce":3621412157}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.196:0","nonce":3411705270}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.196:0","nonce":544559414}]}]} 2026-02-17T10:56:40.002 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T10:56:40.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T10:56:40.003 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:56:40.153 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:40.154 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":13,"fsid":"633ea263-1a23-44b1-b719-26cb7ff8f4d8","created":"2026-02-17T10:56:21.359007+0000","modified":"2026-02-17T10:56:39.805700+0000","last_up_change":"2026-02-17T10:56:31.206123+0000","last_in_change":"2026-02-17T10:56:22.332426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T10:56:35.906512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3a8607d-2fc0-42fa-8964-003c712fec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6804","nonce":1572439835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6808","nonce":1572439835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6814","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6816","nonce":1572439835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6812","nonce":1572439835}]},"public_addr":"10.20.193.196:6804/1572439835","cluster_addr":"10.20.193.196:6808/1572439835","heartbeat_back_addr":"10.20.193.196:6816/1572439835","heartbeat_front_addr":"10.20.193.196:6812/1572439835","state":["exists","up"]},{"osd":1,"uuid":"b0942728-26e3-4493-99f1-621bb3dfbdcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6803","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6805","nonce":4190182765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6807","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6809","nonce":4190182765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6815","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6817","nonce":4190182765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6811","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6813","nonce":4190182765}]},"public_addr":"10.20.193.196:6805/4190182765","cluster_addr":"10.20.193.196:6809/4190182765","heartbeat_back_addr":"10.20.193.196:6817/4190182765","heartbeat_front_addr":"10.20.193.196:6813/4190182765","state":["exists","up"]},{"osd":2,"uuid":"26c3f205-be95-44ed-9981-c15935c8bb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6818","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6819","nonce":1169028315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6820","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6821","nonce":1169028315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6824","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6825","nonce":1169028315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6822","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6823","nonce":1169028315}]},"public_addr":"10.20.193.196:6819/1169028315","cluster_addr":"10.20.193.196:6821/1169028315","heartbeat_back_addr":"10.20.193.196:6825/1169028315","heartbeat_front_addr":"10.20.193.196:6823/1169028315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:56:40.166 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T10:56:40.166 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:56:40.321 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:40.321 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":13,"fsid":"633ea263-1a23-44b1-b719-26cb7ff8f4d8","created":"2026-02-17T10:56:21.359007+0000","modified":"2026-02-17T10:56:39.805700+0000","last_up_change":"2026-02-17T10:56:31.206123+0000","last_in_change":"2026-02-17T10:56:22.332426+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T10:56:35.906512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3a8607d-2fc0-42fa-8964-003c712fec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6804","nonce":1572439835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6808","nonce":1572439835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6814","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6816","nonce":1572439835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":1572439835},{"type":"v1","addr":"10.20.193.196:6812","nonce":1572439835}]},"public_addr":"10.20.193.196:6804/1572439835","cluster_addr":"10.20.193.196:6808/1572439835","heartbeat_back_addr":"10.20.193.196:6816/1572439835","heartbeat_front_addr":"10.20.193.196:6812/1572439835","state":["exists","up"]},{"osd":1,"uuid":"b0942728-26e3-4493-99f1-621bb3dfbdcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6803","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6805","nonce":4190182765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6807","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6809","nonce":4190182765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6815","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6817","nonce":4190182765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6811","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6813","nonce":4190182765}]},"public_addr":"10.20.193.196:6805/4190182765","cluster_addr":"10.20.193.196:6809/4190182765","heartbeat_back_addr":"10.20.193.196:6817/4190182765","heartbeat_front_addr":"10.20.193.196:6813/4190182765","state":["exists","up"]},{"osd":2,"uuid":"26c3f205-be95-44ed-9981-c15935c8bb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6818","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6819","nonce":1169028315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6820","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6821","nonce":1169028315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6824","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6825","nonce":1169028315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6822","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6823","nonce":1169028315}]},"public_addr":"10.20.193.196:6819/1169028315","cluster_addr":"10.20.193.196:6821/1169028315","heartbeat_back_addr":"10.20.193.196:6825/1169028315","heartbeat_front_addr":"10.20.193.196:6823/1169028315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:56:40.335 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T10:56:40.336 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T10:56:40.336 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T10:56:40.418 INFO:teuthology.orchestra.run.trial196.stdout:38654705668 2026-02-17T10:56:40.419 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T10:56:40.422 INFO:teuthology.orchestra.run.trial196.stdout:34359738371 2026-02-17T10:56:40.422 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T10:56:40.611 INFO:teuthology.orchestra.run.trial196.stdout:34359738370 2026-02-17T10:56:40.615 INFO:teuthology.orchestra.run.trial196.stdout:38654705667 2026-02-17T10:56:40.623 INFO:teuthology.orchestra.run.trial196.stdout:38654705668 2026-02-17T10:56:40.623 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T10:56:40.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.1 2026-02-17T10:56:40.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2026-02-17T10:56:40.774 INFO:teuthology.orchestra.run.trial196.stdout:38654705667 2026-02-17T10:56:40.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2026-02-17T10:56:41.624 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T10:56:41.626 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T10:56:41.782 INFO:teuthology.orchestra.run.trial196.stdout:34359738370 2026-02-17T10:56:41.786 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T10:56:41.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.1 2026-02-17T10:56:41.815 INFO:teuthology.orchestra.run.trial196.stdout:38654705668 2026-02-17T10:56:41.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2026-02-17T10:56:41.825 DEBUG:teuthology.parallel:result is None 2026-02-17T10:56:41.937 INFO:teuthology.orchestra.run.trial196.stdout:38654705668 2026-02-17T10:56:41.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2026-02-17T10:56:41.948 DEBUG:teuthology.parallel:result is None 2026-02-17T10:56:42.794 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T10:56:42.942 INFO:teuthology.orchestra.run.trial196.stdout:34359738372 2026-02-17T10:56:42.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738372 for osd.1 2026-02-17T10:56:42.955 DEBUG:teuthology.parallel:result is None 2026-02-17T10:56:42.955 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T10:56:42.955 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:56:43.108 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:43.109 INFO:teuthology.orchestra.run.trial196.stderr:dumped all 2026-02-17T10:56:43.119 INFO:teuthology.orchestra.run.trial196.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-17T10:56:41.774164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89552,"kb_used_data":328,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025968,"statfs":{"total":289910292480,"available":289818591232,"internally_reserved":0,"allocated":335872,"data_stored":82270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.810019+0000","last_change":"2026-02-17T10:56:39.810019+0000","last_active":"2026-02-17T10:56:39.810019+0000","last_peered":"2026-02-17T10:56:39.810019+0000","last_clean":"2026-02-17T10:56:39.810019+0000","last_became_active":"2026-02-17T10:56:37.804237+0000","last_became_peered":"2026-02-17T10:56:37.804237+0000","last_unstale":"2026-02-17T10:56:39.810019+0000","last_undegraded":"2026-02-17T10:56:39.810019+0000","last_fullsized":"2026-02-17T10:56:39.810019+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:10:34.046138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065000400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809683+0000","last_change":"2026-02-17T10:56:39.809683+0000","last_active":"2026-02-17T10:56:39.809683+0000","last_peered":"2026-02-17T10:56:39.809683+0000","last_clean":"2026-02-17T10:56:39.809683+0000","last_became_active":"2026-02-17T10:56:37.804150+0000","last_became_peered":"2026-02-17T10:56:37.804150+0000","last_unstale":"2026-02-17T10:56:39.809683+0000","last_undegraded":"2026-02-17T10:56:39.809683+0000","last_fullsized":"2026-02-17T10:56:39.809683+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:59:22.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035673500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809517+0000","last_change":"2026-02-17T10:56:39.809517+0000","last_active":"2026-02-17T10:56:39.809517+0000","last_peered":"2026-02-17T10:56:39.809517+0000","last_clean":"2026-02-17T10:56:39.809517+0000","last_became_active":"2026-02-17T10:56:37.803832+0000","last_became_peered":"2026-02-17T10:56:37.803832+0000","last_unstale":"2026-02-17T10:56:39.809517+0000","last_undegraded":"2026-02-17T10:56:39.809517+0000","last_fullsized":"2026-02-17T10:56:39.809517+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:01:45.673319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000345986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809849+0000","last_change":"2026-02-17T10:56:39.809849+0000","last_active":"2026-02-17T10:56:39.809849+0000","last_peered":"2026-02-17T10:56:39.809849+0000","last_clean":"2026-02-17T10:56:39.809849+0000","last_became_active":"2026-02-17T10:56:37.804108+0000","last_became_peered":"2026-02-17T10:56:37.804108+0000","last_unstale":"2026-02-17T10:56:39.809849+0000","last_undegraded":"2026-02-17T10:56:39.809849+0000","last_fullsized":"2026-02-17T10:56:39.809849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:21:29.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050042900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809816+0000","last_change":"2026-02-17T10:56:39.809816+0000","last_active":"2026-02-17T10:56:39.809816+0000","last_peered":"2026-02-17T10:56:39.809816+0000","last_clean":"2026-02-17T10:56:39.809816+0000","last_became_active":"2026-02-17T10:56:37.804636+0000","last_became_peered":"2026-02-17T10:56:37.804636+0000","last_unstale":"2026-02-17T10:56:39.809816+0000","last_undegraded":"2026-02-17T10:56:39.809816+0000","last_fullsized":"2026-02-17T10:56:39.809816+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:37:53.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047219699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.810950+0000","last_change":"2026-02-17T10:56:39.809788+0000","last_active":"2026-02-17T10:56:39.810950+0000","last_peered":"2026-02-17T10:56:39.810950+0000","last_clean":"2026-02-17T10:56:39.810950+0000","last_became_active":"2026-02-17T10:56:37.804156+0000","last_became_peered":"2026-02-17T10:56:37.804156+0000","last_unstale":"2026-02-17T10:56:39.810950+0000","last_undegraded":"2026-02-17T10:56:39.810950+0000","last_fullsized":"2026-02-17T10:56:39.810950+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:59:10.492175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031870599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809518+0000","last_change":"2026-02-17T10:56:39.809518+0000","last_active":"2026-02-17T10:56:39.809518+0000","last_peered":"2026-02-17T10:56:39.809518+0000","last_clean":"2026-02-17T10:56:39.809518+0000","last_became_active":"2026-02-17T10:56:37.803785+0000","last_became_peered":"2026-02-17T10:56:37.803785+0000","last_unstale":"2026-02-17T10:56:39.809518+0000","last_undegraded":"2026-02-17T10:56:39.809518+0000","last_fullsized":"2026-02-17T10:56:39.809518+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:15:00.104753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035504200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809622+0000","last_change":"2026-02-17T10:56:39.809622+0000","last_active":"2026-02-17T10:56:39.809622+0000","last_peered":"2026-02-17T10:56:39.809622+0000","last_clean":"2026-02-17T10:56:39.809622+0000","last_became_active":"2026-02-17T10:56:37.804121+0000","last_became_peered":"2026-02-17T10:56:37.804121+0000","last_unstale":"2026-02-17T10:56:39.809622+0000","last_undegraded":"2026-02-17T10:56:39.809622+0000","last_fullsized":"2026-02-17T10:56:39.809622+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:32:48.638966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030872700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31236,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340604,"statfs":{"total":96636764160,"available":96604778496,"internally_reserved":0,"allocated":114688,"data_stored":29534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31236,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340604,"statfs":{"total":96636764160,"available":96604778496,"internally_reserved":0,"allocated":110592,"data_stored":26368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":110592,"data_stored":26368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:56:43.120 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:56:43.270 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:43.270 INFO:teuthology.orchestra.run.trial196.stderr:dumped all 2026-02-17T10:56:43.279 INFO:teuthology.orchestra.run.trial196.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-17T10:56:41.774164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":89552,"kb_used_data":328,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283025968,"statfs":{"total":289910292480,"available":289818591232,"internally_reserved":0,"allocated":335872,"data_stored":82270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.810019+0000","last_change":"2026-02-17T10:56:39.810019+0000","last_active":"2026-02-17T10:56:39.810019+0000","last_peered":"2026-02-17T10:56:39.810019+0000","last_clean":"2026-02-17T10:56:39.810019+0000","last_became_active":"2026-02-17T10:56:37.804237+0000","last_became_peered":"2026-02-17T10:56:37.804237+0000","last_unstale":"2026-02-17T10:56:39.810019+0000","last_undegraded":"2026-02-17T10:56:39.810019+0000","last_fullsized":"2026-02-17T10:56:39.810019+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:10:34.046138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065000400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809683+0000","last_change":"2026-02-17T10:56:39.809683+0000","last_active":"2026-02-17T10:56:39.809683+0000","last_peered":"2026-02-17T10:56:39.809683+0000","last_clean":"2026-02-17T10:56:39.809683+0000","last_became_active":"2026-02-17T10:56:37.804150+0000","last_became_peered":"2026-02-17T10:56:37.804150+0000","last_unstale":"2026-02-17T10:56:39.809683+0000","last_undegraded":"2026-02-17T10:56:39.809683+0000","last_fullsized":"2026-02-17T10:56:39.809683+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:59:22.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035673500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809517+0000","last_change":"2026-02-17T10:56:39.809517+0000","last_active":"2026-02-17T10:56:39.809517+0000","last_peered":"2026-02-17T10:56:39.809517+0000","last_clean":"2026-02-17T10:56:39.809517+0000","last_became_active":"2026-02-17T10:56:37.803832+0000","last_became_peered":"2026-02-17T10:56:37.803832+0000","last_unstale":"2026-02-17T10:56:39.809517+0000","last_undegraded":"2026-02-17T10:56:39.809517+0000","last_fullsized":"2026-02-17T10:56:39.809517+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:01:45.673319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000345986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809849+0000","last_change":"2026-02-17T10:56:39.809849+0000","last_active":"2026-02-17T10:56:39.809849+0000","last_peered":"2026-02-17T10:56:39.809849+0000","last_clean":"2026-02-17T10:56:39.809849+0000","last_became_active":"2026-02-17T10:56:37.804108+0000","last_became_peered":"2026-02-17T10:56:37.804108+0000","last_unstale":"2026-02-17T10:56:39.809849+0000","last_undegraded":"2026-02-17T10:56:39.809849+0000","last_fullsized":"2026-02-17T10:56:39.809849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:21:29.803689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050042900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"11'1","reported_seq":20,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809816+0000","last_change":"2026-02-17T10:56:39.809816+0000","last_active":"2026-02-17T10:56:39.809816+0000","last_peered":"2026-02-17T10:56:39.809816+0000","last_clean":"2026-02-17T10:56:39.809816+0000","last_became_active":"2026-02-17T10:56:37.804636+0000","last_became_peered":"2026-02-17T10:56:37.804636+0000","last_unstale":"2026-02-17T10:56:39.809816+0000","last_undegraded":"2026-02-17T10:56:39.809816+0000","last_fullsized":"2026-02-17T10:56:39.809816+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:37:53.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047219699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.810950+0000","last_change":"2026-02-17T10:56:39.809788+0000","last_active":"2026-02-17T10:56:39.810950+0000","last_peered":"2026-02-17T10:56:39.810950+0000","last_clean":"2026-02-17T10:56:39.810950+0000","last_became_active":"2026-02-17T10:56:37.804156+0000","last_became_peered":"2026-02-17T10:56:37.804156+0000","last_unstale":"2026-02-17T10:56:39.810950+0000","last_undegraded":"2026-02-17T10:56:39.810950+0000","last_fullsized":"2026-02-17T10:56:39.810950+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:59:10.492175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031870599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809518+0000","last_change":"2026-02-17T10:56:39.809518+0000","last_active":"2026-02-17T10:56:39.809518+0000","last_peered":"2026-02-17T10:56:39.809518+0000","last_clean":"2026-02-17T10:56:39.809518+0000","last_became_active":"2026-02-17T10:56:37.803785+0000","last_became_peered":"2026-02-17T10:56:37.803785+0000","last_unstale":"2026-02-17T10:56:39.809518+0000","last_undegraded":"2026-02-17T10:56:39.809518+0000","last_fullsized":"2026-02-17T10:56:39.809518+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:15:00.104753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035504200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T10:56:39.809622+0000","last_change":"2026-02-17T10:56:39.809622+0000","last_active":"2026-02-17T10:56:39.809622+0000","last_peered":"2026-02-17T10:56:39.809622+0000","last_clean":"2026-02-17T10:56:39.809622+0000","last_became_active":"2026-02-17T10:56:37.804121+0000","last_became_peered":"2026-02-17T10:56:37.804121+0000","last_unstale":"2026-02-17T10:56:39.809622+0000","last_undegraded":"2026-02-17T10:56:39.809622+0000","last_fullsized":"2026-02-17T10:56:39.809622+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:32:48.638966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030872700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31236,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340604,"statfs":{"total":96636764160,"available":96604778496,"internally_reserved":0,"allocated":114688,"data_stored":29534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31236,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340604,"statfs":{"total":96636764160,"available":96604778496,"internally_reserved":0,"allocated":110592,"data_stored":26368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27080,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":110592,"data_stored":26368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:56:43.280 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T10:56:43.280 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T10:56:43.280 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T10:56:43.281 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T10:56:43.442 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:56:43.442 INFO:teuthology.orchestra.run.trial196.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T10:56:43.451 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T10:56:43.452 INFO:teuthology.run_tasks:Running task watch_notify_same_primary... 2026-02-17T10:56:43.468 INFO:tasks.watch_notify_same_primary:Beginning watch_notify_same_primary... 2026-02-17T10:56:43.468 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noout 2026-02-17T10:56:43.820 INFO:teuthology.orchestra.run.trial196.stderr:noout is set 2026-02-17T10:56:43.833 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-17T10:56:43.833 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-17T10:56:44.823 INFO:teuthology.orchestra.run.trial196.stderr:pool 'unique_pool_0' created 2026-02-17T10:56:44.835 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-17T10:56:45.825 INFO:teuthology.orchestra.run.trial196.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T10:56:46.840 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-0 /etc/resolv.conf 2026-02-17T10:56:46.867 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-0 2026-02-17T10:56:46.910 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-1 /etc/resolv.conf 2026-02-17T10:56:46.929 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:46.933 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-1 2026-02-17T10:56:46.979 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-2 /etc/resolv.conf 2026-02-17T10:56:46.996 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.003 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-2 2026-02-17T10:56:47.050 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-3 /etc/resolv.conf 2026-02-17T10:56:47.069 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.073 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-3 2026-02-17T10:56:47.119 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-4 /etc/resolv.conf 2026-02-17T10:56:47.138 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.144 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-4 2026-02-17T10:56:47.186 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-5 /etc/resolv.conf 2026-02-17T10:56:47.204 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.209 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-5 2026-02-17T10:56:47.251 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-6 /etc/resolv.conf 2026-02-17T10:56:47.269 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.274 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-6 2026-02-17T10:56:47.319 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-7 /etc/resolv.conf 2026-02-17T10:56:47.336 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.342 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-7 2026-02-17T10:56:47.387 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-8 /etc/resolv.conf 2026-02-17T10:56:47.405 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.410 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-8 2026-02-17T10:56:47.455 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-9 /etc/resolv.conf 2026-02-17T10:56:47.473 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.478 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-9 2026-02-17T10:56:47.523 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-10 /etc/resolv.conf 2026-02-17T10:56:47.542 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.546 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-10 2026-02-17T10:56:47.596 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-11 /etc/resolv.conf 2026-02-17T10:56:47.613 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.620 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-11 2026-02-17T10:56:47.663 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-12 /etc/resolv.conf 2026-02-17T10:56:47.680 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.686 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-12 2026-02-17T10:56:47.731 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-13 /etc/resolv.conf 2026-02-17T10:56:47.748 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.755 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-13 2026-02-17T10:56:47.799 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-14 /etc/resolv.conf 2026-02-17T10:56:47.817 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.824 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-14 2026-02-17T10:56:47.867 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-15 /etc/resolv.conf 2026-02-17T10:56:47.885 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.891 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-15 2026-02-17T10:56:47.935 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-16 /etc/resolv.conf 2026-02-17T10:56:47.953 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:47.958 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-16 2026-02-17T10:56:48.003 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-17 /etc/resolv.conf 2026-02-17T10:56:48.020 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:48.027 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-17 2026-02-17T10:56:48.071 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-18 /etc/resolv.conf 2026-02-17T10:56:48.089 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:48.096 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-18 2026-02-17T10:56:48.139 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 put foo-19 /etc/resolv.conf 2026-02-17T10:56:48.157 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:48.162 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 watch foo-19 2026-02-17T10:56:48.206 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-0 2026-02-17T10:56:48.224 INFO:teuthology.orchestra.run.trial196.stdout:press enter to exit... 2026-02-17T10:56:48.226 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/1287114873 client.4315 cookie=94109053050112 2026-02-17T10:56:48.228 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-0 2026-02-17T10:56:48.228 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-1 2026-02-17T10:56:48.288 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/2520765996 client.4410 cookie=94785969562448 2026-02-17T10:56:48.290 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-1 2026-02-17T10:56:48.290 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-2 2026-02-17T10:56:48.356 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/515307088 client.4340 cookie=94674012496032 2026-02-17T10:56:48.359 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-2 2026-02-17T10:56:48.359 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-3 2026-02-17T10:56:48.421 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/3323314254 client.4352 cookie=94306214220256 2026-02-17T10:56:48.423 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-3 2026-02-17T10:56:48.423 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-4 2026-02-17T10:56:48.485 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/1963927305 client.4367 cookie=94507282063232 2026-02-17T10:56:48.487 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-4 2026-02-17T10:56:48.487 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-5 2026-02-17T10:56:48.549 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/1713268235 client.4497 cookie=93826979960448 2026-02-17T10:56:48.551 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-5 2026-02-17T10:56:48.551 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-6 2026-02-17T10:56:48.613 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/4110549280 client.4403 cookie=94057034706816 2026-02-17T10:56:48.616 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-6 2026-02-17T10:56:48.616 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-7 2026-02-17T10:56:48.677 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/497523936 client.4539 cookie=94889572500480 2026-02-17T10:56:48.680 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-7 2026-02-17T10:56:48.680 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-8 2026-02-17T10:56:48.741 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/2984531062 client.4439 cookie=93862614713808 2026-02-17T10:56:48.743 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-8 2026-02-17T10:56:48.743 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-9 2026-02-17T10:56:48.805 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/3370635565 client.4581 cookie=94096086065344 2026-02-17T10:56:48.806 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-9 2026-02-17T10:56:48.807 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-10 2026-02-17T10:56:48.869 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/3069327685 client.4472 cookie=93982069948336 2026-02-17T10:56:48.871 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-10 2026-02-17T10:56:48.871 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-11 2026-02-17T10:56:48.933 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/2748726729 client.4614 cookie=94356298137824 2026-02-17T10:56:48.936 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-11 2026-02-17T10:56:48.936 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-12 2026-02-17T10:56:48.997 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/1570922073 client.4507 cookie=94546354557168 2026-02-17T10:56:48.999 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-12 2026-02-17T10:56:48.999 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-13 2026-02-17T10:56:49.061 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/2308402978 client.4525 cookie=94524561845504 2026-02-17T10:56:49.063 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-13 2026-02-17T10:56:49.063 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-14 2026-02-17T10:56:49.125 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/1528351174 client.4544 cookie=93828889732656 2026-02-17T10:56:49.127 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-14 2026-02-17T10:56:49.127 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-15 2026-02-17T10:56:49.194 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/2810753124 client.4555 cookie=93914368706944 2026-02-17T10:56:49.196 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-15 2026-02-17T10:56:49.196 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-16 2026-02-17T10:56:49.257 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/3201877075 client.4719 cookie=93867663557936 2026-02-17T10:56:49.259 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-16 2026-02-17T10:56:49.260 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-17 2026-02-17T10:56:49.326 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/3514415431 client.4589 cookie=94736761590432 2026-02-17T10:56:49.328 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-17 2026-02-17T10:56:49.328 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-18 2026-02-17T10:56:49.389 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/3549342253 client.4764 cookie=94652583591808 2026-02-17T10:56:49.392 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-18 2026-02-17T10:56:49.392 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 listwatchers foo-19 2026-02-17T10:56:49.452 INFO:teuthology.orchestra.run.trial196.stdout:watcher=10.20.193.196:0/1483522882 client.4788 cookie=94583968991600 2026-02-17T10:56:49.455 INFO:tasks.watch_notify_same_primary:i see 1 watchers for foo-19 2026-02-17T10:56:49.455 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-0 notify1 2026-02-17T10:56:49.518 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94109053050112 notify_id 77309411328 from 4798 2026-02-17T10:56:49.518 INFO:tasks.watch_notify_same_primary.notify.0.trial196.stdout:reply client.4315 cookie 94109053050112 : 11 bytes 2026-02-17T10:56:49.519 INFO:tasks.watch_notify_same_primary.notify.0.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.519 INFO:tasks.watch_notify_same_primary.notify.0.trial196.stdout:0000000b 2026-02-17T10:56:49.521 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-1 notify1 2026-02-17T10:56:49.582 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94785969562448 notify_id 77309411328 from 4807 2026-02-17T10:56:49.582 INFO:tasks.watch_notify_same_primary.notify.1.trial196.stdout:reply client.4410 cookie 94785969562448 : 11 bytes 2026-02-17T10:56:49.583 INFO:tasks.watch_notify_same_primary.notify.1.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.583 INFO:tasks.watch_notify_same_primary.notify.1.trial196.stdout:0000000b 2026-02-17T10:56:49.585 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-2 notify1 2026-02-17T10:56:49.645 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94674012496032 notify_id 77309411329 from 4816 2026-02-17T10:56:49.645 INFO:tasks.watch_notify_same_primary.notify.2.trial196.stdout:reply client.4340 cookie 94674012496032 : 11 bytes 2026-02-17T10:56:49.646 INFO:tasks.watch_notify_same_primary.notify.2.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.646 INFO:tasks.watch_notify_same_primary.notify.2.trial196.stdout:0000000b 2026-02-17T10:56:49.648 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-3 notify1 2026-02-17T10:56:49.713 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94306214220256 notify_id 77309411329 from 4820 2026-02-17T10:56:49.713 INFO:tasks.watch_notify_same_primary.notify.3.trial196.stdout:reply client.4352 cookie 94306214220256 : 11 bytes 2026-02-17T10:56:49.714 INFO:tasks.watch_notify_same_primary.notify.3.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.714 INFO:tasks.watch_notify_same_primary.notify.3.trial196.stdout:0000000b 2026-02-17T10:56:49.715 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-4 notify1 2026-02-17T10:56:49.777 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94507282063232 notify_id 77309411330 from 5034 2026-02-17T10:56:49.778 INFO:tasks.watch_notify_same_primary.notify.4.trial196.stdout:reply client.4367 cookie 94507282063232 : 11 bytes 2026-02-17T10:56:49.778 INFO:tasks.watch_notify_same_primary.notify.4.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.778 INFO:tasks.watch_notify_same_primary.notify.4.trial196.stdout:0000000b 2026-02-17T10:56:49.779 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-5 notify1 2026-02-17T10:56:49.845 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93826979960448 notify_id 77309411330 from 4843 2026-02-17T10:56:49.845 INFO:tasks.watch_notify_same_primary.notify.5.trial196.stdout:reply client.4497 cookie 93826979960448 : 11 bytes 2026-02-17T10:56:49.846 INFO:tasks.watch_notify_same_primary.notify.5.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.846 INFO:tasks.watch_notify_same_primary.notify.5.trial196.stdout:0000000b 2026-02-17T10:56:49.847 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-6 notify1 2026-02-17T10:56:49.909 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94057034706816 notify_id 77309411331 from 5055 2026-02-17T10:56:49.909 INFO:tasks.watch_notify_same_primary.notify.6.trial196.stdout:reply client.4403 cookie 94057034706816 : 11 bytes 2026-02-17T10:56:49.910 INFO:tasks.watch_notify_same_primary.notify.6.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.910 INFO:tasks.watch_notify_same_primary.notify.6.trial196.stdout:0000000b 2026-02-17T10:56:49.911 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-7 notify1 2026-02-17T10:56:49.975 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94889572500480 notify_id 77309411332 from 5067 2026-02-17T10:56:49.975 INFO:tasks.watch_notify_same_primary.notify.7.trial196.stdout:reply client.4539 cookie 94889572500480 : 11 bytes 2026-02-17T10:56:49.976 INFO:tasks.watch_notify_same_primary.notify.7.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:49.976 INFO:tasks.watch_notify_same_primary.notify.7.trial196.stdout:0000000b 2026-02-17T10:56:49.977 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-8 notify1 2026-02-17T10:56:50.041 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93862614713808 notify_id 77309411328 from 4865 2026-02-17T10:56:50.041 INFO:tasks.watch_notify_same_primary.notify.8.trial196.stdout:reply client.4439 cookie 93862614713808 : 11 bytes 2026-02-17T10:56:50.042 INFO:tasks.watch_notify_same_primary.notify.8.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.042 INFO:tasks.watch_notify_same_primary.notify.8.trial196.stdout:0000000b 2026-02-17T10:56:50.044 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-9 notify1 2026-02-17T10:56:50.104 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94096086065344 notify_id 77309411329 from 4870 2026-02-17T10:56:50.104 INFO:tasks.watch_notify_same_primary.notify.9.trial196.stdout:reply client.4581 cookie 94096086065344 : 11 bytes 2026-02-17T10:56:50.105 INFO:tasks.watch_notify_same_primary.notify.9.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.105 INFO:tasks.watch_notify_same_primary.notify.9.trial196.stdout:0000000b 2026-02-17T10:56:50.106 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-10 notify1 2026-02-17T10:56:50.170 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93982069948336 notify_id 77309411331 from 5103 2026-02-17T10:56:50.171 INFO:tasks.watch_notify_same_primary.notify.10.trial196.stdout:reply client.4472 cookie 93982069948336 : 11 bytes 2026-02-17T10:56:50.171 INFO:tasks.watch_notify_same_primary.notify.10.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.172 INFO:tasks.watch_notify_same_primary.notify.10.trial196.stdout:0000000b 2026-02-17T10:56:50.173 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-11 notify1 2026-02-17T10:56:50.234 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94356298137824 notify_id 77309411332 from 5112 2026-02-17T10:56:50.234 INFO:tasks.watch_notify_same_primary.notify.11.trial196.stdout:reply client.4614 cookie 94356298137824 : 11 bytes 2026-02-17T10:56:50.235 INFO:tasks.watch_notify_same_primary.notify.11.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.235 INFO:tasks.watch_notify_same_primary.notify.11.trial196.stdout:0000000b 2026-02-17T10:56:50.237 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-12 notify1 2026-02-17T10:56:50.298 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94546354557168 notify_id 77309411333 from 5124 2026-02-17T10:56:50.298 INFO:tasks.watch_notify_same_primary.notify.12.trial196.stdout:reply client.4507 cookie 94546354557168 : 11 bytes 2026-02-17T10:56:50.299 INFO:tasks.watch_notify_same_primary.notify.12.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.299 INFO:tasks.watch_notify_same_primary.notify.12.trial196.stdout:0000000b 2026-02-17T10:56:50.301 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-13 notify1 2026-02-17T10:56:50.365 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94524561845504 notify_id 77309411333 from 4903 2026-02-17T10:56:50.366 INFO:tasks.watch_notify_same_primary.notify.13.trial196.stdout:reply client.4525 cookie 94524561845504 : 11 bytes 2026-02-17T10:56:50.367 INFO:tasks.watch_notify_same_primary.notify.13.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.367 INFO:tasks.watch_notify_same_primary.notify.13.trial196.stdout:0000000b 2026-02-17T10:56:50.368 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-14 notify1 2026-02-17T10:56:50.630 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93828889732656 notify_id 77309411330 from 4913 2026-02-17T10:56:50.631 INFO:tasks.watch_notify_same_primary.notify.14.trial196.stdout:reply client.4544 cookie 93828889732656 : 11 bytes 2026-02-17T10:56:50.632 INFO:tasks.watch_notify_same_primary.notify.14.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.632 INFO:tasks.watch_notify_same_primary.notify.14.trial196.stdout:0000000b 2026-02-17T10:56:50.633 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-15 notify1 2026-02-17T10:56:50.654 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93914368706944 notify_id 77309411334 from 4918 2026-02-17T10:56:50.654 INFO:tasks.watch_notify_same_primary.notify.15.trial196.stdout:reply client.4555 cookie 93914368706944 : 11 bytes 2026-02-17T10:56:50.656 INFO:tasks.watch_notify_same_primary.notify.15.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.656 INFO:tasks.watch_notify_same_primary.notify.15.trial196.stdout:0000000b 2026-02-17T10:56:50.657 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-16 notify1 2026-02-17T10:56:50.716 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93867663557936 notify_id 77309411335 from 4927 2026-02-17T10:56:50.717 INFO:tasks.watch_notify_same_primary.notify.16.trial196.stdout:reply client.4719 cookie 93867663557936 : 11 bytes 2026-02-17T10:56:50.718 INFO:tasks.watch_notify_same_primary.notify.16.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.718 INFO:tasks.watch_notify_same_primary.notify.16.trial196.stdout:0000000b 2026-02-17T10:56:50.720 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-17 notify1 2026-02-17T10:56:50.786 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94736761590432 notify_id 77309411336 from 4937 2026-02-17T10:56:50.786 INFO:tasks.watch_notify_same_primary.notify.17.trial196.stdout:reply client.4589 cookie 94736761590432 : 11 bytes 2026-02-17T10:56:50.787 INFO:tasks.watch_notify_same_primary.notify.17.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.787 INFO:tasks.watch_notify_same_primary.notify.17.trial196.stdout:0000000b 2026-02-17T10:56:50.788 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-18 notify1 2026-02-17T10:56:50.848 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94652583591808 notify_id 77309411331 from 4946 2026-02-17T10:56:50.848 INFO:tasks.watch_notify_same_primary.notify.18.trial196.stdout:reply client.4764 cookie 94652583591808 : 11 bytes 2026-02-17T10:56:50.849 INFO:tasks.watch_notify_same_primary.notify.18.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.849 INFO:tasks.watch_notify_same_primary.notify.18.trial196.stdout:0000000b 2026-02-17T10:56:50.851 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-19 notify1 2026-02-17T10:56:50.913 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94583968991600 notify_id 77309411337 from 4955 2026-02-17T10:56:50.913 INFO:tasks.watch_notify_same_primary.notify.19.trial196.stdout:reply client.4788 cookie 94583968991600 : 11 bytes 2026-02-17T10:56:50.914 INFO:tasks.watch_notify_same_primary.notify.19.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:50.914 INFO:tasks.watch_notify_same_primary.notify.19.trial196.stdout:0000000b 2026-02-17T10:56:50.916 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T10:56:50.916 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:56:51.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-17T10:56:57.017 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T10:56:57.017 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2026-02-17T10:56:57.174 INFO:tasks.ceph.mon.a.trial196.stderr:2026-02-17T10:56:57.169+0000 7f58e1296640 -1 mon.a@0(leader).osd e20 definitely_dead 0 2026-02-17T10:56:57.175 INFO:teuthology.orchestra.run.trial196.stderr:osd.0 is already down. 2026-02-17T10:56:57.185 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-0 notify2 2026-02-17T10:56:57.207 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.207 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.207 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94109053050112 notify_id 85899345926 from 4964 2026-02-17T10:56:57.207 INFO:tasks.watch_notify_same_primary.notify.0.trial196.stdout:reply client.4315 cookie 94109053050112 : 11 bytes 2026-02-17T10:56:57.208 INFO:tasks.watch_notify_same_primary.notify.0.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.208 INFO:tasks.watch_notify_same_primary.notify.0.trial196.stdout:0000000b 2026-02-17T10:56:57.209 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-1 notify2 2026-02-17T10:56:57.274 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.274 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.274 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94785969562448 notify_id 85899345930 from 4973 2026-02-17T10:56:57.274 INFO:tasks.watch_notify_same_primary.notify.1.trial196.stdout:reply client.4410 cookie 94785969562448 : 11 bytes 2026-02-17T10:56:57.275 INFO:tasks.watch_notify_same_primary.notify.1.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.275 INFO:tasks.watch_notify_same_primary.notify.1.trial196.stdout:0000000b 2026-02-17T10:56:57.276 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-2 notify2 2026-02-17T10:56:57.339 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.339 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.339 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94674012496032 notify_id 85899345927 from 4978 2026-02-17T10:56:57.340 INFO:tasks.watch_notify_same_primary.notify.2.trial196.stdout:reply client.4340 cookie 94674012496032 : 11 bytes 2026-02-17T10:56:57.340 INFO:tasks.watch_notify_same_primary.notify.2.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.340 INFO:tasks.watch_notify_same_primary.notify.2.trial196.stdout:0000000b 2026-02-17T10:56:57.342 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-3 notify2 2026-02-17T10:56:57.410 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.410 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.410 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94306214220256 notify_id 85899345931 from 4987 2026-02-17T10:56:57.411 INFO:tasks.watch_notify_same_primary.notify.3.trial196.stdout:reply client.4352 cookie 94306214220256 : 11 bytes 2026-02-17T10:56:57.411 INFO:tasks.watch_notify_same_primary.notify.3.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.411 INFO:tasks.watch_notify_same_primary.notify.3.trial196.stdout:0000000b 2026-02-17T10:56:57.413 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-4 notify2 2026-02-17T10:56:57.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2026-02-17T10:56:57.473 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.473 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.473 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94507282063232 notify_id 85899345928 from 5268 2026-02-17T10:56:57.474 INFO:tasks.watch_notify_same_primary.notify.4.trial196.stdout:reply client.4367 cookie 94507282063232 : 11 bytes 2026-02-17T10:56:57.474 INFO:tasks.watch_notify_same_primary.notify.4.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.474 INFO:tasks.watch_notify_same_primary.notify.4.trial196.stdout:0000000b 2026-02-17T10:56:57.475 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-5 notify2 2026-02-17T10:56:57.537 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.538 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.538 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93826979960448 notify_id 85899345932 from 5280 2026-02-17T10:56:57.538 INFO:tasks.watch_notify_same_primary.notify.5.trial196.stdout:reply client.4497 cookie 93826979960448 : 11 bytes 2026-02-17T10:56:57.538 INFO:tasks.watch_notify_same_primary.notify.5.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.539 INFO:tasks.watch_notify_same_primary.notify.5.trial196.stdout:0000000b 2026-02-17T10:56:57.540 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-6 notify2 2026-02-17T10:56:57.601 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.601 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.601 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94057034706816 notify_id 85899345929 from 5292 2026-02-17T10:56:57.602 INFO:tasks.watch_notify_same_primary.notify.6.trial196.stdout:reply client.4403 cookie 94057034706816 : 11 bytes 2026-02-17T10:56:57.602 INFO:tasks.watch_notify_same_primary.notify.6.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.602 INFO:tasks.watch_notify_same_primary.notify.6.trial196.stdout:0000000b 2026-02-17T10:56:57.604 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-7 notify2 2026-02-17T10:56:57.665 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.665 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.665 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94889572500480 notify_id 85899345930 from 5018 2026-02-17T10:56:57.666 INFO:tasks.watch_notify_same_primary.notify.7.trial196.stdout:reply client.4539 cookie 94889572500480 : 11 bytes 2026-02-17T10:56:57.666 INFO:tasks.watch_notify_same_primary.notify.7.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.666 INFO:tasks.watch_notify_same_primary.notify.7.trial196.stdout:0000000b 2026-02-17T10:56:57.668 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-8 notify2 2026-02-17T10:56:57.731 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.731 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.732 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93862614713808 notify_id 85899345933 from 5313 2026-02-17T10:56:57.732 INFO:tasks.watch_notify_same_primary.notify.8.trial196.stdout:reply client.4439 cookie 93862614713808 : 11 bytes 2026-02-17T10:56:57.733 INFO:tasks.watch_notify_same_primary.notify.8.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.733 INFO:tasks.watch_notify_same_primary.notify.8.trial196.stdout:0000000b 2026-02-17T10:56:57.735 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-9 notify2 2026-02-17T10:56:57.797 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.797 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.797 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94096086065344 notify_id 85899345934 from 5036 2026-02-17T10:56:57.797 INFO:tasks.watch_notify_same_primary.notify.9.trial196.stdout:reply client.4581 cookie 94096086065344 : 11 bytes 2026-02-17T10:56:57.798 INFO:tasks.watch_notify_same_primary.notify.9.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.798 INFO:tasks.watch_notify_same_primary.notify.9.trial196.stdout:0000000b 2026-02-17T10:56:57.800 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-10 notify2 2026-02-17T10:56:57.861 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.862 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.862 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93982069948336 notify_id 85899345935 from 5041 2026-02-17T10:56:57.862 INFO:tasks.watch_notify_same_primary.notify.10.trial196.stdout:reply client.4472 cookie 93982069948336 : 11 bytes 2026-02-17T10:56:57.863 INFO:tasks.watch_notify_same_primary.notify.10.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.863 INFO:tasks.watch_notify_same_primary.notify.10.trial196.stdout:0000000b 2026-02-17T10:56:57.864 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-11 notify2 2026-02-17T10:56:57.925 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.925 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.925 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94356298137824 notify_id 85899345936 from 5051 2026-02-17T10:56:57.926 INFO:tasks.watch_notify_same_primary.notify.11.trial196.stdout:reply client.4614 cookie 94356298137824 : 11 bytes 2026-02-17T10:56:57.926 INFO:tasks.watch_notify_same_primary.notify.11.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.926 INFO:tasks.watch_notify_same_primary.notify.11.trial196.stdout:0000000b 2026-02-17T10:56:57.928 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-12 notify2 2026-02-17T10:56:57.990 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:57.990 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:57.990 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94546354557168 notify_id 85899345937 from 5355 2026-02-17T10:56:57.990 INFO:tasks.watch_notify_same_primary.notify.12.trial196.stdout:reply client.4507 cookie 94546354557168 : 11 bytes 2026-02-17T10:56:57.991 INFO:tasks.watch_notify_same_primary.notify.12.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:57.991 INFO:tasks.watch_notify_same_primary.notify.12.trial196.stdout:0000000b 2026-02-17T10:56:57.992 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-13 notify2 2026-02-17T10:56:58.054 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:58.054 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.054 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94524561845504 notify_id 85899345931 from 5364 2026-02-17T10:56:58.055 INFO:tasks.watch_notify_same_primary.notify.13.trial196.stdout:reply client.4525 cookie 94524561845504 : 11 bytes 2026-02-17T10:56:58.055 INFO:tasks.watch_notify_same_primary.notify.13.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.055 INFO:tasks.watch_notify_same_primary.notify.13.trial196.stdout:0000000b 2026-02-17T10:56:58.057 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-14 notify2 2026-02-17T10:56:58.122 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:58.122 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.122 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93828889732656 notify_id 85899345932 from 5373 2026-02-17T10:56:58.122 INFO:tasks.watch_notify_same_primary.notify.14.trial196.stdout:reply client.4544 cookie 93828889732656 : 11 bytes 2026-02-17T10:56:58.123 INFO:tasks.watch_notify_same_primary.notify.14.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.123 INFO:tasks.watch_notify_same_primary.notify.14.trial196.stdout:0000000b 2026-02-17T10:56:58.124 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-15 notify2 2026-02-17T10:56:58.189 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:58.189 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.189 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93914368706944 notify_id 85899345938 from 5385 2026-02-17T10:56:58.190 INFO:tasks.watch_notify_same_primary.notify.15.trial196.stdout:reply client.4555 cookie 93914368706944 : 11 bytes 2026-02-17T10:56:58.190 INFO:tasks.watch_notify_same_primary.notify.15.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.190 INFO:tasks.watch_notify_same_primary.notify.15.trial196.stdout:0000000b 2026-02-17T10:56:58.192 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-16 notify2 2026-02-17T10:56:58.253 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:58.254 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.254 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 93867663557936 notify_id 85899345939 from 5089 2026-02-17T10:56:58.254 INFO:tasks.watch_notify_same_primary.notify.16.trial196.stdout:reply client.4719 cookie 93867663557936 : 11 bytes 2026-02-17T10:56:58.255 INFO:tasks.watch_notify_same_primary.notify.16.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.255 INFO:tasks.watch_notify_same_primary.notify.16.trial196.stdout:0000000b 2026-02-17T10:56:58.256 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-17 notify2 2026-02-17T10:56:58.317 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:58.317 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.318 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94736761590432 notify_id 85899345940 from 5406 2026-02-17T10:56:58.318 INFO:tasks.watch_notify_same_primary.notify.17.trial196.stdout:reply client.4589 cookie 94736761590432 : 11 bytes 2026-02-17T10:56:58.318 INFO:tasks.watch_notify_same_primary.notify.17.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.318 INFO:tasks.watch_notify_same_primary.notify.17.trial196.stdout:0000000b 2026-02-17T10:56:58.320 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-18 notify2 2026-02-17T10:56:58.382 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:58.382 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.382 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94652583591808 notify_id 85899345941 from 5104 2026-02-17T10:56:58.383 INFO:tasks.watch_notify_same_primary.notify.18.trial196.stdout:reply client.4764 cookie 94652583591808 : 11 bytes 2026-02-17T10:56:58.383 INFO:tasks.watch_notify_same_primary.notify.18.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.383 INFO:tasks.watch_notify_same_primary.notify.18.trial196.stdout:0000000b 2026-02-17T10:56:58.385 DEBUG:teuthology.orchestra.run.trial196:> rados -p unique_pool_0 notify foo-19 notify2 2026-02-17T10:56:58.445 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1| 2026-02-17T10:56:58.446 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.446 INFO:teuthology.orchestra.run.trial196.stdout:NOTIFY cookie 94583968991600 notify_id 85899345942 from 5123 2026-02-17T10:56:58.446 INFO:tasks.watch_notify_same_primary.notify.19.trial196.stdout:reply client.4788 cookie 94583968991600 : 11 bytes 2026-02-17T10:56:58.447 INFO:tasks.watch_notify_same_primary.notify.19.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.447 INFO:tasks.watch_notify_same_primary.notify.19.trial196.stdout:0000000b 2026-02-17T10:56:58.448 DEBUG:teuthology.run_tasks:Unwinding manager watch_notify_same_primary 2026-02-17T10:56:58.460 INFO:tasks.watch_notify_same_primary:joining watch_notify_stress 2026-02-17T10:56:58.494 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.494 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.494 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.495 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.495 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.495 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.496 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.496 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.496 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.496 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.497 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.497 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.497 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.498 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.498 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.498 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.498 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.499 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.499 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.499 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.499 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.500 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.500 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.500 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.500 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.501 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.501 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.501 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.501 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.502 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.502 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.502 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.502 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.503 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.503 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.503 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.503 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.503 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.504 INFO:teuthology.orchestra.run.trial196.stdout:00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2| 2026-02-17T10:56:58.504 INFO:teuthology.orchestra.run.trial196.stdout:0000000b 2026-02-17T10:56:58.511 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94109053050112 notify_id 77309411328 from 4798', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94109053050112 notify_id 85899345926 from 4964', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.511 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94785969562448 notify_id 77309411328 from 4807', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94785969562448 notify_id 85899345930 from 4973', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94674012496032 notify_id 77309411329 from 4816', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94674012496032 notify_id 85899345927 from 4978', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94306214220256 notify_id 77309411329 from 4820', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94306214220256 notify_id 85899345931 from 4987', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94507282063232 notify_id 77309411330 from 5034', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94507282063232 notify_id 85899345928 from 5268', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 93826979960448 notify_id 77309411330 from 4843', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 93826979960448 notify_id 85899345932 from 5280', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94057034706816 notify_id 77309411331 from 5055', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94057034706816 notify_id 85899345929 from 5292', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94889572500480 notify_id 77309411332 from 5067', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94889572500480 notify_id 85899345930 from 5018', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 93862614713808 notify_id 77309411328 from 4865', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 93862614713808 notify_id 85899345933 from 5313', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94096086065344 notify_id 77309411329 from 4870', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94096086065344 notify_id 85899345934 from 5036', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 93982069948336 notify_id 77309411331 from 5103', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 93982069948336 notify_id 85899345935 from 5041', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94356298137824 notify_id 77309411332 from 5112', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94356298137824 notify_id 85899345936 from 5051', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94546354557168 notify_id 77309411333 from 5124', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94546354557168 notify_id 85899345937 from 5355', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94524561845504 notify_id 77309411333 from 4903', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94524561845504 notify_id 85899345931 from 5364', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 93828889732656 notify_id 77309411330 from 4913', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 93828889732656 notify_id 85899345932 from 5373', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 93914368706944 notify_id 77309411334 from 4918', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 93914368706944 notify_id 85899345938 from 5385', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 93867663557936 notify_id 77309411335 from 4927', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 93867663557936 notify_id 85899345939 from 5089', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94736761590432 notify_id 77309411336 from 4937', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94736761590432 notify_id 85899345940 from 5406', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94652583591808 notify_id 77309411331 from 4946', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94652583591808 notify_id 85899345941 from 5104', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.watch_notify_same_primary:['press enter to exit...', 'NOTIFY cookie 94583968991600 notify_id 77309411337 from 4955', '00000000 07 00 00 00 6e 6f 74 69 66 79 31 |....notify1|', '0000000b', 'NOTIFY cookie 94583968991600 notify_id 85899345942 from 5123', '00000000 07 00 00 00 6e 6f 74 69 66 79 32 |....notify2|', '0000000b', ''] 2026-02-17T10:56:58.512 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T10:56:58.513 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T10:56:58.555 INFO:tasks.ceph.osd.0:Started 2026-02-17T10:56:58.555 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:no valid command found; 10 closest matches: 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:0 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:1 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:2 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:abort 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:assert 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:config diff 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:config diff get 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:config get 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:config help [] 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:config set ... 2026-02-17T10:56:58.614 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: invalid command 2026-02-17T10:56:58.616 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T10:56:58.616 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-17T10:56:59.855 INFO:tasks.ceph.osd.0.trial196.stderr:2026-02-17T10:56:59.849+0000 7fbe8e98f8c0 -1 Falling back to public interface 2026-02-17T10:57:03.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-17T10:57:03.617 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T10:57:03.677 INFO:tasks.ceph.osd.0.trial196.stderr:2026-02-17T10:57:03.668+0000 7fbe8e98f8c0 -1 osd.0 18 log_to_monitors true 2026-02-17T10:57:03.679 INFO:teuthology.orchestra.run.trial196.stderr:no valid command found; 10 closest matches: 2026-02-17T10:57:03.679 INFO:teuthology.orchestra.run.trial196.stderr:0 2026-02-17T10:57:03.679 INFO:teuthology.orchestra.run.trial196.stderr:1 2026-02-17T10:57:03.679 INFO:teuthology.orchestra.run.trial196.stderr:2 2026-02-17T10:57:03.679 INFO:teuthology.orchestra.run.trial196.stderr:abort 2026-02-17T10:57:03.679 INFO:teuthology.orchestra.run.trial196.stderr:assert 2026-02-17T10:57:03.679 INFO:teuthology.orchestra.run.trial196.stderr:bluefs debug_inject_read_zeros 2026-02-17T10:57:03.680 INFO:teuthology.orchestra.run.trial196.stderr:bluefs files list 2026-02-17T10:57:03.680 INFO:teuthology.orchestra.run.trial196.stderr:bluefs stats 2026-02-17T10:57:03.680 INFO:teuthology.orchestra.run.trial196.stderr:bluestore allocator dump block 2026-02-17T10:57:03.680 INFO:teuthology.orchestra.run.trial196.stderr:bluestore allocator fragmentation block 2026-02-17T10:57:03.680 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: invalid command 2026-02-17T10:57:03.681 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T10:57:03.682 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-17T10:57:03.766 INFO:tasks.ceph.osd.0.trial196.stderr:2026-02-17T10:57:03.760+0000 7fbe86773640 -1 osd.0 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T10:57:08.683 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T10:57:08.747 INFO:teuthology.orchestra.run.trial196.stdout:{ 2026-02-17T10:57:08.748 INFO:teuthology.orchestra.run.trial196.stdout: "ops": [], 2026-02-17T10:57:08.748 INFO:teuthology.orchestra.run.trial196.stdout: "num_ops": 0 2026-02-17T10:57:08.748 INFO:teuthology.orchestra.run.trial196.stdout:} 2026-02-17T10:57:08.755 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-17T10:57:08.755 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-17T10:57:08.959 INFO:teuthology.orchestra.run.trial196.stderr:pool 'unique_pool_0' removed 2026-02-17T10:57:08.973 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T10:57:08.989 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T10:57:08.989 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:57:09.131 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:57:09.132 INFO:teuthology.orchestra.run.trial196.stderr:dumped all 2026-02-17T10:57:09.142 INFO:teuthology.orchestra.run.trial196.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T10:57:08.957375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90476,"kb_used_data":736,"kb_used_omap":7,"kb_used_meta":89656,"kb_avail":283025044,"statfs":{"total":289910292480,"available":289817645056,"internally_reserved":0,"allocated":753664,"data_stored":225996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7623,"internal_metadata":91808313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19340,"num_objects":-20,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20,"num_whiteouts":0,"num_read":-3,"num_read_kb":0,"num_write":-20,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.227923"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739573+0000","last_change":"2026-02-17T10:57:05.739573+0000","last_active":"2026-02-17T10:57:05.739573+0000","last_peered":"2026-02-17T10:57:05.739573+0000","last_clean":"2026-02-17T10:57:05.739573+0000","last_became_active":"2026-02-17T10:57:05.739174+0000","last_became_peered":"2026-02-17T10:57:05.739174+0000","last_unstale":"2026-02-17T10:57:05.739573+0000","last_undegraded":"2026-02-17T10:57:05.739573+0000","last_fullsized":"2026-02-17T10:57:05.739573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:50.830548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030872700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738554+0000","last_change":"2026-02-17T10:57:05.738554+0000","last_active":"2026-02-17T10:57:05.738554+0000","last_peered":"2026-02-17T10:57:05.738554+0000","last_clean":"2026-02-17T10:57:05.738554+0000","last_became_active":"2026-02-17T10:57:05.738150+0000","last_became_peered":"2026-02-17T10:57:05.738150+0000","last_unstale":"2026-02-17T10:57:05.738554+0000","last_undegraded":"2026-02-17T10:57:05.738554+0000","last_fullsized":"2026-02-17T10:57:05.738554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:05:51.463782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035504200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740691+0000","last_change":"2026-02-17T10:57:05.740691+0000","last_active":"2026-02-17T10:57:05.740691+0000","last_peered":"2026-02-17T10:57:05.740691+0000","last_clean":"2026-02-17T10:57:05.740691+0000","last_became_active":"2026-02-17T10:57:05.740028+0000","last_became_peered":"2026-02-17T10:57:05.740028+0000","last_unstale":"2026-02-17T10:57:05.740691+0000","last_undegraded":"2026-02-17T10:57:05.740691+0000","last_fullsized":"2026-02-17T10:57:05.740691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:39:04.414443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031870599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.736535+0000","last_change":"2026-02-17T10:56:39.809816+0000","last_active":"2026-02-17T10:57:05.736535+0000","last_peered":"2026-02-17T10:57:05.736535+0000","last_clean":"2026-02-17T10:57:05.736535+0000","last_became_active":"2026-02-17T10:56:37.804636+0000","last_became_peered":"2026-02-17T10:56:37.804636+0000","last_unstale":"2026-02-17T10:57:05.736535+0000","last_undegraded":"2026-02-17T10:57:05.736535+0000","last_fullsized":"2026-02-17T10:57:05.736535+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:37:53.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047219699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740120+0000","last_change":"2026-02-17T10:57:05.740120+0000","last_active":"2026-02-17T10:57:05.740120+0000","last_peered":"2026-02-17T10:57:05.740120+0000","last_clean":"2026-02-17T10:57:05.740120+0000","last_became_active":"2026-02-17T10:57:05.739911+0000","last_became_peered":"2026-02-17T10:57:05.739911+0000","last_unstale":"2026-02-17T10:57:05.740120+0000","last_undegraded":"2026-02-17T10:57:05.740120+0000","last_fullsized":"2026-02-17T10:57:05.740120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:23:13.520852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050042900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738083+0000","last_change":"2026-02-17T10:57:05.738083+0000","last_active":"2026-02-17T10:57:05.738083+0000","last_peered":"2026-02-17T10:57:05.738083+0000","last_clean":"2026-02-17T10:57:05.738083+0000","last_became_active":"2026-02-17T10:57:05.737803+0000","last_became_peered":"2026-02-17T10:57:05.737803+0000","last_unstale":"2026-02-17T10:57:05.738083+0000","last_undegraded":"2026-02-17T10:57:05.738083+0000","last_fullsized":"2026-02-17T10:57:05.738083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:01:40.938758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000345986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739647+0000","last_change":"2026-02-17T10:57:05.739647+0000","last_active":"2026-02-17T10:57:05.739647+0000","last_peered":"2026-02-17T10:57:05.739647+0000","last_clean":"2026-02-17T10:57:05.739647+0000","last_became_active":"2026-02-17T10:57:05.739287+0000","last_became_peered":"2026-02-17T10:57:05.739287+0000","last_unstale":"2026-02-17T10:57:05.739647+0000","last_undegraded":"2026-02-17T10:57:05.739647+0000","last_fullsized":"2026-02-17T10:57:05.739647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:57:11.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035673500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.737296+0000","last_change":"2026-02-17T10:56:39.810019+0000","last_active":"2026-02-17T10:57:05.737296+0000","last_peered":"2026-02-17T10:57:05.737296+0000","last_clean":"2026-02-17T10:57:05.737296+0000","last_became_active":"2026-02-17T10:56:37.804237+0000","last_became_peered":"2026-02-17T10:56:37.804237+0000","last_unstale":"2026-02-17T10:57:05.737296+0000","last_undegraded":"2026-02-17T10:57:05.737296+0000","last_fullsized":"2026-02-17T10:57:05.737296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:10:34.046138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065000400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":229376,"data_stored":71209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":270336,"data_stored":79931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":253952,"data_stored":74856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:57:09.143 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:57:09.293 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:57:09.294 INFO:teuthology.orchestra.run.trial196.stderr:dumped all 2026-02-17T10:57:09.303 INFO:teuthology.orchestra.run.trial196.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T10:57:08.957375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90476,"kb_used_data":736,"kb_used_omap":7,"kb_used_meta":89656,"kb_avail":283025044,"statfs":{"total":289910292480,"available":289817645056,"internally_reserved":0,"allocated":753664,"data_stored":225996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7623,"internal_metadata":91808313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19340,"num_objects":-20,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20,"num_whiteouts":0,"num_read":-3,"num_read_kb":0,"num_write":-20,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.227923"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739573+0000","last_change":"2026-02-17T10:57:05.739573+0000","last_active":"2026-02-17T10:57:05.739573+0000","last_peered":"2026-02-17T10:57:05.739573+0000","last_clean":"2026-02-17T10:57:05.739573+0000","last_became_active":"2026-02-17T10:57:05.739174+0000","last_became_peered":"2026-02-17T10:57:05.739174+0000","last_unstale":"2026-02-17T10:57:05.739573+0000","last_undegraded":"2026-02-17T10:57:05.739573+0000","last_fullsized":"2026-02-17T10:57:05.739573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:50.830548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030872700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738554+0000","last_change":"2026-02-17T10:57:05.738554+0000","last_active":"2026-02-17T10:57:05.738554+0000","last_peered":"2026-02-17T10:57:05.738554+0000","last_clean":"2026-02-17T10:57:05.738554+0000","last_became_active":"2026-02-17T10:57:05.738150+0000","last_became_peered":"2026-02-17T10:57:05.738150+0000","last_unstale":"2026-02-17T10:57:05.738554+0000","last_undegraded":"2026-02-17T10:57:05.738554+0000","last_fullsized":"2026-02-17T10:57:05.738554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:05:51.463782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035504200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740691+0000","last_change":"2026-02-17T10:57:05.740691+0000","last_active":"2026-02-17T10:57:05.740691+0000","last_peered":"2026-02-17T10:57:05.740691+0000","last_clean":"2026-02-17T10:57:05.740691+0000","last_became_active":"2026-02-17T10:57:05.740028+0000","last_became_peered":"2026-02-17T10:57:05.740028+0000","last_unstale":"2026-02-17T10:57:05.740691+0000","last_undegraded":"2026-02-17T10:57:05.740691+0000","last_fullsized":"2026-02-17T10:57:05.740691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:39:04.414443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031870599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.736535+0000","last_change":"2026-02-17T10:56:39.809816+0000","last_active":"2026-02-17T10:57:05.736535+0000","last_peered":"2026-02-17T10:57:05.736535+0000","last_clean":"2026-02-17T10:57:05.736535+0000","last_became_active":"2026-02-17T10:56:37.804636+0000","last_became_peered":"2026-02-17T10:56:37.804636+0000","last_unstale":"2026-02-17T10:57:05.736535+0000","last_undegraded":"2026-02-17T10:57:05.736535+0000","last_fullsized":"2026-02-17T10:57:05.736535+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:37:53.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047219699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740120+0000","last_change":"2026-02-17T10:57:05.740120+0000","last_active":"2026-02-17T10:57:05.740120+0000","last_peered":"2026-02-17T10:57:05.740120+0000","last_clean":"2026-02-17T10:57:05.740120+0000","last_became_active":"2026-02-17T10:57:05.739911+0000","last_became_peered":"2026-02-17T10:57:05.739911+0000","last_unstale":"2026-02-17T10:57:05.740120+0000","last_undegraded":"2026-02-17T10:57:05.740120+0000","last_fullsized":"2026-02-17T10:57:05.740120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:23:13.520852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050042900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738083+0000","last_change":"2026-02-17T10:57:05.738083+0000","last_active":"2026-02-17T10:57:05.738083+0000","last_peered":"2026-02-17T10:57:05.738083+0000","last_clean":"2026-02-17T10:57:05.738083+0000","last_became_active":"2026-02-17T10:57:05.737803+0000","last_became_peered":"2026-02-17T10:57:05.737803+0000","last_unstale":"2026-02-17T10:57:05.738083+0000","last_undegraded":"2026-02-17T10:57:05.738083+0000","last_fullsized":"2026-02-17T10:57:05.738083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:01:40.938758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000345986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739647+0000","last_change":"2026-02-17T10:57:05.739647+0000","last_active":"2026-02-17T10:57:05.739647+0000","last_peered":"2026-02-17T10:57:05.739647+0000","last_clean":"2026-02-17T10:57:05.739647+0000","last_became_active":"2026-02-17T10:57:05.739287+0000","last_became_peered":"2026-02-17T10:57:05.739287+0000","last_unstale":"2026-02-17T10:57:05.739647+0000","last_undegraded":"2026-02-17T10:57:05.739647+0000","last_fullsized":"2026-02-17T10:57:05.739647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:57:11.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035673500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.737296+0000","last_change":"2026-02-17T10:56:39.810019+0000","last_active":"2026-02-17T10:57:05.737296+0000","last_peered":"2026-02-17T10:57:05.737296+0000","last_clean":"2026-02-17T10:57:05.737296+0000","last_became_active":"2026-02-17T10:56:37.804237+0000","last_became_peered":"2026-02-17T10:56:37.804237+0000","last_unstale":"2026-02-17T10:57:05.737296+0000","last_undegraded":"2026-02-17T10:57:05.737296+0000","last_fullsized":"2026-02-17T10:57:05.737296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:10:34.046138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065000400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":229376,"data_stored":71209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":270336,"data_stored":79931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":253952,"data_stored":74856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:57:09.304 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T10:57:09.304 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:57:09.456 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:57:09.456 INFO:teuthology.orchestra.run.trial196.stderr:dumped all 2026-02-17T10:57:09.466 INFO:teuthology.orchestra.run.trial196.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T10:57:08.957375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90476,"kb_used_data":736,"kb_used_omap":7,"kb_used_meta":89656,"kb_avail":283025044,"statfs":{"total":289910292480,"available":289817645056,"internally_reserved":0,"allocated":753664,"data_stored":225996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7623,"internal_metadata":91808313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19340,"num_objects":-20,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20,"num_whiteouts":0,"num_read":-3,"num_read_kb":0,"num_write":-20,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.227923"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739573+0000","last_change":"2026-02-17T10:57:05.739573+0000","last_active":"2026-02-17T10:57:05.739573+0000","last_peered":"2026-02-17T10:57:05.739573+0000","last_clean":"2026-02-17T10:57:05.739573+0000","last_became_active":"2026-02-17T10:57:05.739174+0000","last_became_peered":"2026-02-17T10:57:05.739174+0000","last_unstale":"2026-02-17T10:57:05.739573+0000","last_undegraded":"2026-02-17T10:57:05.739573+0000","last_fullsized":"2026-02-17T10:57:05.739573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:50.830548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030872700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738554+0000","last_change":"2026-02-17T10:57:05.738554+0000","last_active":"2026-02-17T10:57:05.738554+0000","last_peered":"2026-02-17T10:57:05.738554+0000","last_clean":"2026-02-17T10:57:05.738554+0000","last_became_active":"2026-02-17T10:57:05.738150+0000","last_became_peered":"2026-02-17T10:57:05.738150+0000","last_unstale":"2026-02-17T10:57:05.738554+0000","last_undegraded":"2026-02-17T10:57:05.738554+0000","last_fullsized":"2026-02-17T10:57:05.738554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:05:51.463782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035504200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740691+0000","last_change":"2026-02-17T10:57:05.740691+0000","last_active":"2026-02-17T10:57:05.740691+0000","last_peered":"2026-02-17T10:57:05.740691+0000","last_clean":"2026-02-17T10:57:05.740691+0000","last_became_active":"2026-02-17T10:57:05.740028+0000","last_became_peered":"2026-02-17T10:57:05.740028+0000","last_unstale":"2026-02-17T10:57:05.740691+0000","last_undegraded":"2026-02-17T10:57:05.740691+0000","last_fullsized":"2026-02-17T10:57:05.740691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:39:04.414443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031870599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.736535+0000","last_change":"2026-02-17T10:56:39.809816+0000","last_active":"2026-02-17T10:57:05.736535+0000","last_peered":"2026-02-17T10:57:05.736535+0000","last_clean":"2026-02-17T10:57:05.736535+0000","last_became_active":"2026-02-17T10:56:37.804636+0000","last_became_peered":"2026-02-17T10:56:37.804636+0000","last_unstale":"2026-02-17T10:57:05.736535+0000","last_undegraded":"2026-02-17T10:57:05.736535+0000","last_fullsized":"2026-02-17T10:57:05.736535+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:37:53.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047219699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740120+0000","last_change":"2026-02-17T10:57:05.740120+0000","last_active":"2026-02-17T10:57:05.740120+0000","last_peered":"2026-02-17T10:57:05.740120+0000","last_clean":"2026-02-17T10:57:05.740120+0000","last_became_active":"2026-02-17T10:57:05.739911+0000","last_became_peered":"2026-02-17T10:57:05.739911+0000","last_unstale":"2026-02-17T10:57:05.740120+0000","last_undegraded":"2026-02-17T10:57:05.740120+0000","last_fullsized":"2026-02-17T10:57:05.740120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:23:13.520852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050042900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738083+0000","last_change":"2026-02-17T10:57:05.738083+0000","last_active":"2026-02-17T10:57:05.738083+0000","last_peered":"2026-02-17T10:57:05.738083+0000","last_clean":"2026-02-17T10:57:05.738083+0000","last_became_active":"2026-02-17T10:57:05.737803+0000","last_became_peered":"2026-02-17T10:57:05.737803+0000","last_unstale":"2026-02-17T10:57:05.738083+0000","last_undegraded":"2026-02-17T10:57:05.738083+0000","last_fullsized":"2026-02-17T10:57:05.738083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:01:40.938758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000345986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739647+0000","last_change":"2026-02-17T10:57:05.739647+0000","last_active":"2026-02-17T10:57:05.739647+0000","last_peered":"2026-02-17T10:57:05.739647+0000","last_clean":"2026-02-17T10:57:05.739647+0000","last_became_active":"2026-02-17T10:57:05.739287+0000","last_became_peered":"2026-02-17T10:57:05.739287+0000","last_unstale":"2026-02-17T10:57:05.739647+0000","last_undegraded":"2026-02-17T10:57:05.739647+0000","last_fullsized":"2026-02-17T10:57:05.739647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:57:11.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035673500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.737296+0000","last_change":"2026-02-17T10:56:39.810019+0000","last_active":"2026-02-17T10:57:05.737296+0000","last_peered":"2026-02-17T10:57:05.737296+0000","last_clean":"2026-02-17T10:57:05.737296+0000","last_became_active":"2026-02-17T10:56:37.804237+0000","last_became_peered":"2026-02-17T10:56:37.804237+0000","last_unstale":"2026-02-17T10:57:05.737296+0000","last_undegraded":"2026-02-17T10:57:05.737296+0000","last_fullsized":"2026-02-17T10:57:05.737296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:10:34.046138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065000400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":229376,"data_stored":71209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":270336,"data_stored":79931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":253952,"data_stored":74856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:57:09.467 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T10:57:09.623 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:57:09.624 INFO:teuthology.orchestra.run.trial196.stdout:{"epoch":24,"fsid":"633ea263-1a23-44b1-b719-26cb7ff8f4d8","created":"2026-02-17T10:56:21.359007+0000","modified":"2026-02-17T10:57:08.956082+0000","last_up_change":"2026-02-17T10:57:04.731829+0000","last_in_change":"2026-02-17T10:56:22.332426+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T10:56:35.906512+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3a8607d-2fc0-42fa-8964-003c712fec74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":22,"up_thru":22,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":2010115515},{"type":"v1","addr":"10.20.193.196:6804","nonce":2010115515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":2010115515},{"type":"v1","addr":"10.20.193.196:6808","nonce":2010115515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6814","nonce":2010115515},{"type":"v1","addr":"10.20.193.196:6816","nonce":2010115515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":2010115515},{"type":"v1","addr":"10.20.193.196:6812","nonce":2010115515}]},"public_addr":"10.20.193.196:6804/2010115515","cluster_addr":"10.20.193.196:6808/2010115515","heartbeat_back_addr":"10.20.193.196:6816/2010115515","heartbeat_front_addr":"10.20.193.196:6812/2010115515","state":["exists","up"]},{"osd":1,"uuid":"b0942728-26e3-4493-99f1-621bb3dfbdcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6803","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6805","nonce":4190182765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6807","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6809","nonce":4190182765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6815","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6817","nonce":4190182765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6811","nonce":4190182765},{"type":"v1","addr":"10.20.193.196:6813","nonce":4190182765}]},"public_addr":"10.20.193.196:6805/4190182765","cluster_addr":"10.20.193.196:6809/4190182765","heartbeat_back_addr":"10.20.193.196:6817/4190182765","heartbeat_front_addr":"10.20.193.196:6813/4190182765","state":["exists","up"]},{"osd":2,"uuid":"26c3f205-be95-44ed-9981-c15935c8bb25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6818","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6819","nonce":1169028315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6820","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6821","nonce":1169028315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6824","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6825","nonce":1169028315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6822","nonce":1169028315},{"type":"v1","addr":"10.20.193.196:6823","nonce":1169028315}]},"public_addr":"10.20.193.196:6819/1169028315","cluster_addr":"10.20.193.196:6821/1169028315","heartbeat_back_addr":"10.20.193.196:6825/1169028315","heartbeat_front_addr":"10.20.193.196:6823/1169028315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":19},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T10:56:28.917377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T10:57:10.638 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T10:57:10.638 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T10:57:10.725 INFO:teuthology.orchestra.run.trial196.stdout:{ 2026-02-17T10:57:10.725 INFO:teuthology.orchestra.run.trial196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T10:57:10.726 INFO:teuthology.orchestra.run.trial196.stdout:} 2026-02-17T10:57:10.734 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T10:57:10.889 INFO:teuthology.orchestra.run.trial196.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T10:57:10.900 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T10:57:10.900 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T10:57:10.979 INFO:teuthology.orchestra.run.trial196.stdout:{ 2026-02-17T10:57:10.979 INFO:teuthology.orchestra.run.trial196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T10:57:10.979 INFO:teuthology.orchestra.run.trial196.stdout:} 2026-02-17T10:57:10.988 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T10:57:11.134 INFO:teuthology.orchestra.run.trial196.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T10:57:11.145 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T10:57:11.145 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T10:57:11.219 INFO:teuthology.orchestra.run.trial196.stdout:{ 2026-02-17T10:57:11.220 INFO:teuthology.orchestra.run.trial196.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T10:57:11.220 INFO:teuthology.orchestra.run.trial196.stdout:} 2026-02-17T10:57:11.231 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T10:57:11.386 INFO:teuthology.orchestra.run.trial196.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T10:57:11.397 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:57:11.542 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:57:11.542 INFO:teuthology.orchestra.run.trial196.stderr:dumped all 2026-02-17T10:57:11.551 INFO:teuthology.orchestra.run.trial196.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-02-17T10:57:09.777739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90476,"kb_used_data":736,"kb_used_omap":7,"kb_used_meta":89656,"kb_avail":283025044,"statfs":{"total":289910292480,"available":289817645056,"internally_reserved":0,"allocated":753664,"data_stored":225996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7623,"internal_metadata":91808313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19340,"num_objects":-20,"num_object_clones":0,"num_object_copies":-40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-20,"num_whiteouts":0,"num_read":-3,"num_read_kb":0,"num_write":-20,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000678"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739573+0000","last_change":"2026-02-17T10:57:05.739573+0000","last_active":"2026-02-17T10:57:05.739573+0000","last_peered":"2026-02-17T10:57:05.739573+0000","last_clean":"2026-02-17T10:57:05.739573+0000","last_became_active":"2026-02-17T10:57:05.739174+0000","last_became_peered":"2026-02-17T10:57:05.739174+0000","last_unstale":"2026-02-17T10:57:05.739573+0000","last_undegraded":"2026-02-17T10:57:05.739573+0000","last_fullsized":"2026-02-17T10:57:05.739573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:18:50.830548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030872700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738554+0000","last_change":"2026-02-17T10:57:05.738554+0000","last_active":"2026-02-17T10:57:05.738554+0000","last_peered":"2026-02-17T10:57:05.738554+0000","last_clean":"2026-02-17T10:57:05.738554+0000","last_became_active":"2026-02-17T10:57:05.738150+0000","last_became_peered":"2026-02-17T10:57:05.738150+0000","last_unstale":"2026-02-17T10:57:05.738554+0000","last_undegraded":"2026-02-17T10:57:05.738554+0000","last_fullsized":"2026-02-17T10:57:05.738554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:05:51.463782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035504200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740691+0000","last_change":"2026-02-17T10:57:05.740691+0000","last_active":"2026-02-17T10:57:05.740691+0000","last_peered":"2026-02-17T10:57:05.740691+0000","last_clean":"2026-02-17T10:57:05.740691+0000","last_became_active":"2026-02-17T10:57:05.740028+0000","last_became_peered":"2026-02-17T10:57:05.740028+0000","last_unstale":"2026-02-17T10:57:05.740691+0000","last_undegraded":"2026-02-17T10:57:05.740691+0000","last_fullsized":"2026-02-17T10:57:05.740691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:39:04.414443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031870599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.736535+0000","last_change":"2026-02-17T10:56:39.809816+0000","last_active":"2026-02-17T10:57:05.736535+0000","last_peered":"2026-02-17T10:57:05.736535+0000","last_clean":"2026-02-17T10:57:05.736535+0000","last_became_active":"2026-02-17T10:56:37.804636+0000","last_became_peered":"2026-02-17T10:56:37.804636+0000","last_unstale":"2026-02-17T10:57:05.736535+0000","last_undegraded":"2026-02-17T10:57:05.736535+0000","last_fullsized":"2026-02-17T10:57:05.736535+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:37:53.869466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047219699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.740120+0000","last_change":"2026-02-17T10:57:05.740120+0000","last_active":"2026-02-17T10:57:05.740120+0000","last_peered":"2026-02-17T10:57:05.740120+0000","last_clean":"2026-02-17T10:57:05.740120+0000","last_became_active":"2026-02-17T10:57:05.739911+0000","last_became_peered":"2026-02-17T10:57:05.739911+0000","last_unstale":"2026-02-17T10:57:05.740120+0000","last_undegraded":"2026-02-17T10:57:05.740120+0000","last_fullsized":"2026-02-17T10:57:05.740120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:23:13.520852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050042900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.738083+0000","last_change":"2026-02-17T10:57:05.738083+0000","last_active":"2026-02-17T10:57:05.738083+0000","last_peered":"2026-02-17T10:57:05.738083+0000","last_clean":"2026-02-17T10:57:05.738083+0000","last_became_active":"2026-02-17T10:57:05.737803+0000","last_became_peered":"2026-02-17T10:57:05.737803+0000","last_unstale":"2026-02-17T10:57:05.738083+0000","last_undegraded":"2026-02-17T10:57:05.738083+0000","last_fullsized":"2026-02-17T10:57:05.738083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:01:40.938758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000345986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.739647+0000","last_change":"2026-02-17T10:57:05.739647+0000","last_active":"2026-02-17T10:57:05.739647+0000","last_peered":"2026-02-17T10:57:05.739647+0000","last_clean":"2026-02-17T10:57:05.739647+0000","last_became_active":"2026-02-17T10:57:05.739287+0000","last_became_peered":"2026-02-17T10:57:05.739287+0000","last_unstale":"2026-02-17T10:57:05.739647+0000","last_undegraded":"2026-02-17T10:57:05.739647+0000","last_fullsized":"2026-02-17T10:57:05.739647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:57:11.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035673500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T10:57:05.737296+0000","last_change":"2026-02-17T10:56:39.810019+0000","last_active":"2026-02-17T10:57:05.737296+0000","last_peered":"2026-02-17T10:57:05.737296+0000","last_clean":"2026-02-17T10:57:05.737296+0000","last_became_active":"2026-02-17T10:56:37.804237+0000","last_became_peered":"2026-02-17T10:56:37.804237+0000","last_unstale":"2026-02-17T10:57:05.737296+0000","last_undegraded":"2026-02-17T10:57:05.737296+0000","last_fullsized":"2026-02-17T10:57:05.737296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:56:36.793953+0000","last_clean_scrub_stamp":"2026-02-17T10:56:36.793953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:10:34.046138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065000400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":229376,"data_stored":71209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":270336,"data_stored":79931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":253952,"data_stored":74856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:57:11.556 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.557 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.557 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.557 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.557 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.557 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.557 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.558 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T10:56:36.793953+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=56, tm_sec=36, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=10, tm_min=57, tm_sec=9, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T10:57:11.558 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T10:57:31.558 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T10:57:31.702 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-17T10:57:31.702 INFO:teuthology.orchestra.run.trial196.stderr:dumped all 2026-02-17T10:57:31.712 INFO:teuthology.orchestra.run.trial196.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2026-02-17T10:57:29.779770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90332,"kb_used_data":620,"kb_used_omap":7,"kb_used_meta":89656,"kb_avail":283025188,"statfs":{"total":289910292480,"available":289817792512,"internally_reserved":0,"allocated":634880,"data_stored":199832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7623,"internal_metadata":91808313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001050"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:13.898816+0000","last_change":"2026-02-17T10:57:13.898831+0000","last_active":"2026-02-17T10:57:13.898816+0000","last_peered":"2026-02-17T10:57:13.898816+0000","last_clean":"2026-02-17T10:57:13.898816+0000","last_became_active":"2026-02-17T10:57:05.739174+0000","last_became_peered":"2026-02-17T10:57:05.739174+0000","last_unstale":"2026-02-17T10:57:13.898816+0000","last_undegraded":"2026-02-17T10:57:13.898816+0000","last_fullsized":"2026-02-17T10:57:13.898816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:57:13.898756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:57:13.898756+0000","last_clean_scrub_stamp":"2026-02-17T10:57:13.898756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:52:22.700075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030872700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:12.879905+0000","last_change":"2026-02-17T10:57:12.879938+0000","last_active":"2026-02-17T10:57:12.879905+0000","last_peered":"2026-02-17T10:57:12.879905+0000","last_clean":"2026-02-17T10:57:12.879905+0000","last_became_active":"2026-02-17T10:57:05.738150+0000","last_became_peered":"2026-02-17T10:57:05.738150+0000","last_unstale":"2026-02-17T10:57:12.879905+0000","last_undegraded":"2026-02-17T10:57:12.879905+0000","last_fullsized":"2026-02-17T10:57:12.879905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:57:12.879810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:57:12.879810+0000","last_clean_scrub_stamp":"2026-02-17T10:57:12.879810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:40:42.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035504200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"24'3","reported_seq":54,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:11.755686+0000","last_change":"2026-02-17T10:57:11.755725+0000","last_active":"2026-02-17T10:57:11.755686+0000","last_peered":"2026-02-17T10:57:11.755686+0000","last_clean":"2026-02-17T10:57:11.755686+0000","last_became_active":"2026-02-17T10:57:05.740028+0000","last_became_peered":"2026-02-17T10:57:05.740028+0000","last_unstale":"2026-02-17T10:57:11.755686+0000","last_undegraded":"2026-02-17T10:57:11.755686+0000","last_fullsized":"2026-02-17T10:57:11.755686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2026-02-17T10:57:11.755605+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2026-02-17T10:57:11.755605+0000","last_clean_scrub_stamp":"2026-02-17T10:57:11.755605+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:38:06.514164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031870599999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"24'2","reported_seq":52,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:12.895332+0000","last_change":"2026-02-17T10:57:12.895352+0000","last_active":"2026-02-17T10:57:12.895332+0000","last_peered":"2026-02-17T10:57:12.895332+0000","last_clean":"2026-02-17T10:57:12.895332+0000","last_became_active":"2026-02-17T10:56:37.804636+0000","last_became_peered":"2026-02-17T10:56:37.804636+0000","last_unstale":"2026-02-17T10:57:12.895332+0000","last_undegraded":"2026-02-17T10:57:12.895332+0000","last_fullsized":"2026-02-17T10:57:12.895332+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2026-02-17T10:57:12.895289+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2026-02-17T10:57:12.895289+0000","last_clean_scrub_stamp":"2026-02-17T10:57:12.895289+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:26:57.349392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047219699999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":57,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:15.900495+0000","last_change":"2026-02-17T10:57:15.900520+0000","last_active":"2026-02-17T10:57:15.900495+0000","last_peered":"2026-02-17T10:57:15.900495+0000","last_clean":"2026-02-17T10:57:15.900495+0000","last_became_active":"2026-02-17T10:57:05.739911+0000","last_became_peered":"2026-02-17T10:57:05.739911+0000","last_unstale":"2026-02-17T10:57:15.900495+0000","last_undegraded":"2026-02-17T10:57:15.900495+0000","last_fullsized":"2026-02-17T10:57:15.900495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:57:15.900405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:57:15.900405+0000","last_clean_scrub_stamp":"2026-02-17T10:57:15.900405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:51:29.267939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00050042900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":57,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:11.885981+0000","last_change":"2026-02-17T10:57:11.886001+0000","last_active":"2026-02-17T10:57:11.885981+0000","last_peered":"2026-02-17T10:57:11.885981+0000","last_clean":"2026-02-17T10:57:11.885981+0000","last_became_active":"2026-02-17T10:57:05.737803+0000","last_became_peered":"2026-02-17T10:57:05.737803+0000","last_unstale":"2026-02-17T10:57:11.885981+0000","last_undegraded":"2026-02-17T10:57:11.885981+0000","last_fullsized":"2026-02-17T10:57:11.885981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:57:11.885904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:57:11.885904+0000","last_clean_scrub_stamp":"2026-02-17T10:57:11.885904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:37:05.074084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000345986,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":57,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:14.898733+0000","last_change":"2026-02-17T10:57:14.898749+0000","last_active":"2026-02-17T10:57:14.898733+0000","last_peered":"2026-02-17T10:57:14.898733+0000","last_clean":"2026-02-17T10:57:14.898733+0000","last_became_active":"2026-02-17T10:57:05.739287+0000","last_became_peered":"2026-02-17T10:57:05.739287+0000","last_unstale":"2026-02-17T10:57:14.898733+0000","last_undegraded":"2026-02-17T10:57:14.898733+0000","last_fullsized":"2026-02-17T10:57:14.898733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:57:14.898670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:57:14.898670+0000","last_clean_scrub_stamp":"2026-02-17T10:57:14.898670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:09:46.262455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035673500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2026-02-17T10:57:11.895106+0000","last_change":"2026-02-17T10:57:11.895138+0000","last_active":"2026-02-17T10:57:11.895106+0000","last_peered":"2026-02-17T10:57:11.895106+0000","last_clean":"2026-02-17T10:57:11.895106+0000","last_became_active":"2026-02-17T10:56:37.804237+0000","last_became_peered":"2026-02-17T10:56:37.804237+0000","last_unstale":"2026-02-17T10:57:11.895106+0000","last_undegraded":"2026-02-17T10:57:11.895106+0000","last_fullsized":"2026-02-17T10:57:11.895106+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T10:57:11.895009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T10:57:11.895009+0000","last_clean_scrub_stamp":"2026-02-17T10:57:11.895009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:43:14.556854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065000400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":208896,"data_stored":66598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280518,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":208,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":212992,"data_stored":66617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4435,"internal_metadata":32370349},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":212992,"data_stored":66617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T10:57:31.714 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T10:57:31.872 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T10:57:31.872 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T10:57:31.872 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T10:57:31.872 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:57:31.935 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T10:57:31.935 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T10:57:31.935 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:57:32.027 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T10:57:32.027 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T10:57:32.027 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:57:32.114 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T10:57:32.114 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T10:57:32.114 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T10:57:32.115 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:57:32.140 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T10:57:32.140 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T10:57:32.140 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T10:57:32.140 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:57:32.194 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T10:57:32.194 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T10:57:32.194 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:57:32.249 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T10:57:32.249 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T10:57:32.249 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T10:57:32.306 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T10:57:32.306 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T10:57:32.306 DEBUG:teuthology.orchestra.run.trial196:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(OBJECT_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(MON_DOWN\)' | head -n 1 2026-02-17T10:57:32.356 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:57:32.356 DEBUG:teuthology.orchestra.run.trial196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T10:57:32.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:57:32.414 DEBUG:teuthology.orchestra.run.trial196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T10:57:32.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:57:32.468 DEBUG:teuthology.orchestra.run.trial196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T10:57:32.522 INFO:tasks.ceph:Archiving mon data... 2026-02-17T10:57:32.524 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233/data/mon.a.tgz 2026-02-17T10:57:32.524 DEBUG:teuthology.orchestra.run.trial196:> mktemp 2026-02-17T10:57:32.566 INFO:teuthology.orchestra.run.trial196.stdout:/tmp/tmp.DVmB5OvFrs 2026-02-17T10:57:32.567 DEBUG:teuthology.orchestra.run.trial196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DVmB5OvFrs 2026-02-17T10:57:32.635 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0666 /tmp/tmp.DVmB5OvFrs 2026-02-17T10:57:32.736 DEBUG:teuthology.orchestra.remote:trial196:/tmp/tmp.DVmB5OvFrs is 142KB 2026-02-17T10:57:32.747 DEBUG:teuthology.orchestra.run.trial196:> rm -fr /tmp/tmp.DVmB5OvFrs 2026-02-17T10:57:32.752 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233/data/mon.b.tgz 2026-02-17T10:57:32.752 DEBUG:teuthology.orchestra.run.trial196:> mktemp 2026-02-17T10:57:32.798 INFO:teuthology.orchestra.run.trial196.stdout:/tmp/tmp.FnfVPqXm76 2026-02-17T10:57:32.798 DEBUG:teuthology.orchestra.run.trial196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FnfVPqXm76 2026-02-17T10:57:32.868 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0666 /tmp/tmp.FnfVPqXm76 2026-02-17T10:57:32.964 DEBUG:teuthology.orchestra.remote:trial196:/tmp/tmp.FnfVPqXm76 is 194KB 2026-02-17T10:57:32.976 DEBUG:teuthology.orchestra.run.trial196:> rm -fr /tmp/tmp.FnfVPqXm76 2026-02-17T10:57:32.980 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233/data/mon.c.tgz 2026-02-17T10:57:32.981 DEBUG:teuthology.orchestra.run.trial196:> mktemp 2026-02-17T10:57:33.026 INFO:teuthology.orchestra.run.trial196.stdout:/tmp/tmp.8PXzFbRscY 2026-02-17T10:57:33.026 DEBUG:teuthology.orchestra.run.trial196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8PXzFbRscY 2026-02-17T10:57:33.103 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0666 /tmp/tmp.8PXzFbRscY 2026-02-17T10:57:33.202 DEBUG:teuthology.orchestra.remote:trial196:/tmp/tmp.8PXzFbRscY is 194KB 2026-02-17T10:57:33.210 DEBUG:teuthology.orchestra.run.trial196:> rm -fr /tmp/tmp.8PXzFbRscY 2026-02-17T10:57:33.213 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T10:57:33.213 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T10:57:33.305 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T10:57:33.305 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T10:57:33.307 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233/remote/trial196/crash 2026-02-17T10:57:33.308 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T10:57:33.355 INFO:tasks.ceph:Compressing logs... 2026-02-17T10:57:33.355 DEBUG:teuthology.orchestra.run.trial196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T10:57:33.406 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20960.log 2026-02-17T10:57:33.406 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22763.log 2026-02-17T10:57:33.407 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21149.log 2026-02-17T10:57:33.407 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20960.log.gz 2026-02-17T10:57:33.407 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22763.log.gz 2026-02-17T10:57:33.407 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19637.log 2026-02-17T10:57:33.407 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19680.log 2026-02-17T10:57:33.407 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21149.log.gz 2026-02-17T10:57:33.408 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19467.log 2026-02-17T10:57:33.408 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19637.log.gz 2026-02-17T10:57:33.408 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21023.log 2026-02-17T10:57:33.408 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19680.log.gz 2026-02-17T10:57:33.408 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19467.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T10:57:33.408 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19467.log.gz 2026-02-17T10:57:33.409 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19722.log 2026-02-17T10:57:33.409 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21023.log.gz 2026-02-17T10:57:33.409 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21574.log 2026-02-17T10:57:33.409 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19973.log 2026-02-17T10:57:33.409 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19722.log.gz 2026-02-17T10:57:33.410 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19360.log 2026-02-17T10:57:33.410 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21574.log.gz 2026-02-17T10:57:33.410 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19847.log 2026-02-17T10:57:33.410 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19973.log.gz 2026-02-17T10:57:33.410 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20184.log 2026-02-17T10:57:33.410 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19360.log.gz 2026-02-17T10:57:33.411 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19847.log.gz 2026-02-17T10:57:33.411 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22737.log 2026-02-17T10:57:33.411 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20310.log 2026-02-17T10:57:33.411 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20184.log.gz 2026-02-17T10:57:33.411 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15662.log 2026-02-17T10:57:33.412 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22737.log.gz 2026-02-17T10:57:33.412 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20582.log 2026-02-17T10:57:33.412 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20310.log.gz 2026-02-17T10:57:33.412 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20624.log 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.15662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15662.log.gz 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22659.log 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20582.log.gz 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20624.log.gz 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20750.log 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22659.log.gz 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22633.log 2026-02-17T10:57:33.413 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19234.log 2026-02-17T10:57:33.414 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20750.log: /var/log/ceph/ceph-client.admin.22633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22633.log.gz 2026-02-17T10:57:33.414 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20750.log.gz 2026-02-17T10:57:33.414 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20645.log 2026-02-17T10:57:33.414 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20057.log 2026-02-17T10:57:33.414 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19234.log.gz 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21385.log 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20645.log.gz 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20226.log 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20057.log: /var/log/ceph/ceph-client.admin.21385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20057.log.gz 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15686.log 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21385.log.gz 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20226.log.gz 2026-02-17T10:57:33.415 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21238.log 2026-02-17T10:57:33.416 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.15686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20981.log 2026-02-17T10:57:33.416 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15686.log.gz 2026-02-17T10:57:33.416 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21343.log 2026-02-17T10:57:33.416 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21238.log.gz 2026-02-17T10:57:33.416 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21469.log 2026-02-17T10:57:33.416 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20981.log.gz 2026-02-17T10:57:33.416 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21343.log.gz 2026-02-17T10:57:33.417 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20855.log 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21322.log 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21469.log.gz 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19080.log 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20855.log.gz 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20141.log 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21322.log.gz 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19080.log.gz 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20141.log.gz 2026-02-17T10:57:33.418 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21511.log 2026-02-17T10:57:33.419 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21065.log 2026-02-17T10:57:33.419 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.21511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20876.log 2026-02-17T10:57:33.419 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21511.log.gz 2026-02-17T10:57:33.419 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21065.log.gz 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20015.log 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21002.log 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20876.log.gz 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20015.log.gz 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20267.log 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21002.log.gz 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19511.log 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20267.log.gz 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22555.log 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19511.log.gz 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21196.log 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22555.log.gz 2026-02-17T10:57:33.420 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19386.log 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21280.log 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21196.log.gz 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18996.log 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19386.log.gz 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21044.log 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21280.log.gz 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.18996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21173.log 2026-02-17T10:57:33.421 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18996.log.gz 2026-02-17T10:57:33.422 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21044.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T10:57:33.422 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21044.log.gz 2026-02-17T10:57:33.422 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21173.log.gz 2026-02-17T10:57:33.422 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19082.log 2026-02-17T10:57:33.422 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22581.log 2026-02-17T10:57:33.423 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.19082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19082.log.gz 2026-02-17T10:57:33.423 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20834.log 2026-02-17T10:57:33.423 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22581.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22581.log.gz 2026-02-17T10:57:33.423 INFO:teuthology.orchestra.run.trial196.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.19554.log 2026-02-17T10:57:33.423 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18976.log 2026-02-17T10:57:33.423 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20834.log.gz 2026-02-17T10:57:33.423 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19554.log.gz 2026-02-17T10:57:33.424 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20435.log 2026-02-17T10:57:33.424 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.18976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18976.log.gz 2026-02-17T10:57:33.424 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19764.log 2026-02-17T10:57:33.424 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19438.log 2026-02-17T10:57:33.424 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20435.log.gz 2026-02-17T10:57:33.424 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19764.log.gz 2026-02-17T10:57:33.424 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19022.log 2026-02-17T10:57:33.425 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19490.log 2026-02-17T10:57:33.425 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19438.log.gz 2026-02-17T10:57:33.425 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19022.log.gz 2026-02-17T10:57:33.425 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22477.log 2026-02-17T10:57:33.426 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20268.log 2026-02-17T10:57:33.426 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19490.log.gz 2026-02-17T10:57:33.426 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19048.log 2026-02-17T10:57:33.426 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22477.log.gz 2026-02-17T10:57:33.426 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20918.log 2026-02-17T10:57:33.426 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20268.log.gz 2026-02-17T10:57:33.427 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20687.log 2026-02-17T10:57:33.427 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19048.log.gz 2026-02-17T10:57:33.427 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20918.log.gz 2026-02-17T10:57:33.427 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19889.log 2026-02-17T10:57:33.427 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19334.log 2026-02-17T10:57:33.428 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20687.log.gz 2026-02-17T10:57:33.428 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19889.log.gz 2026-02-17T10:57:33.428 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21301.log 2026-02-17T10:57:33.428 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20498.log 2026-02-17T10:57:33.428 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19334.log.gz 2026-02-17T10:57:33.429 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18363.log 2026-02-17T10:57:33.429 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21301.log.gz 2026-02-17T10:57:33.429 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15710.log 2026-02-17T10:57:33.429 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20498.log.gz 2026-02-17T10:57:33.429 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.18363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21128.log 2026-02-17T10:57:33.429 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18363.log.gz 2026-02-17T10:57:33.430 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.15710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19081.log 2026-02-17T10:57:33.430 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15710.log.gz 2026-02-17T10:57:33.430 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19512.log 2026-02-17T10:57:33.430 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21128.log.gz 2026-02-17T10:57:33.430 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22451.log 2026-02-17T10:57:33.430 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19081.log.gz 2026-02-17T10:57:33.431 INFO:teuthology.orchestra.run.trial196.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T10:57:33.431 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22711.log 2026-02-17T10:57:33.431 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19512.log.gz 2026-02-17T10:57:33.431 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22451.log.gz 2026-02-17T10:57:33.431 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20100.log 2026-02-17T10:57:33.431 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20603.log 2026-02-17T10:57:33.432 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22711.log.gz 2026-02-17T10:57:33.432 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20897.log 2026-02-17T10:57:33.432 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20100.log.gz 2026-02-17T10:57:33.432 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20603.log.gz 2026-02-17T10:57:33.432 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20813.log 2026-02-17T10:57:33.433 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21107.log 2026-02-17T10:57:33.433 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20897.log.gz 2026-02-17T10:57:33.433 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20519.log 2026-02-17T10:57:33.433 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20813.log.gz 2026-02-17T10:57:33.433 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20540.log 2026-02-17T10:57:33.433 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21107.log.gz 2026-02-17T10:57:33.434 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19721.log 2026-02-17T10:57:33.434 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20519.log.gz 2026-02-17T10:57:33.434 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19932.log 2026-02-17T10:57:33.434 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20540.log.gz 2026-02-17T10:57:33.434 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19721.log.gz 2026-02-17T10:57:33.435 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19974.log 2026-02-17T10:57:33.435 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21553.log 2026-02-17T10:57:33.435 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19932.log.gz 2026-02-17T10:57:33.435 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19974.log.gz 2026-02-17T10:57:33.435 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18926.log 2026-02-17T10:57:33.436 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19805.log 2026-02-17T10:57:33.436 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21553.log: /var/log/ceph/ceph-client.admin.18926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21553.log.gz 2026-02-17T10:57:33.436 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18926.log.gz 2026-02-17T10:57:33.436 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22685.log 2026-02-17T10:57:33.436 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19805.log.gz 2026-02-17T10:57:33.436 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19848.log 2026-02-17T10:57:33.437 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19763.log 2026-02-17T10:57:33.437 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22685.log.gz 2026-02-17T10:57:33.437 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19848.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T10:57:33.437 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19848.log.gz 2026-02-17T10:57:33.437 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19763.log.gz 2026-02-17T10:57:33.437 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20393.log 2026-02-17T10:57:33.438 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21595.log 2026-02-17T10:57:33.438 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.20393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20393.log.gz 2026-02-17T10:57:33.438 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T10:57:33.438 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19308.log 2026-02-17T10:57:33.438 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21595.log.gz 2026-02-17T10:57:33.438 INFO:teuthology.orchestra.run.trial196.stderr: 95.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T10:57:33.439 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11829.log 2026-02-17T10:57:33.439 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19308.log.gz 2026-02-17T10:57:33.439 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21532.log 2026-02-17T10:57:33.439 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph.tmp-client.admin.11829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19931.log 2026-02-17T10:57:33.439 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11829.log.gz 2026-02-17T10:57:33.440 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20456.log 2026-02-17T10:57:33.440 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21532.log: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T10:57:33.440 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21532.log.gz 2026-02-17T10:57:33.440 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19931.log.gz 2026-02-17T10:57:33.440 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T10:57:33.440 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20666.log 2026-02-17T10:57:33.440 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20456.log.gz 2026-02-17T10:57:33.441 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19806.log 2026-02-17T10:57:33.441 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20666.log.gzgzip 2026-02-17T10:57:33.441 INFO:teuthology.orchestra.run.trial196.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22607.log 2026-02-17T10:57:33.441 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20771.log 2026-02-17T10:57:33.441 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19806.log.gz 2026-02-17T10:57:33.441 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22607.log.gz 2026-02-17T10:57:33.442 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19412.log 2026-02-17T10:57:33.442 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20225.log 2026-02-17T10:57:33.442 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20771.log.gz 2026-02-17T10:57:33.442 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T10:57:33.443 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15745.log 2026-02-17T10:57:33.443 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19412.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20225.log.gz -- replaced with /var/log/ceph/ceph-client.admin.19412.log.gz 2026-02-17T10:57:33.443 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-17T10:57:33.443 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19153.log 2026-02-17T10:57:33.443 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.15745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20561.log 2026-02-17T10:57:33.443 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15745.log.gz 2026-02-17T10:57:33.443 INFO:teuthology.orchestra.run.trial196.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T10:57:33.444 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15811.log 2026-02-17T10:57:33.444 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19153.log.gz 2026-02-17T10:57:33.444 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20561.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20561.log.gz -5 2026-02-17T10:57:33.444 INFO:teuthology.orchestra.run.trial196.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22787.log 2026-02-17T10:57:33.444 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20016.log 2026-02-17T10:57:33.444 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.15811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15811.log.gz 2026-02-17T10:57:33.445 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22787.log.gz 2026-02-17T10:57:33.445 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20351.log 2026-02-17T10:57:33.445 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20372.log 2026-02-17T10:57:33.445 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20016.log.gz 2026-02-17T10:57:33.445 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21406.log 2026-02-17T10:57:33.445 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20351.log.gz 2026-02-17T10:57:33.446 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20372.log.gz 2026-02-17T10:57:33.446 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20729.log 2026-02-17T10:57:33.446 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21406.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.20792.log -- replaced with /var/log/ceph/ceph-client.admin.21406.log.gz 2026-02-17T10:57:33.446 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-17T10:57:33.446 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19230.log 2026-02-17T10:57:33.446 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20729.log.gz 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22529.log 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20792.log.gz 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15467.log 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19230.log: /var/log/ceph/ceph-client.admin.22529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19230.log.gz 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22529.log.gz 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21259.log 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.15467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20058.log 2026-02-17T10:57:33.447 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15467.log.gz 2026-02-17T10:57:33.448 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21427.log 2026-02-17T10:57:33.448 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21259.log.gz 2026-02-17T10:57:33.448 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21364.log 2026-02-17T10:57:33.448 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20058.log.gz 2026-02-17T10:57:33.448 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20183.log 2026-02-17T10:57:33.448 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21427.log.gz 2026-02-17T10:57:33.449 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21364.log.gz 2026-02-17T10:57:33.449 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19595.log 2026-02-17T10:57:33.449 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T10:57:33.449 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20183.log.gz 2026-02-17T10:57:33.449 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20099.log 2026-02-17T10:57:33.449 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19595.log.gz 2026-02-17T10:57:33.450 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19154.log 2026-02-17T10:57:33.450 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21490.log 2026-02-17T10:57:33.450 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20099.log.gz 2026-02-17T10:57:33.450 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21217.log 2026-02-17T10:57:33.450 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19154.log.gz 2026-02-17T10:57:33.451 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19204.log 2026-02-17T10:57:33.451 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21490.log.gz 2026-02-17T10:57:33.451 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20708.log 2026-02-17T10:57:33.451 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21217.log.gz 2026-02-17T10:57:33.451 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21086.log 2026-02-17T10:57:33.451 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19204.log.gz 2026-02-17T10:57:33.452 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19553.log 2026-02-17T10:57:33.452 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20708.log.gz 2026-02-17T10:57:33.452 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21086.log.gz 2026-02-17T10:57:33.452 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20477.log 2026-02-17T10:57:33.452 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15611.log 2026-02-17T10:57:33.453 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19553.log.gz 2026-02-17T10:57:33.453 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20477.log.gz 2026-02-17T10:57:33.453 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19679.log 2026-02-17T10:57:33.453 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.15611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.18951.log 2026-02-17T10:57:33.453 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15611.log.gz 2026-02-17T10:57:33.453 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19679.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T10:57:33.454 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19679.log.gz 2026-02-17T10:57:33.454 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5/var/log/ceph/ceph-client.admin.18951.log: --verbose -- /var/log/ceph/ceph-client.admin.19596.log 2026-02-17T10:57:33.454 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.18951.log.gz 2026-02-17T10:57:33.454 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19638.log 2026-02-17T10:57:33.455 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19890.log 2026-02-17T10:57:33.455 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19596.log.gz 2026-02-17T10:57:33.455 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20142.log 2026-02-17T10:57:33.455 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19638.log.gz 2026-02-17T10:57:33.455 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.19890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19890.log.gz 2026-02-17T10:57:33.455 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20414.log 2026-02-17T10:57:33.456 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20309.log 2026-02-17T10:57:33.456 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20142.log.gz 2026-02-17T10:57:33.456 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19280.log 2026-02-17T10:57:33.456 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20414.log.gz 2026-02-17T10:57:33.456 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21448.log 2026-02-17T10:57:33.456 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20309.log.gz 2026-02-17T10:57:33.457 INFO:teuthology.orchestra.run.trial196.stderr:gzip/var/log/ceph/ceph-client.admin.19280.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.20939.log 2026-02-17T10:57:33.457 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19280.log.gz 2026-02-17T10:57:33.457 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.21448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21448.log.gz 2026-02-17T10:57:33.457 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22503.log 2026-02-17T10:57:33.457 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.20939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20939.log.gz 2026-02-17T10:57:33.458 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.22503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22503.log.gz 2026-02-17T10:57:33.466 INFO:teuthology.orchestra.run.trial196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T10:57:33.466 INFO:teuthology.orchestra.run.trial196.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T10:57:33.533 INFO:teuthology.orchestra.run.trial196.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T10:57:33.772 INFO:teuthology.orchestra.run.trial196.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T10:57:33.811 INFO:teuthology.orchestra.run.trial196.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T10:57:33.812 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-17T10:57:33.812 INFO:teuthology.orchestra.run.trial196.stderr:real 0m0.411s 2026-02-17T10:57:33.813 INFO:teuthology.orchestra.run.trial196.stderr:user 0m0.933s 2026-02-17T10:57:33.813 INFO:teuthology.orchestra.run.trial196.stderr:sys 0m0.093s 2026-02-17T10:57:33.813 INFO:tasks.ceph:Archiving logs... 2026-02-17T10:57:33.813 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233/remote/trial196/log 2026-02-17T10:57:33.818 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T10:57:34.088 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T10:57:34.100 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T10:57:34.101 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T10:57:34.185 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T10:57:34.197 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T10:57:34.197 DEBUG:teuthology.orchestra.run.trial196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T10:57:34.238 INFO:teuthology.orchestra.run.trial196.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T10:57:34.238 INFO:teuthology.orchestra.run.trial196.stdout:============================================================================== 2026-02-17T10:57:34.238 INFO:teuthology.orchestra.run.trial196.stdout: ip229.ip-51-81- 206.108.0.131 2 u 43 64 3 75.667 -0.217 1.884 2026-02-17T10:57:34.238 INFO:teuthology.orchestra.run.trial196.stdout: ntp.maxhost.io 132.163.97.4 2 u 40 64 3 69.724 +0.941 1.495 2026-02-17T10:57:34.238 INFO:teuthology.orchestra.run.trial196.stdout: chi2.us.ntp.li 204.9.54.119 2 u 42 64 3 19.630 +1.184 2.637 2026-02-17T10:57:34.238 INFO:teuthology.orchestra.run.trial196.stdout: chi3.us.ntp.li 204.9.54.119 2 u 43 64 3 19.090 +1.287 1.375 2026-02-17T10:57:34.239 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T10:57:34.249 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T10:57:34.250 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T10:57:34.263 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T10:57:34.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T10:57:34.292 INFO:teuthology.task.internal:Duration was 262.128170 seconds 2026-02-17T10:57:34.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T10:57:34.306 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T10:57:34.307 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T10:57:34.331 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T10:57:34.331 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial196.front.sepia.ceph.com 2026-02-17T10:57:34.331 DEBUG:teuthology.orchestra.run.trial196:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T10:57:34.380 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T10:57:34.381 DEBUG:teuthology.orchestra.run.trial196:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T10:57:34.580 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T10:57:34.580 DEBUG:teuthology.orchestra.run.trial196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T10:57:34.589 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T10:57:34.591 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T10:57:34.591 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T10:57:34.591 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T10:57:34.591 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T10:57:34.636 INFO:teuthology.orchestra.run.trial196.stderr: 81.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T10:57:34.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T10:57:34.652 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T10:57:34.652 DEBUG:teuthology.orchestra.run.trial196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T10:57:34.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T10:57:34.696 DEBUG:teuthology.orchestra.run.trial196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T10:57:34.733 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern = core 2026-02-17T10:57:34.744 DEBUG:teuthology.orchestra.run.trial196:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T10:57:34.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T10:57:34.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T10:57:34.807 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T10:57:34.808 DEBUG:teuthology.misc:Transferring archived files from trial196:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51233/remote/trial196 2026-02-17T10:57:34.809 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T10:57:34.867 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T10:57:34.867 DEBUG:teuthology.orchestra.run.trial196:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T10:57:34.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T10:57:34.917 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T10:57:34.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T10:57:34.935 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T10:57:34.935 DEBUG:teuthology.orchestra.run.trial196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T10:57:34.946 INFO:teuthology.orchestra.run.trial196.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 10:57 /home/ubuntu/cephtest 2026-02-17T10:57:34.947 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T10:57:34.966 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T10:57:35.003 INFO:teuthology.run:Summary data: description: rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} duration: 262.1281704902649 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T10:57:35.003 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T10:57:35.134 INFO:teuthology.run:pass