2026-02-17T08:45:22.348 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T08:45:22.365 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:45:22.443 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51191 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51191' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw notification: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 mon election default strategy: 3 osd client message cap: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op num shards: 1 osd op num threads per shard: 16 osd op queue: mclock_scheduler flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMsO5PfMNZGnwOsbh5AMNpQwgeSTrSLAgF520rAYtG4nxN8deHW8+7D0mTfrajlgW8NUH1Xe0+jZbhVpanXIC+E= tasks: - install: null - ceph: fs: xfs log-ignorelist: - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH - \(POOL_APP_NOT_ENABLED\) wait-for-scrub: false - ssh_keys: null - cbt: benchmarks: radosbench: concurrent_ops: 4 concurrent_procs: 2 op_size: - 4096 pool_monitoring_list: - collectl pool_profile: replicated run_monitoring_list: - collectl time: 60 write_only: true cluster: iterations: 1 osds_per_node: 3 pool_profiles: replicated: pg_size: 256 pgp_size: 256 replication: replicated user: ubuntu monitoring_profiles: perf: args: stat -p {pid} -o {perf_dir}/perf_stat.{pid} nodes: - osds perf_cmd: perf pid_glob: ceph-osd.*.pid teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T08:45:22.443 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T08:45:22.443 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T08:45:22.443 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T08:45:22.445 INFO:teuthology.task.internal:Checking packages... 2026-02-17T08:45:22.445 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T08:45:22.445 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T08:45:22.445 INFO:teuthology.packaging:ref: None 2026-02-17T08:45:22.445 INFO:teuthology.packaging:tag: None 2026-02-17T08:45:22.445 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:45:22.445 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:45:22.445 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:45:22.583 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:45:22.584 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T08:45:22.597 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T08:45:22.597 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T08:45:22.612 INFO:teuthology.task.internal:Saving configuration 2026-02-17T08:45:22.629 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T08:45:22.642 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T08:45:22.721 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial040.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51191', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 08:41:58.161922', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICkjx5WjS2AKTWxzRbLDefEFu4Tb5a32qXOdi5FfKvHD'} 2026-02-17T08:45:22.721 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T08:45:22.733 INFO:teuthology.task.internal:roles: ubuntu@trial040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T08:45:22.733 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T08:45:22.819 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7631b2773ec0>, signals=[15]) 2026-02-17T08:45:22.819 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T08:45:22.830 INFO:teuthology.task.internal:Opening connections... 2026-02-17T08:45:22.830 DEBUG:teuthology.task.internal:connecting to ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:45:22.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:45:22.897 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T08:45:22.909 DEBUG:teuthology.orchestra.run.trial040:> uname -m 2026-02-17T08:45:22.977 INFO:teuthology.orchestra.run.trial040.stdout:x86_64 2026-02-17T08:45:22.977 DEBUG:teuthology.orchestra.run.trial040:> cat /etc/os-release 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:NAME="Ubuntu" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_ID="22.04" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:VERSION_CODENAME=jammy 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:ID=ubuntu 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:ID_LIKE=debian 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T08:45:23.021 INFO:teuthology.orchestra.run.trial040.stdout:UBUNTU_CODENAME=jammy 2026-02-17T08:45:23.022 INFO:teuthology.lock.ops:Updating trial040.front.sepia.ceph.com on lock server 2026-02-17T08:45:23.082 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T08:45:23.095 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T08:45:23.107 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T08:45:23.107 DEBUG:teuthology.orchestra.run.trial040:> test '!' -e /home/ubuntu/cephtest 2026-02-17T08:45:23.110 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T08:45:23.122 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T08:45:23.122 DEBUG:teuthology.orchestra.run.trial040:> test -z $(ls -A /var/lib/ceph) 2026-02-17T08:45:23.159 INFO:teuthology.orchestra.run.trial040.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T08:45:23.160 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T08:45:23.252 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T08:45:23.272 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T08:45:23.272 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T08:45:23.272 DEBUG:teuthology.orchestra.run.trial040:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T08:45:23.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:45:23.275 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-17T08:45:23.326 INFO:teuthology.orchestra.run.trial040.stdout:5.15.0-164-generic 2026-02-17T08:45:23.326 INFO:teuthology.task.kernel:Running kernel on trial040: 5.15.0-164-generic 2026-02-17T08:45:23.326 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get clean 2026-02-17T08:45:23.383 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get update 2026-02-17T08:45:23.880 INFO:teuthology.orchestra.run.trial040.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:45:23.963 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T08:45:24.312 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T08:45:24.463 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T08:45:24.603 INFO:teuthology.orchestra.run.trial040.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3237 kB] 2026-02-17T08:45:25.004 INFO:teuthology.orchestra.run.trial040.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T08:45:25.017 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T08:45:25.018 INFO:teuthology.orchestra.run.trial040.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T08:45:25.053 INFO:teuthology.orchestra.run.trial040.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T08:45:25.060 INFO:teuthology.orchestra.run.trial040.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T08:45:25.060 INFO:teuthology.orchestra.run.trial040.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T08:45:25.218 INFO:teuthology.orchestra.run.trial040.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T08:45:25.240 INFO:teuthology.orchestra.run.trial040.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T08:45:25.326 INFO:teuthology.orchestra.run.trial040.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T08:45:25.336 INFO:teuthology.orchestra.run.trial040.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T08:45:25.337 INFO:teuthology.orchestra.run.trial040.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T08:45:25.370 INFO:teuthology.orchestra.run.trial040.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T08:45:25.378 INFO:teuthology.orchestra.run.trial040.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T08:45:25.378 INFO:teuthology.orchestra.run.trial040.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T08:45:25.525 INFO:teuthology.orchestra.run.trial040.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T08:45:28.860 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 22.7 MB in 3s (7699 kB/s) 2026-02-17T08:45:29.396 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-17T08:45:29.410 DEBUG:teuthology.orchestra.run.trial040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T08:45:29.443 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-17T08:45:29.553 INFO:teuthology.orchestra.run.trial040.stdout:Building dependency tree... 2026-02-17T08:45:29.554 INFO:teuthology.orchestra.run.trial040.stdout:Reading state information... 2026-02-17T08:45:29.640 INFO:teuthology.orchestra.run.trial040.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:45:29.640 INFO:teuthology.orchestra.run.trial040.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:45:29.640 INFO:teuthology.orchestra.run.trial040.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:45:29.640 INFO:teuthology.orchestra.run.trial040.stdout: sg3-utils-udev 2026-02-17T08:45:29.640 INFO:teuthology.orchestra.run.trial040.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:45:29.641 INFO:teuthology.orchestra.run.trial040.stdout:The following additional packages will be installed: 2026-02-17T08:45:29.641 INFO:teuthology.orchestra.run.trial040.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T08:45:29.641 INFO:teuthology.orchestra.run.trial040.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T08:45:29.641 INFO:teuthology.orchestra.run.trial040.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T08:45:29.641 INFO:teuthology.orchestra.run.trial040.stdout:Suggested packages: 2026-02-17T08:45:29.641 INFO:teuthology.orchestra.run.trial040.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T08:45:29.654 INFO:teuthology.orchestra.run.trial040.stdout:The following NEW packages will be installed: 2026-02-17T08:45:29.654 INFO:teuthology.orchestra.run.trial040.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T08:45:29.654 INFO:teuthology.orchestra.run.trial040.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T08:45:29.654 INFO:teuthology.orchestra.run.trial040.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T08:45:29.655 INFO:teuthology.orchestra.run.trial040.stdout:The following packages will be upgraded: 2026-02-17T08:45:29.655 INFO:teuthology.orchestra.run.trial040.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T08:45:30.065 INFO:teuthology.orchestra.run.trial040.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:45:30.065 INFO:teuthology.orchestra.run.trial040.stdout:Need to get 113 MB of archives. 2026-02-17T08:45:30.065 INFO:teuthology.orchestra.run.trial040.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T08:45:30.066 INFO:teuthology.orchestra.run.trial040.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T08:45:31.397 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T08:45:31.724 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T08:45:33.592 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T08:45:33.592 INFO:teuthology.orchestra.run.trial040.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T08:45:33.593 INFO:teuthology.orchestra.run.trial040.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T08:45:33.934 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T08:45:34.010 INFO:teuthology.orchestra.run.trial040.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T08:45:34.209 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 113 MB in 4s (26.0 MB/s) 2026-02-17T08:45:34.229 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T08:45:34.391 INFO:teuthology.orchestra.run.trial040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T08:45:34.392 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:45:34.393 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:34.750 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T08:45:34.757 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:45:34.776 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:34.817 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T08:45:34.824 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:45:34.824 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:35.935 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:45:35.936 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:45:35.958 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:45:35.959 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:45:35.977 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T08:45:35.984 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T08:45:35.984 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:45:37.348 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T08:45:37.360 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:45:37.360 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:37.960 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:45:37.961 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:45:37.986 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:45:37.989 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:37.990 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T08:45:37.992 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:38.793 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:39.648 INFO:teuthology.orchestra.run.trial040.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T08:45:39.649 INFO:teuthology.orchestra.run.trial040.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T08:45:39.654 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:40.479 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T08:45:40.480 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T08:45:40.481 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:45:40.487 INFO:teuthology.orchestra.run.trial040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T08:45:40.487 INFO:teuthology.orchestra.run.trial040.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:45:47.575 INFO:teuthology.orchestra.run.trial040.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T08:45:54.257 INFO:teuthology.orchestra.run.trial040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T08:45:54.257 INFO:teuthology.orchestra.run.trial040.stdout:Sourcing file `/etc/default/grub' 2026-02-17T08:45:54.276 INFO:teuthology.orchestra.run.trial040.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T08:45:54.277 INFO:teuthology.orchestra.run.trial040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T08:45:54.280 INFO:teuthology.orchestra.run.trial040.stdout:Generating grub configuration file ... 2026-02-17T08:45:54.364 INFO:teuthology.orchestra.run.trial040.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T08:45:54.371 INFO:teuthology.orchestra.run.trial040.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:45:54.545 INFO:teuthology.orchestra.run.trial040.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T08:45:54.551 INFO:teuthology.orchestra.run.trial040.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T08:45:54.623 INFO:teuthology.orchestra.run.trial040.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T08:45:54.623 INFO:teuthology.orchestra.run.trial040.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T08:45:54.623 INFO:teuthology.orchestra.run.trial040.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T08:45:54.625 INFO:teuthology.orchestra.run.trial040.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:45:54.634 INFO:teuthology.orchestra.run.trial040.stdout:done 2026-02-17T08:45:55.042 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout:Pending kernel upgrade! 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout:Running kernel version: 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout: 5.15.0-164-generic 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout:Diagnostics: 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T08:45:55.043 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout:The processor microcode seems to be up-to-date. 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout:No services need to be restarted. 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout:No containers need to be restarted. 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout:No user sessions are running outdated binaries. 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:45:55.044 INFO:teuthology.orchestra.run.trial040.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T08:45:55.719 DEBUG:teuthology.orchestra.run.trial040:> dpkg -s linux-image-generic 2026-02-17T08:45:55.729 INFO:teuthology.orchestra.run.trial040.stdout:Package: linux-image-generic 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Status: install ok installed 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Priority: optional 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Section: kernel 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Installed-Size: 21 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Architecture: amd64 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Source: linux-meta 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Version: 5.15.0.170.159 2026-02-17T08:45:55.730 INFO:teuthology.orchestra.run.trial040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T08:45:55.731 INFO:teuthology.orchestra.run.trial040.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T08:45:55.731 INFO:teuthology.orchestra.run.trial040.stdout:Recommends: thermald 2026-02-17T08:45:55.731 INFO:teuthology.orchestra.run.trial040.stdout:Description: Generic Linux kernel image 2026-02-17T08:45:55.731 INFO:teuthology.orchestra.run.trial040.stdout: This package will always depend on the latest generic kernel image 2026-02-17T08:45:55.731 INFO:teuthology.orchestra.run.trial040.stdout: available. 2026-02-17T08:45:55.731 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T08:45:55.731 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T08:45:55.731 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T08:45:55.732 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T08:45:55.732 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial040.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T08:45:55.732 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get clean 2026-02-17T08:45:55.811 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get update 2026-02-17T08:45:56.395 INFO:teuthology.orchestra.run.trial040.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:45:56.481 INFO:teuthology.orchestra.run.trial040.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T08:45:56.575 INFO:teuthology.orchestra.run.trial040.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T08:45:56.667 INFO:teuthology.orchestra.run.trial040.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T08:45:57.318 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-17T08:45:57.332 DEBUG:teuthology.orchestra.run.trial040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T08:45:57.365 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-17T08:45:57.477 INFO:teuthology.orchestra.run.trial040.stdout:Building dependency tree... 2026-02-17T08:45:57.478 INFO:teuthology.orchestra.run.trial040.stdout:Reading state information... 2026-02-17T08:45:57.564 INFO:teuthology.orchestra.run.trial040.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T08:45:57.565 INFO:teuthology.orchestra.run.trial040.stdout:linux-image-generic set to manually installed. 2026-02-17T08:45:57.565 INFO:teuthology.orchestra.run.trial040.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:45:57.565 INFO:teuthology.orchestra.run.trial040.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:45:57.565 INFO:teuthology.orchestra.run.trial040.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:45:57.565 INFO:teuthology.orchestra.run.trial040.stdout: sg3-utils-udev 2026-02-17T08:45:57.565 INFO:teuthology.orchestra.run.trial040.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:45:57.584 INFO:teuthology.orchestra.run.trial040.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:45:57.586 DEBUG:teuthology.orchestra.run.trial040:> dpkg -s linux-image-generic 2026-02-17T08:45:57.635 INFO:teuthology.orchestra.run.trial040.stdout:Package: linux-image-generic 2026-02-17T08:45:57.635 INFO:teuthology.orchestra.run.trial040.stdout:Status: install ok installed 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Priority: optional 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Section: kernel 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Installed-Size: 21 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Architecture: amd64 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Source: linux-meta 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Version: 5.15.0.170.159 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T08:45:57.636 INFO:teuthology.orchestra.run.trial040.stdout:Recommends: thermald 2026-02-17T08:45:57.637 INFO:teuthology.orchestra.run.trial040.stdout:Description: Generic Linux kernel image 2026-02-17T08:45:57.637 INFO:teuthology.orchestra.run.trial040.stdout: This package will always depend on the latest generic kernel image 2026-02-17T08:45:57.637 INFO:teuthology.orchestra.run.trial040.stdout: available. 2026-02-17T08:45:57.638 DEBUG:teuthology.orchestra.run.trial040:> mktemp 2026-02-17T08:45:57.683 INFO:teuthology.orchestra.run.trial040.stdout:/tmp/tmp.wOxuCRQEEM 2026-02-17T08:45:57.684 DEBUG:teuthology.orchestra.run.trial040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wOxuCRQEEM 2026-02-17T08:45:57.735 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0666 /tmp/tmp.wOxuCRQEEM 2026-02-17T08:45:57.834 DEBUG:teuthology.orchestra.remote:trial040:/tmp/tmp.wOxuCRQEEM is 7KB 2026-02-17T08:45:57.842 DEBUG:teuthology.orchestra.run.trial040:> rm -fr /tmp/tmp.wOxuCRQEEM 2026-02-17T08:45:57.846 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T08:45:57.895 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:45:57.895 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T08:45:57.895 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T08:45:57.949 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T08:45:57.949 DEBUG:teuthology.orchestra.run.trial040:> sudo update-grub 2026-02-17T08:45:58.190 INFO:teuthology.orchestra.run.trial040.stderr:Sourcing file `/etc/default/grub' 2026-02-17T08:45:58.208 INFO:teuthology.orchestra.run.trial040.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T08:45:58.209 INFO:teuthology.orchestra.run.trial040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T08:45:58.211 INFO:teuthology.orchestra.run.trial040.stderr:Generating grub configuration file ... 2026-02-17T08:45:58.295 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T08:45:58.300 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:45:58.477 INFO:teuthology.orchestra.run.trial040.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T08:45:58.483 INFO:teuthology.orchestra.run.trial040.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T08:45:58.551 INFO:teuthology.orchestra.run.trial040.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T08:45:58.551 INFO:teuthology.orchestra.run.trial040.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T08:45:58.551 INFO:teuthology.orchestra.run.trial040.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T08:45:58.553 INFO:teuthology.orchestra.run.trial040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:45:58.561 INFO:teuthology.orchestra.run.trial040.stderr:done 2026-02-17T08:45:58.563 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial040 2026-02-17T08:45:58.563 DEBUG:teuthology.orchestra.run.trial040:> sudo bash -c ' 2026-02-17T08:45:58.563 DEBUG:teuthology.orchestra.run.trial040:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T08:45:58.563 DEBUG:teuthology.orchestra.run.trial040:> ' 2026-02-17T08:46:28.566 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T08:46:28.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T08:46:28.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:47:28.623 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T08:47:37.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T08:47:37.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:47:37.728 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-17T08:47:38.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T08:47:38.120 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T08:47:38.120 DEBUG:teuthology.orchestra.run.trial040:> uname -r 2026-02-17T08:47:38.168 INFO:teuthology.orchestra.run.trial040.stdout:5.15.0-170-generic 2026-02-17T08:47:38.168 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T08:47:38.168 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T08:47:38.168 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T08:47:39.169 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T08:47:39.170 DEBUG:teuthology.orchestra.run.trial040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T08:47:39.183 INFO:teuthology.orchestra.run.trial040.stdout:ttyS1 2026-02-17T08:47:39.206 DEBUG:teuthology.parallel:result is None 2026-02-17T08:47:39.206 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T08:47:39.218 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T08:47:39.218 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T08:47:39.252 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T08:47:39.264 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T08:47:39.278 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T08:47:39.279 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T08:47:39.302 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T08:47:39.314 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T08:47:39.314 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T08:47:39.345 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:47:39.351 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:47:39.352 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T08:47:39.364 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T08:47:39.364 DEBUG:teuthology.orchestra.run.trial040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T08:47:39.405 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T08:47:39.422 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T08:47:39.422 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T08:47:39.452 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:47:39.496 DEBUG:teuthology.orchestra.run.trial040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:47:39.541 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:47:39.541 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T08:47:39.590 DEBUG:teuthology.orchestra.run.trial040:> sudo service rsyslog restart 2026-02-17T08:47:39.650 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T08:47:39.662 INFO:teuthology.task.internal:Starting timer... 2026-02-17T08:47:39.663 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T08:47:39.686 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T08:47:39.706 DEBUG:teuthology.task.selinux:Excluding trial040: OS 'ubuntu' does not support SELinux 2026-02-17T08:47:39.706 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T08:47:39.706 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T08:47:39.706 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T08:47:39.706 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T08:47:39.721 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T08:47:39.723 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T08:47:39.848 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T08:47:39.862 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T08:47:39.864 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial040.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T08:50:03.530 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial040.front.sepia.ceph.com')] 2026-02-17T08:50:03.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T08:50:03.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:50:03.614 DEBUG:teuthology.orchestra.run.trial040:> true 2026-02-17T08:50:03.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial040.front.sepia.ceph.com' 2026-02-17T08:50:03.863 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T08:50:03.880 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T08:50:03.880 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T08:50:03.881 DEBUG:teuthology.orchestra.run.trial040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:50:03.921 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Command line: ntpd -gq 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: ---------------------------------------------------- 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: corporation. Support and training for ntp-4 are 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: available at https://www.nwtime.org/support 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: ---------------------------------------------------- 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: proto: precision = 0.030 usec (-25) 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: basedate set to 2022-02-04 2026-02-17T08:50:03.922 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: gps base set to 2022-02-06 (week 2196) 2026-02-17T08:50:03.923 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T08:50:03.923 INFO:teuthology.orchestra.run.trial040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T08:50:03.923 INFO:teuthology.orchestra.run.trial040.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T08:50:03.924 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T08:50:03.924 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T08:50:03.924 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T08:50:03.924 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T08:50:03.925 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Listen normally on 3 enp1s0f0 10.20.193.40:123 2026-02-17T08:50:03.925 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Listen normally on 4 lo [::1]:123 2026-02-17T08:50:03.925 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5e28%2]:123 2026-02-17T08:50:03.925 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:03 ntpd[8773]: Listening on routing socket on fd #22 for interface updates 2026-02-17T08:50:04.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:04.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:04.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:04.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:04.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:04.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:04.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:04.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:04.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:04.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:04.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:04.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:04 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:05.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:05 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:05.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:05 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:05.992 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:05 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:05.992 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:05 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:05.992 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:05 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:05.992 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:05 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:06.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:06.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:06.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:06.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:06.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:06.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:06.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:06.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:06.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:06.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:06.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:06.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:06.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:06.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:06.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:06.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:06.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:06.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:06 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:07.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:07 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:07.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:07 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:07.990 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:07 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:07.991 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:07 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:07.991 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:07 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:07.991 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:07 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:08.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:08.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:08.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:08.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:08.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:08.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:08.948 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:08.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:08.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:08.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:08.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:08.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:08.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:08.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:08.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:08.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:08.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:08.958 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:08 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:09.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:09 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:09.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:09 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:09.991 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:09 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:09.991 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:09 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:09.991 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:09 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:09.992 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:09 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:10.921 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:10.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:10.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:10.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:10.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:10.922 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:10.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:10.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:10.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:10.949 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:10.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:50:10.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:50:10.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:50:10.951 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:50:10.952 INFO:teuthology.orchestra.run.trial040.stdout:17 Feb 08:50:10 ntpd[8773]: ntpd: time set +0.503726 s 2026-02-17T08:50:10.952 INFO:teuthology.orchestra.run.trial040.stdout:ntpd: time set +0.503726s 2026-02-17T08:50:10.952 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T08:50:10.952 INFO:teuthology.orchestra.run.trial040.stderr:17 Feb 08:50:10 ntpd[8773]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T08:50:11.011 INFO:teuthology.orchestra.run.trial040.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T08:50:11.012 INFO:teuthology.orchestra.run.trial040.stdout:============================================================================== 2026-02-17T08:50:11.012 INFO:teuthology.orchestra.run.trial040.stdout: s2-a.time.mci1. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:50:11.012 INFO:teuthology.orchestra.run.trial040.stdout: 172-238-164-57. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:50:11.012 INFO:teuthology.orchestra.run.trial040.stdout: us-east-2.clear .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:50:11.012 INFO:teuthology.orchestra.run.trial040.stdout: ntp.maxhost.io .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:50:11.013 INFO:teuthology.run_tasks:Running task install... 2026-02-17T08:50:11.028 DEBUG:teuthology.task.install:project ceph 2026-02-17T08:50:11.028 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T08:50:11.028 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T08:50:11.028 INFO:teuthology.task.install:Using flavor: default 2026-02-17T08:50:11.037 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T08:50:11.037 INFO:teuthology.task.install:extra packages: [] 2026-02-17T08:50:11.038 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-key list | grep Ceph 2026-02-17T08:50:11.105 INFO:teuthology.orchestra.run.trial040.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T08:50:11.132 INFO:teuthology.orchestra.run.trial040.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T08:50:11.133 INFO:teuthology.orchestra.run.trial040.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T08:50:11.134 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T08:50:11.134 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:50:11.308 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default/ 2026-02-17T08:50:11.308 INFO:teuthology.task.install.deb:Package version is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:50:11.441 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:11.441 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T08:50:11.451 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get update 2026-02-17T08:50:11.605 INFO:teuthology.orchestra.run.trial040.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T08:50:11.616 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-17T08:50:11.628 INFO:teuthology.orchestra.run.trial040.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T08:50:11.639 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T08:50:11.948 INFO:teuthology.orchestra.run.trial040.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:50:12.029 INFO:teuthology.orchestra.run.trial040.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T08:50:12.117 INFO:teuthology.orchestra.run.trial040.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T08:50:12.205 INFO:teuthology.orchestra.run.trial040.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T08:50:12.351 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 25.8 kB in 1s (34.8 kB/s) 2026-02-17T08:50:12.861 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-17T08:50:12.874 DEBUG:teuthology.orchestra.run.trial040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-705-g04cf6dd4-1jammy cephadm=19.2.3-705-g04cf6dd4-1jammy ceph-mds=19.2.3-705-g04cf6dd4-1jammy ceph-mgr=19.2.3-705-g04cf6dd4-1jammy ceph-common=19.2.3-705-g04cf6dd4-1jammy ceph-fuse=19.2.3-705-g04cf6dd4-1jammy ceph-test=19.2.3-705-g04cf6dd4-1jammy ceph-volume=19.2.3-705-g04cf6dd4-1jammy radosgw=19.2.3-705-g04cf6dd4-1jammy python3-rados=19.2.3-705-g04cf6dd4-1jammy python3-rgw=19.2.3-705-g04cf6dd4-1jammy python3-cephfs=19.2.3-705-g04cf6dd4-1jammy python3-rbd=19.2.3-705-g04cf6dd4-1jammy libcephfs2=19.2.3-705-g04cf6dd4-1jammy libcephfs-dev=19.2.3-705-g04cf6dd4-1jammy librados2=19.2.3-705-g04cf6dd4-1jammy librbd1=19.2.3-705-g04cf6dd4-1jammy rbd-fuse=19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:50:12.907 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-17T08:50:13.015 INFO:teuthology.orchestra.run.trial040.stdout:Building dependency tree... 2026-02-17T08:50:13.016 INFO:teuthology.orchestra.run.trial040.stdout:Reading state information... 2026-02-17T08:50:13.106 INFO:teuthology.orchestra.run.trial040.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout: sg3-utils-udev 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout:The following additional packages will be installed: 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T08:50:13.107 INFO:teuthology.orchestra.run.trial040.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T08:50:13.108 INFO:teuthology.orchestra.run.trial040.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout:Suggested packages: 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T08:50:13.109 INFO:teuthology.orchestra.run.trial040.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T08:50:13.110 INFO:teuthology.orchestra.run.trial040.stdout:Recommended packages: 2026-02-17T08:50:13.110 INFO:teuthology.orchestra.run.trial040.stdout: btrfs-tools 2026-02-17T08:50:13.141 INFO:teuthology.orchestra.run.trial040.stdout:The following NEW packages will be installed: 2026-02-17T08:50:13.141 INFO:teuthology.orchestra.run.trial040.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T08:50:13.141 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T08:50:13.141 INFO:teuthology.orchestra.run.trial040.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T08:50:13.141 INFO:teuthology.orchestra.run.trial040.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T08:50:13.141 INFO:teuthology.orchestra.run.trial040.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T08:50:13.142 INFO:teuthology.orchestra.run.trial040.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T08:50:13.143 INFO:teuthology.orchestra.run.trial040.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T08:50:13.143 INFO:teuthology.orchestra.run.trial040.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T08:50:13.143 INFO:teuthology.orchestra.run.trial040.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T08:50:13.143 INFO:teuthology.orchestra.run.trial040.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T08:50:13.143 INFO:teuthology.orchestra.run.trial040.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T08:50:13.143 INFO:teuthology.orchestra.run.trial040.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T08:50:13.143 INFO:teuthology.orchestra.run.trial040.stdout: xmlstarlet zip 2026-02-17T08:50:13.219 INFO:teuthology.orchestra.run.trial040.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:50:13.219 INFO:teuthology.orchestra.run.trial040.stdout:Need to get 178 MB of archives. 2026-02-17T08:50:13.219 INFO:teuthology.orchestra.run.trial040.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T08:50:13.219 INFO:teuthology.orchestra.run.trial040.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-705-g04cf6dd4-1jammy [3593 kB] 2026-02-17T08:50:13.321 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-705-g04cf6dd4-1jammy [3257 kB] 2026-02-17T08:50:13.365 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-705-g04cf6dd4-1jammy [979 kB] 2026-02-17T08:50:13.381 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-705-g04cf6dd4-1jammy [357 kB] 2026-02-17T08:50:13.386 INFO:teuthology.orchestra.run.trial040.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-705-g04cf6dd4-1jammy [32.9 kB] 2026-02-17T08:50:13.387 INFO:teuthology.orchestra.run.trial040.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-705-g04cf6dd4-1jammy [184 kB] 2026-02-17T08:50:13.390 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-705-g04cf6dd4-1jammy [74.1 kB] 2026-02-17T08:50:13.391 INFO:teuthology.orchestra.run.trial040.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-705-g04cf6dd4-1jammy [337 kB] 2026-02-17T08:50:13.397 INFO:teuthology.orchestra.run.trial040.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-705-g04cf6dd4-1jammy [6935 kB] 2026-02-17T08:50:13.495 INFO:teuthology.orchestra.run.trial040.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T08:50:13.511 INFO:teuthology.orchestra.run.trial040.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-705-g04cf6dd4-1jammy [112 kB] 2026-02-17T08:50:13.512 INFO:teuthology.orchestra.run.trial040.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-705-g04cf6dd4-1jammy [470 kB] 2026-02-17T08:50:13.519 INFO:teuthology.orchestra.run.trial040.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-705-g04cf6dd4-1jammy [26.5 MB] 2026-02-17T08:50:13.834 INFO:teuthology.orchestra.run.trial040.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T08:50:13.844 INFO:teuthology.orchestra.run.trial040.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T08:50:13.914 INFO:teuthology.orchestra.run.trial040.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T08:50:13.958 INFO:teuthology.orchestra.run.trial040.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-705-g04cf6dd4-1jammy [5178 kB] 2026-02-17T08:50:14.039 INFO:teuthology.orchestra.run.trial040.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-705-g04cf6dd4-1jammy [248 kB] 2026-02-17T08:50:14.042 INFO:teuthology.orchestra.run.trial040.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-705-g04cf6dd4-1jammy [125 kB] 2026-02-17T08:50:14.044 INFO:teuthology.orchestra.run.trial040.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-705-g04cf6dd4-1jammy [1081 kB] 2026-02-17T08:50:14.063 INFO:teuthology.orchestra.run.trial040.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-705-g04cf6dd4-1jammy [6239 kB] 2026-02-17T08:50:14.115 INFO:teuthology.orchestra.run.trial040.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T08:50:14.126 INFO:teuthology.orchestra.run.trial040.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T08:50:14.152 INFO:teuthology.orchestra.run.trial040.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T08:50:14.160 INFO:teuthology.orchestra.run.trial040.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T08:50:14.163 INFO:teuthology.orchestra.run.trial040.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T08:50:14.163 INFO:teuthology.orchestra.run.trial040.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T08:50:14.164 INFO:teuthology.orchestra.run.trial040.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T08:50:14.165 INFO:teuthology.orchestra.run.trial040.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-705-g04cf6dd4-1jammy [23.0 MB] 2026-02-17T08:50:14.181 INFO:teuthology.orchestra.run.trial040.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T08:50:14.185 INFO:teuthology.orchestra.run.trial040.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T08:50:14.188 INFO:teuthology.orchestra.run.trial040.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T08:50:14.258 INFO:teuthology.orchestra.run.trial040.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T08:50:14.258 INFO:teuthology.orchestra.run.trial040.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T08:50:14.259 INFO:teuthology.orchestra.run.trial040.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T08:50:14.261 INFO:teuthology.orchestra.run.trial040.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T08:50:14.262 INFO:teuthology.orchestra.run.trial040.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T08:50:14.263 INFO:teuthology.orchestra.run.trial040.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T08:50:14.264 INFO:teuthology.orchestra.run.trial040.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T08:50:14.264 INFO:teuthology.orchestra.run.trial040.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T08:50:14.264 INFO:teuthology.orchestra.run.trial040.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T08:50:14.335 INFO:teuthology.orchestra.run.trial040.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T08:50:14.335 INFO:teuthology.orchestra.run.trial040.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T08:50:14.335 INFO:teuthology.orchestra.run.trial040.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T08:50:14.336 INFO:teuthology.orchestra.run.trial040.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T08:50:14.407 INFO:teuthology.orchestra.run.trial040.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T08:50:14.409 INFO:teuthology.orchestra.run.trial040.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T08:50:14.409 INFO:teuthology.orchestra.run.trial040.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T08:50:14.410 INFO:teuthology.orchestra.run.trial040.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T08:50:14.410 INFO:teuthology.orchestra.run.trial040.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T08:50:14.410 INFO:teuthology.orchestra.run.trial040.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T08:50:14.479 INFO:teuthology.orchestra.run.trial040.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T08:50:14.480 INFO:teuthology.orchestra.run.trial040.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T08:50:14.480 INFO:teuthology.orchestra.run.trial040.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T08:50:14.480 INFO:teuthology.orchestra.run.trial040.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T08:50:14.545 INFO:teuthology.orchestra.run.trial040.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-705-g04cf6dd4-1jammy [14.2 kB] 2026-02-17T08:50:14.545 INFO:teuthology.orchestra.run.trial040.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [1173 kB] 2026-02-17T08:50:14.551 INFO:teuthology.orchestra.run.trial040.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T08:50:14.551 INFO:teuthology.orchestra.run.trial040.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T08:50:14.552 INFO:teuthology.orchestra.run.trial040.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T08:50:14.552 INFO:teuthology.orchestra.run.trial040.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T08:50:14.552 INFO:teuthology.orchestra.run.trial040.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T08:50:14.554 INFO:teuthology.orchestra.run.trial040.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T08:50:14.560 INFO:teuthology.orchestra.run.trial040.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-705-g04cf6dd4-1jammy [2503 kB] 2026-02-17T08:50:14.602 INFO:teuthology.orchestra.run.trial040.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-705-g04cf6dd4-1jammy [798 kB] 2026-02-17T08:50:14.614 INFO:teuthology.orchestra.run.trial040.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-705-g04cf6dd4-1jammy [157 kB] 2026-02-17T08:50:14.617 INFO:teuthology.orchestra.run.trial040.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-705-g04cf6dd4-1jammy [2396 kB] 2026-02-17T08:50:14.623 INFO:teuthology.orchestra.run.trial040.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T08:50:14.625 INFO:teuthology.orchestra.run.trial040.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T08:50:14.625 INFO:teuthology.orchestra.run.trial040.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T08:50:14.626 INFO:teuthology.orchestra.run.trial040.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T08:50:14.657 INFO:teuthology.orchestra.run.trial040.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-705-g04cf6dd4-1jammy [8625 kB] 2026-02-17T08:50:14.699 INFO:teuthology.orchestra.run.trial040.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T08:50:14.701 INFO:teuthology.orchestra.run.trial040.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T08:50:14.702 INFO:teuthology.orchestra.run.trial040.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T08:50:14.721 INFO:teuthology.orchestra.run.trial040.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T08:50:14.722 INFO:teuthology.orchestra.run.trial040.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T08:50:14.722 INFO:teuthology.orchestra.run.trial040.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T08:50:14.771 INFO:teuthology.orchestra.run.trial040.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T08:50:14.771 INFO:teuthology.orchestra.run.trial040.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T08:50:14.772 INFO:teuthology.orchestra.run.trial040.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T08:50:14.776 INFO:teuthology.orchestra.run.trial040.stdout:Get:82 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T08:50:14.799 INFO:teuthology.orchestra.run.trial040.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-705-g04cf6dd4-1jammy [14.3 kB] 2026-02-17T08:50:14.799 INFO:teuthology.orchestra.run.trial040.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-705-g04cf6dd4-1jammy [52.1 MB] 2026-02-17T08:50:14.843 INFO:teuthology.orchestra.run.trial040.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T08:50:14.844 INFO:teuthology.orchestra.run.trial040.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T08:50:14.845 INFO:teuthology.orchestra.run.trial040.stdout:Get:87 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T08:50:14.849 INFO:teuthology.orchestra.run.trial040.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T08:50:14.852 INFO:teuthology.orchestra.run.trial040.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T08:50:14.852 INFO:teuthology.orchestra.run.trial040.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T08:50:14.915 INFO:teuthology.orchestra.run.trial040.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T08:50:14.920 INFO:teuthology.orchestra.run.trial040.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T08:50:14.921 INFO:teuthology.orchestra.run.trial040.stdout:Get:93 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T08:50:14.924 INFO:teuthology.orchestra.run.trial040.stdout:Get:94 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T08:50:14.988 INFO:teuthology.orchestra.run.trial040.stdout:Get:95 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T08:50:14.988 INFO:teuthology.orchestra.run.trial040.stdout:Get:96 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T08:50:14.988 INFO:teuthology.orchestra.run.trial040.stdout:Get:97 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T08:50:14.990 INFO:teuthology.orchestra.run.trial040.stdout:Get:98 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T08:50:14.991 INFO:teuthology.orchestra.run.trial040.stdout:Get:99 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T08:50:14.999 INFO:teuthology.orchestra.run.trial040.stdout:Get:100 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T08:50:15.060 INFO:teuthology.orchestra.run.trial040.stdout:Get:101 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T08:50:15.060 INFO:teuthology.orchestra.run.trial040.stdout:Get:102 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T08:50:15.062 INFO:teuthology.orchestra.run.trial040.stdout:Get:103 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T08:50:15.063 INFO:teuthology.orchestra.run.trial040.stdout:Get:104 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T08:50:15.659 INFO:teuthology.orchestra.run.trial040.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-705-g04cf6dd4-1jammy [135 kB] 2026-02-17T08:50:15.660 INFO:teuthology.orchestra.run.trial040.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-705-g04cf6dd4-1jammy [41.0 kB] 2026-02-17T08:50:15.660 INFO:teuthology.orchestra.run.trial040.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-705-g04cf6dd4-1jammy [13.7 MB] 2026-02-17T08:50:15.881 INFO:teuthology.orchestra.run.trial040.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [92.1 kB] 2026-02-17T08:50:16.200 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 178 MB in 3s (64.9 MB/s) 2026-02-17T08:50:16.216 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T08:50:16.369 INFO:teuthology.orchestra.run.trial040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T08:50:16.371 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T08:50:16.372 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T08:50:16.393 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T08:50:16.405 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T08:50:16.405 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T08:50:16.421 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T08:50:16.433 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T08:50:16.434 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T08:50:16.454 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T08:50:16.462 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:50:16.468 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:50:16.504 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T08:50:16.515 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:50:16.515 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:50:16.532 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T08:50:16.540 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:50:16.540 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:50:16.560 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T08:50:16.568 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T08:50:16.569 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T08:50:16.585 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librados2. 2026-02-17T08:50:16.593 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../007-librados2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:16.593 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.634 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libnbd0. 2026-02-17T08:50:16.642 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T08:50:16.643 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T08:50:16.657 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librbd1. 2026-02-17T08:50:16.665 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../009-librbd1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:16.666 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.706 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T08:50:16.714 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:16.715 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.735 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rados. 2026-02-17T08:50:16.743 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../011-python3-rados_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:16.744 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.761 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T08:50:16.769 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:16.770 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.783 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T08:50:16.790 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:16.791 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.806 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T08:50:16.814 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:16.814 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.831 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T08:50:16.839 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T08:50:16.840 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T08:50:16.855 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T08:50:16.863 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T08:50:16.864 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T08:50:16.878 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T08:50:16.886 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:16.886 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:16.903 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T08:50:16.911 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T08:50:16.912 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T08:50:16.930 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T08:50:16.938 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T08:50:16.938 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T08:50:16.955 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T08:50:16.963 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T08:50:16.963 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T08:50:16.980 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package lua5.1. 2026-02-17T08:50:16.989 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T08:50:16.989 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T08:50:17.009 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package lua-any. 2026-02-17T08:50:17.017 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T08:50:17.017 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T08:50:17.030 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package zip. 2026-02-17T08:50:17.038 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T08:50:17.039 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T08:50:17.054 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package unzip. 2026-02-17T08:50:17.061 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T08:50:17.062 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T08:50:17.079 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package luarocks. 2026-02-17T08:50:17.087 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T08:50:17.088 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T08:50:17.125 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librgw2. 2026-02-17T08:50:17.133 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../026-librgw2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:17.133 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:17.204 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T08:50:17.212 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:17.213 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:17.228 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T08:50:17.236 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T08:50:17.237 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T08:50:17.252 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T08:50:17.260 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:17.260 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:17.278 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-common. 2026-02-17T08:50:17.286 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../030-ceph-common_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:17.287 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:17.489 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-base. 2026-02-17T08:50:17.498 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../031-ceph-base_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:17.503 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:17.565 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T08:50:17.573 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T08:50:17.574 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T08:50:17.588 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T08:50:17.596 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T08:50:17.597 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T08:50:17.613 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T08:50:17.621 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T08:50:17.621 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T08:50:17.636 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T08:50:17.645 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T08:50:17.645 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T08:50:17.659 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T08:50:17.667 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T08:50:17.668 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T08:50:17.683 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T08:50:17.691 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T08:50:17.691 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T08:50:17.705 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-portend. 2026-02-17T08:50:17.714 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T08:50:17.714 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T08:50:17.729 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T08:50:17.736 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T08:50:17.737 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T08:50:17.751 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T08:50:17.759 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T08:50:17.760 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T08:50:17.782 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T08:50:17.790 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T08:50:17.791 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T08:50:17.806 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T08:50:17.814 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T08:50:17.815 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T08:50:17.829 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-mako. 2026-02-17T08:50:17.837 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T08:50:17.838 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T08:50:17.854 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T08:50:17.862 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T08:50:17.862 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T08:50:17.877 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T08:50:17.885 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T08:50:17.885 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T08:50:17.899 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-webob. 2026-02-17T08:50:17.908 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T08:50:17.908 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T08:50:17.923 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T08:50:17.932 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T08:50:17.934 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T08:50:17.950 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T08:50:17.958 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T08:50:17.958 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T08:50:17.973 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-paste. 2026-02-17T08:50:17.980 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T08:50:17.980 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T08:50:18.008 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T08:50:18.017 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T08:50:18.017 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T08:50:18.031 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T08:50:18.040 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T08:50:18.040 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T08:50:18.055 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T08:50:18.063 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T08:50:18.064 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T08:50:18.079 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T08:50:18.087 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T08:50:18.087 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T08:50:18.111 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T08:50:18.120 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T08:50:18.120 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T08:50:18.140 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T08:50:18.148 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:18.148 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.177 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T08:50:18.185 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.186 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.200 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T08:50:18.208 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.209 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.230 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T08:50:18.238 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.239 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.295 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T08:50:18.303 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T08:50:18.304 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T08:50:18.320 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T08:50:18.328 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.329 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.483 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph. 2026-02-17T08:50:18.491 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../061-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.492 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.506 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T08:50:18.514 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.514 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.538 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T08:50:18.546 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.547 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.580 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package cephadm. 2026-02-17T08:50:18.588 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../064-cephadm_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:18.589 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.605 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T08:50:18.614 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T08:50:18.614 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T08:50:18.635 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T08:50:18.643 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:18.643 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.663 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T08:50:18.671 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T08:50:18.672 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T08:50:18.687 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-routes. 2026-02-17T08:50:18.695 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T08:50:18.695 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T08:50:18.715 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T08:50:18.723 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:18.723 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:18.929 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T08:50:18.938 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T08:50:18.938 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T08:50:18.977 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T08:50:18.985 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T08:50:18.986 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T08:50:19.013 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T08:50:19.021 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T08:50:19.021 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T08:50:19.036 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T08:50:19.045 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T08:50:19.045 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T08:50:19.127 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T08:50:19.136 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:19.137 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:19.305 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T08:50:19.314 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T08:50:19.314 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T08:50:19.328 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T08:50:19.337 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T08:50:19.337 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T08:50:19.354 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T08:50:19.363 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T08:50:19.363 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T08:50:19.380 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T08:50:19.388 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T08:50:19.389 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T08:50:19.404 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T08:50:19.412 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T08:50:19.413 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T08:50:19.431 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T08:50:19.439 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T08:50:19.439 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T08:50:19.533 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T08:50:19.542 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:19.542 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:19.556 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T08:50:19.564 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T08:50:19.571 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T08:50:19.587 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T08:50:19.595 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T08:50:19.596 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T08:50:19.610 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package jq. 2026-02-17T08:50:19.619 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T08:50:19.619 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T08:50:19.633 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package socat. 2026-02-17T08:50:19.642 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T08:50:19.642 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T08:50:19.661 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T08:50:19.670 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T08:50:19.670 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T08:50:19.707 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-test. 2026-02-17T08:50:19.716 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../087-ceph-test_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:19.716 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:20.180 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T08:50:20.189 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:50:20.190 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:20.213 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T08:50:20.222 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:20.222 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:20.237 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T08:50:20.246 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T08:50:20.246 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T08:50:20.266 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T08:50:20.275 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T08:50:20.276 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T08:50:20.292 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T08:50:20.300 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T08:50:20.301 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T08:50:20.333 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package pkg-config. 2026-02-17T08:50:20.342 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T08:50:20.342 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T08:50:20.358 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T08:50:20.366 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T08:50:20.367 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T08:50:20.395 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T08:50:20.404 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T08:50:20.404 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T08:50:20.418 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T08:50:20.426 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T08:50:20.427 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T08:50:20.444 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T08:50:20.453 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T08:50:20.454 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T08:50:20.469 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T08:50:20.478 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T08:50:20.478 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T08:50:20.497 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-py. 2026-02-17T08:50:20.505 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T08:50:20.506 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T08:50:20.526 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T08:50:20.534 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T08:50:20.534 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T08:50:20.576 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T08:50:20.585 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T08:50:20.586 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T08:50:20.602 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-toml. 2026-02-17T08:50:20.610 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T08:50:20.611 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T08:50:20.626 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T08:50:20.634 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T08:50:20.635 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T08:50:20.657 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T08:50:20.665 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T08:50:20.666 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T08:50:20.683 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T08:50:20.692 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T08:50:20.692 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T08:50:20.757 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package radosgw. 2026-02-17T08:50:20.766 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../106-radosgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:20.767 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:20.878 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T08:50:20.887 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:50:20.887 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:20.915 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T08:50:20.983 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T08:50:20.983 INFO:teuthology.orchestra.run.trial040.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T08:50:21.055 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T08:50:21.344 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T08:50:21.742 INFO:teuthology.orchestra.run.trial040.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T08:50:21.753 INFO:teuthology.orchestra.run.trial040.stdout:Setting up cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:21.795 INFO:teuthology.orchestra.run.trial040.stdout:Adding system user cephadm....done 2026-02-17T08:50:21.805 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T08:50:21.875 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T08:50:21.948 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T08:50:21.948 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T08:50:22.021 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T08:50:22.096 INFO:teuthology.orchestra.run.trial040.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T08:50:22.097 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T08:50:22.193 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T08:50:22.318 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T08:50:22.391 INFO:teuthology.orchestra.run.trial040.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T08:50:22.403 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T08:50:22.482 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T08:50:22.555 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:22.620 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T08:50:22.621 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T08:50:22.622 INFO:teuthology.orchestra.run.trial040.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T08:50:22.623 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T08:50:22.624 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T08:50:22.625 INFO:teuthology.orchestra.run.trial040.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T08:50:22.641 INFO:teuthology.orchestra.run.trial040.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T08:50:22.643 INFO:teuthology.orchestra.run.trial040.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T08:50:22.644 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T08:50:22.645 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T08:50:22.772 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T08:50:22.850 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T08:50:22.931 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T08:50:23.018 INFO:teuthology.orchestra.run.trial040.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T08:50:23.019 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T08:50:23.272 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T08:50:23.350 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T08:50:23.350 INFO:teuthology.orchestra.run.trial040.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T08:50:23.351 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T08:50:23.448 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T08:50:23.573 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T08:50:23.703 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T08:50:23.786 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T08:50:23.892 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T08:50:23.966 INFO:teuthology.orchestra.run.trial040.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T08:50:23.966 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:24.051 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T08:50:24.569 INFO:teuthology.orchestra.run.trial040.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T08:50:24.590 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:50:24.594 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T08:50:24.673 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T08:50:24.673 INFO:teuthology.orchestra.run.trial040.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T08:50:24.674 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T08:50:24.748 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T08:50:24.821 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:50:24.822 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T08:50:24.902 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T08:50:24.975 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T08:50:25.055 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T08:50:25.131 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T08:50:25.208 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T08:50:25.288 INFO:teuthology.orchestra.run.trial040.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T08:50:25.289 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T08:50:25.376 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T08:50:25.377 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T08:50:25.453 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T08:50:25.532 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T08:50:25.618 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T08:50:25.693 INFO:teuthology.orchestra.run.trial040.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T08:50:25.694 INFO:teuthology.orchestra.run.trial040.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T08:50:25.695 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T08:50:25.696 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T08:50:25.836 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T08:50:25.915 INFO:teuthology.orchestra.run.trial040.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T08:50:25.916 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T08:50:25.992 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:50:25.993 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T08:50:26.078 INFO:teuthology.orchestra.run.trial040.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T08:50:26.079 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T08:50:26.160 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T08:50:26.297 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T08:50:26.389 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T08:50:26.507 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T08:50:26.508 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:26.508 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:26.509 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T08:50:27.044 INFO:teuthology.orchestra.run.trial040.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T08:50:27.055 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.056 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.056 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.057 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.058 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.127 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T08:50:27.127 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T08:50:27.531 INFO:teuthology.orchestra.run.trial040.stdout:Setting up libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.532 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.533 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.534 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.534 INFO:teuthology.orchestra.run.trial040.stdout:Setting up rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.535 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.536 INFO:teuthology.orchestra.run.trial040.stdout:Setting up python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.537 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:27.565 INFO:teuthology.orchestra.run.trial040.stdout:Adding group ceph....done 2026-02-17T08:50:27.600 INFO:teuthology.orchestra.run.trial040.stdout:Adding system user ceph....done 2026-02-17T08:50:27.611 INFO:teuthology.orchestra.run.trial040.stdout:Setting system user ceph properties....done 2026-02-17T08:50:27.617 INFO:teuthology.orchestra.run.trial040.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T08:50:27.700 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T08:50:27.984 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T08:50:28.391 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:28.392 INFO:teuthology.orchestra.run.trial040.stdout:Setting up radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:28.669 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:50:28.670 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:50:29.062 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:29.179 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T08:50:29.551 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:29.611 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T08:50:29.611 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T08:50:29.998 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:30.077 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T08:50:30.077 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T08:50:30.474 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:30.558 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T08:50:30.558 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T08:50:30.961 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:30.962 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:30.973 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:31.043 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T08:50:31.043 INFO:teuthology.orchestra.run.trial040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T08:50:31.458 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:31.469 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:31.470 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:31.480 INFO:teuthology.orchestra.run.trial040.stdout:Setting up ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:50:31.593 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T08:50:31.600 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T08:50:31.617 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T08:50:31.703 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T08:50:32.179 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:32.179 INFO:teuthology.orchestra.run.trial040.stdout:Running kernel seems to be up-to-date. 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout:The processor microcode seems to be up-to-date. 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout:No services need to be restarted. 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout:No containers need to be restarted. 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout:No user sessions are running outdated binaries. 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:32.180 INFO:teuthology.orchestra.run.trial040.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T08:50:32.834 INFO:teuthology.orchestra.run.trial040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T08:50:32.839 DEBUG:teuthology.parallel:result is None 2026-02-17T08:50:32.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:50:32.964 DEBUG:teuthology.orchestra.run.trial040:> dpkg-query -W -f '${Version}' ceph 2026-02-17T08:50:32.974 INFO:teuthology.orchestra.run.trial040.stdout:19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:50:32.974 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:50:32.974 INFO:teuthology.task.install:The correct ceph version 19.2.3-705-g04cf6dd4-1jammy is installed. 2026-02-17T08:50:32.976 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T08:50:32.976 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:32.976 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T08:50:33.032 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T08:50:33.032 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:33.032 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T08:50:33.088 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T08:50:33.140 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T08:50:33.140 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:33.140 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T08:50:33.189 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T08:50:33.239 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T08:50:33.239 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:33.239 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T08:50:33.289 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T08:50:33.340 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T08:50:33.424 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T08:50:33.424 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 777 /var/log/ceph 2026-02-17T08:50:33.432 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T08:50:33.432 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T08:50:33.483 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T08:50:33.483 DEBUG:teuthology.orchestra.run.trial040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T08:50:33.539 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T08:50:33.539 INFO:tasks.ceph:config {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'mon election default strategy': 3, 'osd client message cap': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0'}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 16, 'osd op queue': 'mclock_scheduler'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T08:50:33.539 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51191', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51191', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'mon election default strategy': 3, 'osd client message cap': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0'}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 16, 'osd op queue': 'mclock_scheduler'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMsO5PfMNZGnwOsbh5AMNpQwgeSTrSLAgF520rAYtG4nxN8deHW8+7D0mTfrajlgW8NUH1Xe0+jZbhVpanXIC+E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'fs': 'xfs', 'log-ignorelist': ['\\(PG_', '\\(OSD_', '\\(OBJECT_', 'overall HEALTH', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'wait-for-scrub': False, 'conf': {'global': {'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'auth supported': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'mon election default strategy': 3, 'osd client message cap': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': '0/0', 'debug ms': '0/0', 'debug paxos': '0/0'}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 16, 'osd op queue': 'mclock_scheduler'}}, 'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'cluster': 'ceph'}}, {'ssh_keys': None}, {'cbt': {'benchmarks': {'radosbench': {'concurrent_ops': 4, 'concurrent_procs': 2, 'op_size': [4096], 'pool_monitoring_list': ['collectl'], 'pool_profile': 'replicated', 'run_monitoring_list': ['collectl'], 'time': 60, 'write_only': True}}, 'cluster': {'iterations': 1, 'osds_per_node': 3, 'pool_profiles': {'replicated': {'pg_size': 256, 'pgp_size': 256, 'replication': 'replicated'}}, 'user': 'ubuntu'}, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'ceph-osd.*.pid'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T08:50:33.539 DEBUG:teuthology.orchestra.run.trial040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T08:50:33.580 DEBUG:teuthology.orchestra.run.trial040:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T08:50:33.628 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:33.628 DEBUG:teuthology.orchestra.run.trial040:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T08:50:33.672 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T08:50:33.673 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_1 2026-02-17T08:50:33.720 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T08:50:33.720 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:50:33.720 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 906 Links: 1 2026-02-17T08:50:33.720 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:50:33.720 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 08:49:50.433256331 +0000 2026-02-17T08:50:33.721 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 08:49:50.257261938 +0000 2026-02-17T08:50:33.721 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 08:49:50.257261938 +0000 2026-02-17T08:50:33.721 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-17T08:50:33.721 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T08:50:33.771 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T08:50:33.771 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T08:50:33.771 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000190401 s, 2.7 MB/s 2026-02-17T08:50:33.772 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T08:50:33.821 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_2 2026-02-17T08:50:33.868 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T08:50:33.868 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:50:33.868 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 940 Links: 1 2026-02-17T08:50:33.868 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:50:33.868 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 08:49:50.753246134 +0000 2026-02-17T08:50:33.868 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 08:49:50.577251741 +0000 2026-02-17T08:50:33.869 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 08:49:50.577251741 +0000 2026-02-17T08:50:33.869 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-17T08:50:33.869 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T08:50:33.919 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T08:50:33.919 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T08:50:33.919 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000169322 s, 3.0 MB/s 2026-02-17T08:50:33.921 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T08:50:33.970 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_3 2026-02-17T08:50:34.016 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T08:50:34.016 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:50:34.016 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 952 Links: 1 2026-02-17T08:50:34.016 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:50:34.017 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 08:49:51.105234919 +0000 2026-02-17T08:50:34.017 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 08:49:50.909241163 +0000 2026-02-17T08:50:34.017 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 08:49:50.909241163 +0000 2026-02-17T08:50:34.017 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-17T08:50:34.017 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T08:50:34.067 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T08:50:34.067 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T08:50:34.067 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000175643 s, 2.9 MB/s 2026-02-17T08:50:34.068 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T08:50:34.117 DEBUG:teuthology.orchestra.run.trial040:> stat /dev/vg_nvme/lv_4 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout:Device: 5h/5d Inode: 976 Links: 1 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout:Access: 2026-02-17 08:49:51.449223957 +0000 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout:Modify: 2026-02-17 08:49:51.273229565 +0000 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout:Change: 2026-02-17 08:49:51.273229565 +0000 2026-02-17T08:50:34.164 INFO:teuthology.orchestra.run.trial040.stdout: Birth: - 2026-02-17T08:50:34.165 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T08:50:34.211 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records in 2026-02-17T08:50:34.211 INFO:teuthology.orchestra.run.trial040.stderr:1+0 records out 2026-02-17T08:50:34.211 INFO:teuthology.orchestra.run.trial040.stderr:512 bytes copied, 0.000175533 s, 2.9 MB/s 2026-02-17T08:50:34.213 DEBUG:teuthology.orchestra.run.trial040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T08:50:34.261 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:50:34.261 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T08:50:34.262 INFO:tasks.ceph:Generating config... 2026-02-17T08:50:34.264 INFO:tasks.ceph:[global] auth client required = none 2026-02-17T08:50:34.264 INFO:tasks.ceph:[global] auth cluster required = none 2026-02-17T08:50:34.264 INFO:tasks.ceph:[global] auth service required = none 2026-02-17T08:50:34.264 INFO:tasks.ceph:[global] auth supported = none 2026-02-17T08:50:34.264 INFO:tasks.ceph:[global] debug asok = 0/0 2026-02-17T08:50:34.264 INFO:tasks.ceph:[global] debug auth = 0/0 2026-02-17T08:50:34.264 INFO:tasks.ceph:[global] debug bdev = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug bluefs = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug bluestore = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug buffer = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug civetweb = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug client = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug compressor = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug context = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug crush = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug crypto = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug dpdk = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug eventtrace = 0/0 2026-02-17T08:50:34.265 INFO:tasks.ceph:[global] debug filer = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug filestore = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug finisher = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug fuse = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug heartbeatmap = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug javaclient = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug journal = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug journaler = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug kstore = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug lockdep = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug mds = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug mds balancer = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug mds locker = 0/0 2026-02-17T08:50:34.266 INFO:tasks.ceph:[global] debug mds log = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug mds log expire = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug mds migrator = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug memdb = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug mgr = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug mgrc = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug mon = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug monc = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug ms = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug objclass = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug objectcacher = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug objecter = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug optracker = 0/0 2026-02-17T08:50:34.267 INFO:tasks.ceph:[global] debug osd = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug paxos = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug perfcounter = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rados = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rbd = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rbd mirror = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rbd replay = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug refs = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rgw = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rgw lifecycle = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rgw notification = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rgw sync = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug rocksdb = 0/0 2026-02-17T08:50:34.268 INFO:tasks.ceph:[global] debug striper = 0/0 2026-02-17T08:50:34.269 INFO:tasks.ceph:[global] debug throttle = 0/0 2026-02-17T08:50:34.269 INFO:tasks.ceph:[global] debug timer = 0/0 2026-02-17T08:50:34.269 INFO:tasks.ceph:[global] debug tp = 0/0 2026-02-17T08:50:34.269 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T08:50:34.269 INFO:tasks.ceph:[global] osd client message cap = 5000 2026-02-17T08:50:34.269 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T08:50:34.269 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T08:50:34.269 INFO:tasks.ceph:[mon] debug mon = 0/0 2026-02-17T08:50:34.269 INFO:tasks.ceph:[mon] debug ms = 0/0 2026-02-17T08:50:34.269 INFO:tasks.ceph:[mon] debug paxos = 0/0 2026-02-17T08:50:34.269 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T08:50:34.269 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T08:50:34.269 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] debug filestore = 0/0 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] debug journal = 0/0 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] debug ms = 0/0 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] debug osd = 0/0 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T08:50:34.270 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T08:50:34.271 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T08:50:34.271 INFO:tasks.ceph:[osd] osd op num shards = 1 2026-02-17T08:50:34.271 INFO:tasks.ceph:[osd] osd op num threads per shard = 16 2026-02-17T08:50:34.271 INFO:tasks.ceph:[osd] osd op queue = mclock_scheduler 2026-02-17T08:50:34.271 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T08:50:34.271 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T08:50:34.320 INFO:teuthology.orchestra.run.trial040.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T08:50:34.323 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T08:50:34.382 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T08:50:34.431 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.40')] 2026-02-17T08:50:34.431 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'none', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.40', 'auth client required': 'none', 'auth cluster required': 'none', 'auth service required': 'none', 'debug asok': '0/0', 'debug auth': '0/0', 'debug bdev': '0/0', 'debug bluefs': '0/0', 'debug bluestore': '0/0', 'debug buffer': '0/0', 'debug civetweb': '0/0', 'debug client': '0/0', 'debug compressor': '0/0', 'debug context': '0/0', 'debug crush': '0/0', 'debug crypto': '0/0', 'debug dpdk': '0/0', 'debug eventtrace': '0/0', 'debug filer': '0/0', 'debug filestore': '0/0', 'debug finisher': '0/0', 'debug fuse': '0/0', 'debug heartbeatmap': '0/0', 'debug javaclient': '0/0', 'debug journal': '0/0', 'debug journaler': '0/0', 'debug kstore': '0/0', 'debug lockdep': '0/0', 'debug mds': '0/0', 'debug mds balancer': '0/0', 'debug mds locker': '0/0', 'debug mds log': '0/0', 'debug mds log expire': '0/0', 'debug mds migrator': '0/0', 'debug memdb': '0/0', 'debug mgr': '0/0', 'debug mgrc': '0/0', 'debug mon': '0/0', 'debug monc': '0/0', 'debug ms': '0/0', 'debug objclass': '0/0', 'debug objectcacher': '0/0', 'debug objecter': '0/0', 'debug optracker': '0/0', 'debug osd': '0/0', 'debug paxos': '0/0', 'debug perfcounter': '0/0', 'debug rados': '0/0', 'debug rbd': '0/0', 'debug rbd mirror': '0/0', 'debug rbd replay': '0/0', 'debug refs': '0/0', 'debug rgw': '0/0', 'debug rgw lifecycle': '0/0', 'debug rgw notification': '0/0', 'debug rgw sync': '0/0', 'debug rocksdb': '0/0', 'debug striper': '0/0', 'debug throttle': '0/0', 'debug timer': '0/0', 'debug tp': '0/0', 'mon election default strategy': 3, 'osd client message cap': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': '0/0', 'debug journal': '0/0', 'debug ms': '0/0', 'debug osd': '0/0', 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op num shards': 1, 'osd op num threads per shard': 16, 'osd op queue': 'mclock_scheduler'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': '0/0', 'debug mon': '0/0', 'debug paxos': '0/0', 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T08:50:34.431 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:34.431 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T08:50:34.476 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.40 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:50:34.532 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: generated fsid 79e32f0b-1443-49aa-900d-e6a41aae3578 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:setting min_mon_release = quincy 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:epoch 0 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:fsid 79e32f0b-1443-49aa-900d-e6a41aae3578 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:last_changed 2026-02-17T08:50:34.530329+0000 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:created 2026-02-17T08:50:34.530329+0000 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:min_mon_release 17 (quincy) 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:election_strategy: 3 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:0: [v2:10.20.193.40:3300/0,v1:10.20.193.40:6789/0] mon.a 2026-02-17T08:50:34.533 INFO:teuthology.orchestra.run.trial040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T08:50:34.535 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T08:50:34.579 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 79e32f0b-1443-49aa-900d-e6a41aae3578... 2026-02-17T08:50:34.581 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T08:50:34.639 INFO:teuthology.orchestra.run.trial040.stdout:[global] 2026-02-17T08:50:34.639 INFO:teuthology.orchestra.run.trial040.stdout: chdir = "" 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: auth supported = none 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: filestore xattr use omap = true 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: mon clock drift allowed = 1.000 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: osd crush chooseleaf type = 0 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: auth debug = true 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.640 INFO:teuthology.orchestra.run.trial040.stdout: ms die on old message = true 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: ms die on bug = true 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: mon pg warn max object skew = 0 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: osd pool default size = 2 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: mon osd allow primary affinity = true 2026-02-17T08:50:34.641 INFO:teuthology.orchestra.run.trial040.stdout: mon osd allow pg remap = true 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on legacy crush tunables = false 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on crush straw calc version zero = false 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on no sortbitwise = false 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on osd down out interval zero = false 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon warn on too few osds = false 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: mon_allow_pool_size_one = true 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.642 INFO:teuthology.orchestra.run.trial040.stdout: osd default data pool replay window = 5 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: mon allow pool delete = true 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: mon cluster log file level = debug 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: debug asserts on shutdown = true 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: mon health detail to clog = false 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: mon host = 10.20.193.40 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: auth client required = none 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: auth cluster required = none 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: auth service required = none 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: debug asok = 0/0 2026-02-17T08:50:34.643 INFO:teuthology.orchestra.run.trial040.stdout: debug auth = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug bdev = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug bluefs = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug bluestore = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug buffer = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug civetweb = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug client = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug compressor = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug context = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug crush = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug crypto = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug dpdk = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug eventtrace = 0/0 2026-02-17T08:50:34.644 INFO:teuthology.orchestra.run.trial040.stdout: debug filer = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug filestore = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug finisher = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug fuse = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug heartbeatmap = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug javaclient = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug journal = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug journaler = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug kstore = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug lockdep = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug mds = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug mds balancer = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug mds locker = 0/0 2026-02-17T08:50:34.645 INFO:teuthology.orchestra.run.trial040.stdout: debug mds log = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug mds log expire = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug mds migrator = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug memdb = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug mgr = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug mgrc = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug mon = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug monc = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug objclass = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug objectcacher = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug objecter = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug optracker = 0/0 2026-02-17T08:50:34.646 INFO:teuthology.orchestra.run.trial040.stdout: debug osd = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug paxos = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug perfcounter = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rados = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rbd = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rbd mirror = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rbd replay = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug refs = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rgw = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rgw lifecycle = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rgw notification = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rgw sync = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug rocksdb = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug striper = 0/0 2026-02-17T08:50:34.647 INFO:teuthology.orchestra.run.trial040.stdout: debug throttle = 0/0 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: debug timer = 0/0 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: debug tp = 0/0 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: mon election default strategy = 3 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: osd client message cap = 5000 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: fsid = 79e32f0b-1443-49aa-900d-e6a41aae3578 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout:[osd] 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: osd journal size = 100 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: osd scrub load threshold = 5.0 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: osd scrub max interval = 600 2026-02-17T08:50:34.648 INFO:teuthology.orchestra.run.trial040.stdout: osd mclock profile = high_recovery_ops 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd recover clone overlap = true 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd recovery max chunk = 1048576 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd debug shutdown = true 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd debug op order = true 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd debug verify stray on activate = true 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd debug trim objects = true 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd open classes on start = true 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd debug pg log writeout = true 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.649 INFO:teuthology.orchestra.run.trial040.stdout: osd deep scrub update digest min age = 30 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: osd map max advance = 10 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: journal zero on create = true 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: filestore ondisk finisher threads = 3 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: filestore apply finisher threads = 3 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: bdev debug aio = true 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: osd debug misdirected ops = true 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: bdev async discard = True 2026-02-17T08:50:34.650 INFO:teuthology.orchestra.run.trial040.stdout: bdev enable discard = True 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: bluestore allocator = bitmap 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: bluestore block size = 96636764160 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: bluestore fsck on mount = True 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: debug bluefs = 20 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: debug bluestore = 20 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: debug filestore = 0/0 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: debug journal = 0/0 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 0/0 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: debug osd = 0/0 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: debug rocksdb = 10 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: mon osd full ratio = 0.9 2026-02-17T08:50:34.651 INFO:teuthology.orchestra.run.trial040.stdout: mon osd nearfull ratio = 0.8 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: osd failsafe full ratio = 0.95 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: osd objectstore = bluestore 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: osd op num shards = 1 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: osd op num threads per shard = 16 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: osd op queue = mclock_scheduler 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout:[mgr] 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 1 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: debug mgr = 20 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: debug mon = 20 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: debug auth = 20 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:50:34.652 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: mgr/telemetry/nag = false 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout:[mon] 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: debug ms = 0/0 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: debug mon = 0/0 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: debug paxos = 0/0 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: debug auth = 20 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: mon data avail warn = 5 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: mon mgr mkfs grace = 240 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: mon osd reporter subtree level = osd 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: mon osd prime pg temp = true 2026-02-17T08:50:34.653 INFO:teuthology.orchestra.run.trial040.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T08:50:34.654 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: # 1m isn't quite enough 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: mon_down_mkfs_grace = 2m 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: mon_warn_on_filestore_osds = false 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout:[client] 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: rgw cache enabled = true 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: rgw enable ops log = true 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: rgw enable usage log = true 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T08:50:34.655 INFO:teuthology.orchestra.run.trial040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T08:50:34.656 INFO:teuthology.orchestra.run.trial040.stdout:[mon.a] 2026-02-17T08:50:34.657 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T08:50:34.657 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T08:50:34.726 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T08:50:34.727 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:34.727 DEBUG:teuthology.orchestra.run.trial040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T08:50:34.772 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:34.773 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T08:50:34.822 INFO:tasks.ceph:Sending monmap to node ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:50:34.822 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:34.822 DEBUG:teuthology.orchestra.run.trial040:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T08:50:34.822 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T08:50:34.878 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:34.878 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:50:34.924 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T08:50:34.925 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T08:50:34.925 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T08:50:34.996 INFO:teuthology.orchestra.run.trial040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T08:50:34.999 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T08:50:34.999 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T08:50:34.999 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T08:50:35.062 INFO:teuthology.orchestra.run.trial040.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T08:50:35.070 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T08:50:35.070 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T08:50:35.071 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T08:50:35.120 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:50:35.120 INFO:tasks.ceph:role: osd.0 2026-02-17T08:50:35.120 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:50:35.120 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T08:50:35.169 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T08:50:35.169 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T08:50:35.170 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T08:50:35.744 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-17T08:50:35.746 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-17T08:50:35.746 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T08:50:35.805 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T08:50:35.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:50:35.854 INFO:teuthology.orchestra.run.trial040.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T08:50:35.855 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T08:50:35.904 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:50:35.905 INFO:tasks.ceph:role: osd.1 2026-02-17T08:50:35.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:50:35.905 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T08:50:35.957 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T08:50:35.958 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T08:50:36.523 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-17T08:50:36.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-17T08:50:36.525 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T08:50:36.583 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T08:50:36.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:50:36.630 INFO:teuthology.orchestra.run.trial040.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T08:50:36.631 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T08:50:36.680 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:50:36.680 INFO:tasks.ceph:role: osd.2 2026-02-17T08:50:36.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:50:36.680 DEBUG:teuthology.orchestra.run.trial040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T08:50:36.730 INFO:teuthology.orchestra.run.trial040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T08:50:36.730 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T08:50:36.730 INFO:teuthology.orchestra.run.trial040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T08:50:36.730 INFO:teuthology.orchestra.run.trial040.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T08:50:36.730 INFO:teuthology.orchestra.run.trial040.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T08:50:36.730 INFO:teuthology.orchestra.run.trial040.stdout: = sunit=0 swidth=0 blks 2026-02-17T08:50:36.730 INFO:teuthology.orchestra.run.trial040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T08:50:36.731 INFO:teuthology.orchestra.run.trial040.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T08:50:36.731 INFO:teuthology.orchestra.run.trial040.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T08:50:36.731 INFO:teuthology.orchestra.run.trial040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T08:50:37.296 INFO:teuthology.orchestra.run.trial040.stdout:Discarding blocks...Done. 2026-02-17T08:50:37.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial040.front.sepia.ceph.com -o noatime 2026-02-17T08:50:37.298 DEBUG:teuthology.orchestra.run.trial040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T08:50:37.357 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T08:50:37.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:50:37.411 INFO:teuthology.orchestra.run.trial040.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T08:50:37.411 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:50:37.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:37.468+0000 7f191ac108c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T08:50:37.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:37.468+0000 7f191ac108c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T08:50:37.474 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:37.468+0000 7f191ac108c0 -1 bdev(0x55c28243b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T08:50:37.475 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:37.468+0000 7f191ac108c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T08:50:41.536 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T08:50:41.589 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:50:41.652 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:41.648+0000 7ff23a7678c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T08:50:41.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:41.648+0000 7ff23a7678c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T08:50:41.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:41.648+0000 7ff23a7678c0 -1 bdev(0x559f56c81800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T08:50:41.653 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:41.648+0000 7ff23a7678c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T08:50:45.729 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T08:50:45.780 DEBUG:teuthology.orchestra.run.trial040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:50:45.844 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:45.836+0000 7f4e82fb28c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T08:50:45.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:45.840+0000 7f4e82fb28c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T08:50:45.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:45.840+0000 7f4e82fb28c0 -1 bdev(0x55ad69b37800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T08:50:45.845 INFO:teuthology.orchestra.run.trial040.stderr:2026-02-17T08:50:45.840+0000 7f4e82fb28c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T08:50:49.919 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T08:50:49.969 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T08:50:49.970 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:49.970 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T08:50:50.021 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:50.021 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T08:50:50.073 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:50.073 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T08:50:50.125 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:50.125 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T08:50:50.177 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:50.177 DEBUG:teuthology.orchestra.run.trial040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T08:50:50.224 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T08:50:50.225 DEBUG:teuthology.orchestra.run.trial040:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T08:50:50.275 INFO:teuthology.orchestra.run.trial040.stdout:[mgr.x] 2026-02-17T08:50:50.275 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDaK5RpgFU/OxAAqU4gHexq37+hhxShIfLwZA== 2026-02-17T08:50:50.275 INFO:teuthology.orchestra.run.trial040.stdout:[osd.0] 2026-02-17T08:50:50.275 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDdK5RpZCUeHBAAcVE2VnLF47XuPlgQFScqJA== 2026-02-17T08:50:50.275 INFO:teuthology.orchestra.run.trial040.stdout:[osd.1] 2026-02-17T08:50:50.275 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDhK5RpLjvHJhAAGCMp5pMMhs1PmRttAQ0c5Q== 2026-02-17T08:50:50.276 INFO:teuthology.orchestra.run.trial040.stdout:[osd.2] 2026-02-17T08:50:50.276 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDlK5Rp/IsxMhAAR2vb9O6D5QavnfZGtwMMTA== 2026-02-17T08:50:50.276 INFO:teuthology.orchestra.run.trial040.stdout:[client.0] 2026-02-17T08:50:50.276 INFO:teuthology.orchestra.run.trial040.stdout: key = AQDbK5RpW/+cAxAA9+WIZMWYquLF0lRu+lpNrA== 2026-02-17T08:50:50.277 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T08:50:50.342 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T08:50:50.404 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T08:50:50.469 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T08:50:50.534 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T08:50:50.598 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T08:50:50.598 DEBUG:teuthology.orchestra.run.trial040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T08:50:50.648 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T08:50:50.713 DEBUG:teuthology.orchestra.run.trial040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T08:50:50.764 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:50:50.812 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T08:50:50.812 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T08:50:50.812 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T08:50:50.853 INFO:tasks.ceph.mon.a:Started 2026-02-17T08:50:50.854 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T08:50:50.854 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T08:50:50.854 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T08:50:50.856 INFO:tasks.ceph.mgr.x:Started 2026-02-17T08:50:50.856 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T08:50:50.856 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T08:50:50.976 INFO:teuthology.orchestra.run.trial040.stderr:adjusted tunables profile to default 2026-02-17T08:50:50.987 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T08:50:50.987 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T08:50:50.987 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:50.987 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T08:50:50.996 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:50.997 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T08:50:51.049 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:50:51.049 DEBUG:teuthology.orchestra.run.trial040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T08:50:51.101 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new 183f85ed-8961-4d3a-b13f-07857b55e0d2 0 2026-02-17T08:50:51.165 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.160+0000 7ff0db6c6280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T08:50:51.190 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.184+0000 7ff0db6c6280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T08:50:51.226 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.220+0000 7ff0db6c6280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T08:50:51.238 INFO:teuthology.orchestra.run.trial040.stdout:0 2026-02-17T08:50:51.248 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new 64e79af8-ac6e-4be8-8ddd-dd0e225a3848 1 2026-02-17T08:50:51.316 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.308+0000 7ff0db6c6280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T08:50:51.396 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.388+0000 7ff0db6c6280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:50:51.401 INFO:teuthology.orchestra.run.trial040.stdout:1 2026-02-17T08:50:51.410 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd new 11142e91-5fcf-49cd-9e9f-a96af3fd2f66 2 2026-02-17T08:50:51.432 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.424+0000 7ff0db6c6280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T08:50:51.507 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.500+0000 7ff0db6c6280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T08:50:51.530 INFO:teuthology.orchestra.run.trial040.stdout:2 2026-02-17T08:50:51.539 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T08:50:51.539 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T08:50:51.541 INFO:tasks.ceph.osd.0:Started 2026-02-17T08:50:51.541 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T08:50:51.541 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T08:50:51.543 INFO:tasks.ceph.osd.1:Started 2026-02-17T08:50:51.543 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T08:50:51.543 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T08:50:51.546 INFO:tasks.ceph.osd.2:Started 2026-02-17T08:50:51.546 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T08:50:51.647 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:50:51.647 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":5,"fsid":"79e32f0b-1443-49aa-900d-e6a41aae3578","created":"2026-02-17T08:50:50.935368+0000","modified":"2026-02-17T08:50:51.527267+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T08:50:51.527267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"183f85ed-8961-4d3a-b13f-07857b55e0d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"64e79af8-ac6e-4be8-8ddd-dd0e225a3848","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"11142e91-5fcf-49cd-9e9f-a96af3fd2f66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:50:51.657 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T08:50:51.657 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T08:50:51.683 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.676+0000 7ff0db6c6280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T08:50:51.959 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T08:50:51.989 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:51.984+0000 7ff0db6c6280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T08:50:52.043 INFO:teuthology.misc.health.trial040.stdout: 2026-02-17T08:50:52.043 INFO:teuthology.misc.health.trial040.stdout:{"epoch":5,"fsid":"79e32f0b-1443-49aa-900d-e6a41aae3578","created":"2026-02-17T08:50:50.935368+0000","modified":"2026-02-17T08:50:51.527267+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T08:50:51.527267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"183f85ed-8961-4d3a-b13f-07857b55e0d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"64e79af8-ac6e-4be8-8ddd-dd0e225a3848","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"11142e91-5fcf-49cd-9e9f-a96af3fd2f66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:50:52.051 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T08:50:52.083 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.076+0000 7ff0db6c6280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T08:50:52.111 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.104+0000 7ff0db6c6280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T08:50:52.143 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.136+0000 7ff0db6c6280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T08:50:52.187 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.180+0000 7ff0db6c6280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T08:50:52.290 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.284+0000 7ff0db6c6280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:50:52.489 INFO:tasks.ceph.mgr.x.trial040.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-17T08:50:52.669 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.660+0000 7ff0db6c6280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T08:50:52.701 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.692+0000 7ff0db6c6280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T08:50:52.797 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.792+0000 7ff0db6c6280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T08:50:52.821 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.816+0000 7ff0db6c6280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T08:50:52.848 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.840+0000 7ff0db6c6280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T08:50:52.876 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.868+0000 7ff0db6c6280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T08:50:53.000 INFO:tasks.ceph.mgr.x.trial040.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T08:50:53.001 INFO:tasks.ceph.mgr.x.trial040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T08:50:53.001 INFO:tasks.ceph.mgr.x.trial040.stderr: from numpy import show_config as show_numpy_config 2026-02-17T08:50:53.007 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:52.999+0000 7ff0db6c6280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T08:50:53.034 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:53.027+0000 7ff0db6c6280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T08:50:53.074 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:53.067+0000 7ff0db6c6280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T08:50:53.350 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T08:50:53.343+0000 7f71cb77b8c0 -1 Falling back to public interface 2026-02-17T08:50:53.598 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T08:50:53.591+0000 7f2a012ae8c0 -1 Falling back to public interface 2026-02-17T08:50:53.621 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T08:50:53.615+0000 7f73fe5688c0 -1 Falling back to public interface 2026-02-17T08:50:54.100 INFO:tasks.ceph.mgr.x.trial040.stderr:2026-02-17T08:50:54.091+0000 7feffa211640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T08:50:56.229 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T08:50:56.223+0000 7f71cb77b8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:50:56.399 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T08:50:56.391+0000 7f2a012ae8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:50:56.498 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T08:50:56.491+0000 7f73fe5688c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:50:58.354 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T08:50:58.492 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T08:50:58.483+0000 7f73f9cee640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T08:50:58.514 INFO:teuthology.misc.health.trial040.stdout: 2026-02-17T08:50:58.514 INFO:teuthology.misc.health.trial040.stdout:{"epoch":7,"fsid":"79e32f0b-1443-49aa-900d-e6a41aae3578","created":"2026-02-17T08:50:50.935368+0000","modified":"2026-02-17T08:50:58.096675+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T08:50:51.527267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"183f85ed-8961-4d3a-b13f-07857b55e0d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"64e79af8-ac6e-4be8-8ddd-dd0e225a3848","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"11142e91-5fcf-49cd-9e9f-a96af3fd2f66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:50:58.517 INFO:tasks.ceph.osd.2.trial040.stderr:2026-02-17T08:50:58.511+0000 7f73f5b3a640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:50:58.526 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T08:50:58.543 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T08:50:58.535+0000 7f71c6f01640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T08:50:58.547 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T08:50:58.539+0000 7f29fca34640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T08:50:58.569 INFO:tasks.ceph.osd.0.trial040.stderr:2026-02-17T08:50:58.563+0000 7f71c2d4d640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:50:58.573 INFO:tasks.ceph.osd.1.trial040.stderr:2026-02-17T08:50:58.567+0000 7f29f8880640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:51:04.829 DEBUG:teuthology.orchestra.run.trial040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T08:51:04.970 INFO:teuthology.misc.health.trial040.stdout: 2026-02-17T08:51:04.971 INFO:teuthology.misc.health.trial040.stdout:{"epoch":11,"fsid":"79e32f0b-1443-49aa-900d-e6a41aae3578","created":"2026-02-17T08:50:50.935368+0000","modified":"2026-02-17T08:51:04.109580+0000","last_up_change":"2026-02-17T08:50:59.490314+0000","last_in_change":"2026-02-17T08:50:51.527267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T08:51:01.131040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"183f85ed-8961-4d3a-b13f-07857b55e0d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6803","nonce":3134512181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6805","nonce":3134512181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6809","nonce":3134512181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6807","nonce":3134512181}]},"public_addr":"10.20.193.40:6803/3134512181","cluster_addr":"10.20.193.40:6805/3134512181","heartbeat_back_addr":"10.20.193.40:6809/3134512181","heartbeat_front_addr":"10.20.193.40:6807/3134512181","state":["exists","up"]},{"osd":1,"uuid":"64e79af8-ac6e-4be8-8ddd-dd0e225a3848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6811","nonce":1874078971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6813","nonce":1874078971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6817","nonce":1874078971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6815","nonce":1874078971}]},"public_addr":"10.20.193.40:6811/1874078971","cluster_addr":"10.20.193.40:6813/1874078971","heartbeat_back_addr":"10.20.193.40:6817/1874078971","heartbeat_front_addr":"10.20.193.40:6815/1874078971","state":["exists","up"]},{"osd":2,"uuid":"11142e91-5fcf-49cd-9e9f-a96af3fd2f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6819","nonce":249925878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6821","nonce":249925878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6825","nonce":249925878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6823","nonce":249925878}]},"public_addr":"10.20.193.40:6819/249925878","cluster_addr":"10.20.193.40:6821/249925878","heartbeat_back_addr":"10.20.193.40:6825/249925878","heartbeat_front_addr":"10.20.193.40:6823/249925878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:51:04.981 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T08:51:04.982 INFO:tasks.ceph:Creating RBD pool 2026-02-17T08:51:04.982 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T08:51:06.114 INFO:teuthology.orchestra.run.trial040.stderr:pool 'rbd' created 2026-02-17T08:51:06.130 DEBUG:teuthology.orchestra.run.trial040:> rbd --cluster ceph pool init rbd 2026-02-17T08:51:09.129 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T08:51:09.130 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T08:51:09.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T08:51:09.130 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T08:51:09.131 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T08:51:09.303 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:09.312 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6800","nonce":965573073},{"type":"v1","addr":"10.20.193.40:6801","nonce":965573073}]},"active_addr":"10.20.193.40:6801/965573073","active_change":"2026-02-17T08:50:53.091011+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":51616617}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":2608767262}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":322820709}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.40:0","nonce":3132624852}]}]} 2026-02-17T08:51:09.316 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T08:51:09.316 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T08:51:09.317 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T08:51:09.462 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:09.462 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":15,"fsid":"79e32f0b-1443-49aa-900d-e6a41aae3578","created":"2026-02-17T08:50:50.935368+0000","modified":"2026-02-17T08:51:09.117039+0000","last_up_change":"2026-02-17T08:50:59.490314+0000","last_in_change":"2026-02-17T08:50:51.527267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T08:51:01.131040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T08:51:05.126318+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"183f85ed-8961-4d3a-b13f-07857b55e0d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6803","nonce":3134512181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6805","nonce":3134512181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6809","nonce":3134512181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6807","nonce":3134512181}]},"public_addr":"10.20.193.40:6803/3134512181","cluster_addr":"10.20.193.40:6805/3134512181","heartbeat_back_addr":"10.20.193.40:6809/3134512181","heartbeat_front_addr":"10.20.193.40:6807/3134512181","state":["exists","up"]},{"osd":1,"uuid":"64e79af8-ac6e-4be8-8ddd-dd0e225a3848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6811","nonce":1874078971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6813","nonce":1874078971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6817","nonce":1874078971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6815","nonce":1874078971}]},"public_addr":"10.20.193.40:6811/1874078971","cluster_addr":"10.20.193.40:6813/1874078971","heartbeat_back_addr":"10.20.193.40:6817/1874078971","heartbeat_front_addr":"10.20.193.40:6815/1874078971","state":["exists","up"]},{"osd":2,"uuid":"11142e91-5fcf-49cd-9e9f-a96af3fd2f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6819","nonce":249925878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6821","nonce":249925878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6825","nonce":249925878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6823","nonce":249925878}]},"public_addr":"10.20.193.40:6819/249925878","cluster_addr":"10.20.193.40:6821/249925878","heartbeat_back_addr":"10.20.193.40:6825/249925878","heartbeat_front_addr":"10.20.193.40:6823/249925878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:51:09.472 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T08:51:09.472 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T08:51:09.615 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:09.615 INFO:teuthology.orchestra.run.trial040.stdout:{"epoch":15,"fsid":"79e32f0b-1443-49aa-900d-e6a41aae3578","created":"2026-02-17T08:50:50.935368+0000","modified":"2026-02-17T08:51:09.117039+0000","last_up_change":"2026-02-17T08:50:59.490314+0000","last_in_change":"2026-02-17T08:50:51.527267+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T08:51:01.131040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T08:51:05.126318+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"183f85ed-8961-4d3a-b13f-07857b55e0d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6802","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6803","nonce":3134512181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6804","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6805","nonce":3134512181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6808","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6809","nonce":3134512181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6806","nonce":3134512181},{"type":"v1","addr":"10.20.193.40:6807","nonce":3134512181}]},"public_addr":"10.20.193.40:6803/3134512181","cluster_addr":"10.20.193.40:6805/3134512181","heartbeat_back_addr":"10.20.193.40:6809/3134512181","heartbeat_front_addr":"10.20.193.40:6807/3134512181","state":["exists","up"]},{"osd":1,"uuid":"64e79af8-ac6e-4be8-8ddd-dd0e225a3848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6810","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6811","nonce":1874078971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6812","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6813","nonce":1874078971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6816","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6817","nonce":1874078971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6814","nonce":1874078971},{"type":"v1","addr":"10.20.193.40:6815","nonce":1874078971}]},"public_addr":"10.20.193.40:6811/1874078971","cluster_addr":"10.20.193.40:6813/1874078971","heartbeat_back_addr":"10.20.193.40:6817/1874078971","heartbeat_front_addr":"10.20.193.40:6815/1874078971","state":["exists","up"]},{"osd":2,"uuid":"11142e91-5fcf-49cd-9e9f-a96af3fd2f66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6818","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6819","nonce":249925878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6820","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6821","nonce":249925878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6824","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6825","nonce":249925878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.40:6822","nonce":249925878},{"type":"v1","addr":"10.20.193.40:6823","nonce":249925878}]},"public_addr":"10.20.193.40:6819/249925878","cluster_addr":"10.20.193.40:6821/249925878","heartbeat_back_addr":"10.20.193.40:6825/249925878","heartbeat_front_addr":"10.20.193.40:6823/249925878","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:51:09.625 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T08:51:09.626 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T08:51:09.627 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T08:51:09.706 INFO:teuthology.orchestra.run.trial040.stdout:34359738371 2026-02-17T08:51:09.706 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T08:51:09.708 INFO:teuthology.orchestra.run.trial040.stdout:34359738371 2026-02-17T08:51:09.708 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T08:51:09.709 INFO:teuthology.orchestra.run.trial040.stdout:34359738372 2026-02-17T08:51:09.710 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T08:51:09.889 INFO:teuthology.orchestra.run.trial040.stdout:34359738370 2026-02-17T08:51:09.894 INFO:teuthology.orchestra.run.trial040.stdout:34359738370 2026-02-17T08:51:09.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.0 2026-02-17T08:51:09.900 INFO:teuthology.orchestra.run.trial040.stdout:34359738371 2026-02-17T08:51:09.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.1 2026-02-17T08:51:09.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T08:51:10.901 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T08:51:10.906 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T08:51:10.912 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T08:51:11.052 INFO:teuthology.orchestra.run.trial040.stdout:34359738370 2026-02-17T08:51:11.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.0 2026-02-17T08:51:11.087 INFO:teuthology.orchestra.run.trial040.stdout:34359738370 2026-02-17T08:51:11.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.1 2026-02-17T08:51:11.100 INFO:teuthology.orchestra.run.trial040.stdout:34359738371 2026-02-17T08:51:11.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T08:51:12.065 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T08:51:12.101 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T08:51:12.112 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T08:51:12.223 INFO:teuthology.orchestra.run.trial040.stdout:34359738372 2026-02-17T08:51:12.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738372 for osd.0 2026-02-17T08:51:12.235 DEBUG:teuthology.parallel:result is None 2026-02-17T08:51:12.250 INFO:teuthology.orchestra.run.trial040.stdout:34359738372 2026-02-17T08:51:12.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738372 for osd.1 2026-02-17T08:51:12.262 DEBUG:teuthology.parallel:result is None 2026-02-17T08:51:12.296 INFO:teuthology.orchestra.run.trial040.stdout:34359738373 2026-02-17T08:51:12.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.2 2026-02-17T08:51:12.307 DEBUG:teuthology.parallel:result is None 2026-02-17T08:51:12.307 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T08:51:12.307 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:51:12.487 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:12.488 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T08:51:12.496 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-17T08:51:11.095385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90768,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024752,"statfs":{"total":289910292480,"available":289817346048,"internally_reserved":0,"allocated":1581056,"data_stored":1291889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.983798"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121403+0000","last_change":"2026-02-17T08:51:09.121403+0000","last_active":"2026-02-17T08:51:09.121403+0000","last_peered":"2026-02-17T08:51:09.121403+0000","last_clean":"2026-02-17T08:51:09.121403+0000","last_became_active":"2026-02-17T08:51:07.118605+0000","last_became_peered":"2026-02-17T08:51:07.118605+0000","last_unstale":"2026-02-17T08:51:09.121403+0000","last_undegraded":"2026-02-17T08:51:09.121403+0000","last_fullsized":"2026-02-17T08:51:09.121403+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:00:25.446127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000263465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121548+0000","last_change":"2026-02-17T08:51:09.121548+0000","last_active":"2026-02-17T08:51:09.121548+0000","last_peered":"2026-02-17T08:51:09.121548+0000","last_clean":"2026-02-17T08:51:09.121548+0000","last_became_active":"2026-02-17T08:51:07.118607+0000","last_became_peered":"2026-02-17T08:51:07.118607+0000","last_unstale":"2026-02-17T08:51:09.121548+0000","last_undegraded":"2026-02-17T08:51:09.121548+0000","last_fullsized":"2026-02-17T08:51:09.121548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:28:06.647419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038716299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121748+0000","last_change":"2026-02-17T08:51:09.121748+0000","last_active":"2026-02-17T08:51:09.121748+0000","last_peered":"2026-02-17T08:51:09.121748+0000","last_clean":"2026-02-17T08:51:09.121748+0000","last_became_active":"2026-02-17T08:51:07.118474+0000","last_became_peered":"2026-02-17T08:51:07.118474+0000","last_unstale":"2026-02-17T08:51:09.121748+0000","last_undegraded":"2026-02-17T08:51:09.121748+0000","last_fullsized":"2026-02-17T08:51:09.121748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:21:06.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056687299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121814+0000","last_change":"2026-02-17T08:51:09.121814+0000","last_active":"2026-02-17T08:51:09.121814+0000","last_peered":"2026-02-17T08:51:09.121814+0000","last_clean":"2026-02-17T08:51:09.121814+0000","last_became_active":"2026-02-17T08:51:07.118372+0000","last_became_peered":"2026-02-17T08:51:07.118372+0000","last_unstale":"2026-02-17T08:51:09.121814+0000","last_undegraded":"2026-02-17T08:51:09.121814+0000","last_fullsized":"2026-02-17T08:51:09.121814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:26:12.151171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060597500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.120839+0000","last_change":"2026-02-17T08:51:09.119812+0000","last_active":"2026-02-17T08:51:09.120839+0000","last_peered":"2026-02-17T08:51:09.120839+0000","last_clean":"2026-02-17T08:51:09.120839+0000","last_became_active":"2026-02-17T08:51:07.119342+0000","last_became_peered":"2026-02-17T08:51:07.119342+0000","last_unstale":"2026-02-17T08:51:09.120839+0000","last_undegraded":"2026-02-17T08:51:09.120839+0000","last_fullsized":"2026-02-17T08:51:09.120839+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:40:11.972123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029664699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.444071+0000","last_change":"2026-02-17T08:51:09.444071+0000","last_active":"2026-02-17T08:51:09.444071+0000","last_peered":"2026-02-17T08:51:09.444071+0000","last_clean":"2026-02-17T08:51:09.444071+0000","last_became_active":"2026-02-17T08:51:07.119044+0000","last_became_peered":"2026-02-17T08:51:07.119044+0000","last_unstale":"2026-02-17T08:51:09.444071+0000","last_undegraded":"2026-02-17T08:51:09.444071+0000","last_fullsized":"2026-02-17T08:51:09.444071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:29:24.115712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024562199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.444066+0000","last_change":"2026-02-17T08:51:09.444066+0000","last_active":"2026-02-17T08:51:09.444066+0000","last_peered":"2026-02-17T08:51:09.444066+0000","last_clean":"2026-02-17T08:51:09.444066+0000","last_became_active":"2026-02-17T08:51:07.118566+0000","last_became_peered":"2026-02-17T08:51:07.118566+0000","last_unstale":"2026-02-17T08:51:09.444066+0000","last_undegraded":"2026-02-17T08:51:09.444066+0000","last_fullsized":"2026-02-17T08:51:09.444066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:40:53.761263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000215687,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121931+0000","last_change":"2026-02-17T08:51:09.121931+0000","last_active":"2026-02-17T08:51:09.121931+0000","last_peered":"2026-02-17T08:51:09.121931+0000","last_clean":"2026-02-17T08:51:09.121931+0000","last_became_active":"2026-02-17T08:51:07.117980+0000","last_became_peered":"2026-02-17T08:51:07.117980+0000","last_unstale":"2026-02-17T08:51:09.121931+0000","last_undegraded":"2026-02-17T08:51:09.121931+0000","last_fullsized":"2026-02-17T08:51:09.121931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:59:20.305434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000707513,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'72","reported_seq":110,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121237+0000","last_change":"2026-02-17T08:51:03.111871+0000","last_active":"2026-02-17T08:51:09.121237+0000","last_peered":"2026-02-17T08:51:09.121237+0000","last_clean":"2026-02-17T08:51:09.121237+0000","last_became_active":"2026-02-17T08:51:03.111470+0000","last_became_peered":"2026-02-17T08:51:03.111470+0000","last_unstale":"2026-02-17T08:51:09.121237+0000","last_undegraded":"2026-02-17T08:51:09.121237+0000","last_fullsized":"2026-02-17T08:51:09.121237+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:02.104607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:02.104607+0000","last_clean_scrub_stamp":"2026-02-17T08:51:02.104607+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:54:19.250202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31244,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340596,"statfs":{"total":96636764160,"available":96604770304,"internally_reserved":0,"allocated":122880,"data_stored":34665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":729088,"data_stored":628612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":729088,"data_stored":628612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:51:12.498 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:51:12.645 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:12.646 INFO:teuthology.orchestra.run.trial040.stderr:dumped all 2026-02-17T08:51:12.654 INFO:teuthology.orchestra.run.trial040.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-17T08:51:11.095385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90768,"kb_used_data":1544,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024752,"statfs":{"total":289910292480,"available":289817346048,"internally_reserved":0,"allocated":1581056,"data_stored":1291889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.983798"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121403+0000","last_change":"2026-02-17T08:51:09.121403+0000","last_active":"2026-02-17T08:51:09.121403+0000","last_peered":"2026-02-17T08:51:09.121403+0000","last_clean":"2026-02-17T08:51:09.121403+0000","last_became_active":"2026-02-17T08:51:07.118605+0000","last_became_peered":"2026-02-17T08:51:07.118605+0000","last_unstale":"2026-02-17T08:51:09.121403+0000","last_undegraded":"2026-02-17T08:51:09.121403+0000","last_fullsized":"2026-02-17T08:51:09.121403+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:00:25.446127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000263465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121548+0000","last_change":"2026-02-17T08:51:09.121548+0000","last_active":"2026-02-17T08:51:09.121548+0000","last_peered":"2026-02-17T08:51:09.121548+0000","last_clean":"2026-02-17T08:51:09.121548+0000","last_became_active":"2026-02-17T08:51:07.118607+0000","last_became_peered":"2026-02-17T08:51:07.118607+0000","last_unstale":"2026-02-17T08:51:09.121548+0000","last_undegraded":"2026-02-17T08:51:09.121548+0000","last_fullsized":"2026-02-17T08:51:09.121548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:28:06.647419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038716299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121748+0000","last_change":"2026-02-17T08:51:09.121748+0000","last_active":"2026-02-17T08:51:09.121748+0000","last_peered":"2026-02-17T08:51:09.121748+0000","last_clean":"2026-02-17T08:51:09.121748+0000","last_became_active":"2026-02-17T08:51:07.118474+0000","last_became_peered":"2026-02-17T08:51:07.118474+0000","last_unstale":"2026-02-17T08:51:09.121748+0000","last_undegraded":"2026-02-17T08:51:09.121748+0000","last_fullsized":"2026-02-17T08:51:09.121748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:21:06.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056687299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121814+0000","last_change":"2026-02-17T08:51:09.121814+0000","last_active":"2026-02-17T08:51:09.121814+0000","last_peered":"2026-02-17T08:51:09.121814+0000","last_clean":"2026-02-17T08:51:09.121814+0000","last_became_active":"2026-02-17T08:51:07.118372+0000","last_became_peered":"2026-02-17T08:51:07.118372+0000","last_unstale":"2026-02-17T08:51:09.121814+0000","last_undegraded":"2026-02-17T08:51:09.121814+0000","last_fullsized":"2026-02-17T08:51:09.121814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:26:12.151171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060597500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.120839+0000","last_change":"2026-02-17T08:51:09.119812+0000","last_active":"2026-02-17T08:51:09.120839+0000","last_peered":"2026-02-17T08:51:09.120839+0000","last_clean":"2026-02-17T08:51:09.120839+0000","last_became_active":"2026-02-17T08:51:07.119342+0000","last_became_peered":"2026-02-17T08:51:07.119342+0000","last_unstale":"2026-02-17T08:51:09.120839+0000","last_undegraded":"2026-02-17T08:51:09.120839+0000","last_fullsized":"2026-02-17T08:51:09.120839+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:40:11.972123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029664699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.444071+0000","last_change":"2026-02-17T08:51:09.444071+0000","last_active":"2026-02-17T08:51:09.444071+0000","last_peered":"2026-02-17T08:51:09.444071+0000","last_clean":"2026-02-17T08:51:09.444071+0000","last_became_active":"2026-02-17T08:51:07.119044+0000","last_became_peered":"2026-02-17T08:51:07.119044+0000","last_unstale":"2026-02-17T08:51:09.444071+0000","last_undegraded":"2026-02-17T08:51:09.444071+0000","last_fullsized":"2026-02-17T08:51:09.444071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:29:24.115712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024562199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.444066+0000","last_change":"2026-02-17T08:51:09.444066+0000","last_active":"2026-02-17T08:51:09.444066+0000","last_peered":"2026-02-17T08:51:09.444066+0000","last_clean":"2026-02-17T08:51:09.444066+0000","last_became_active":"2026-02-17T08:51:07.118566+0000","last_became_peered":"2026-02-17T08:51:07.118566+0000","last_unstale":"2026-02-17T08:51:09.444066+0000","last_undegraded":"2026-02-17T08:51:09.444066+0000","last_fullsized":"2026-02-17T08:51:09.444066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:40:53.761263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000215687,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121931+0000","last_change":"2026-02-17T08:51:09.121931+0000","last_active":"2026-02-17T08:51:09.121931+0000","last_peered":"2026-02-17T08:51:09.121931+0000","last_clean":"2026-02-17T08:51:09.121931+0000","last_became_active":"2026-02-17T08:51:07.117980+0000","last_became_peered":"2026-02-17T08:51:07.117980+0000","last_unstale":"2026-02-17T08:51:09.121931+0000","last_undegraded":"2026-02-17T08:51:09.121931+0000","last_fullsized":"2026-02-17T08:51:09.121931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:06.110621+0000","last_clean_scrub_stamp":"2026-02-17T08:51:06.110621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:59:20.305434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000707513,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'72","reported_seq":110,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-17T08:51:09.121237+0000","last_change":"2026-02-17T08:51:03.111871+0000","last_active":"2026-02-17T08:51:09.121237+0000","last_peered":"2026-02-17T08:51:09.121237+0000","last_clean":"2026-02-17T08:51:09.121237+0000","last_became_active":"2026-02-17T08:51:03.111470+0000","last_became_peered":"2026-02-17T08:51:03.111470+0000","last_unstale":"2026-02-17T08:51:09.121237+0000","last_undegraded":"2026-02-17T08:51:09.121237+0000","last_fullsized":"2026-02-17T08:51:09.121237+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:51:02.104607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:51:02.104607+0000","last_clean_scrub_stamp":"2026-02-17T08:51:02.104607+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:54:19.250202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31244,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340596,"statfs":{"total":96636764160,"available":96604770304,"internally_reserved":0,"allocated":122880,"data_stored":34665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":729088,"data_stored":628612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":729088,"data_stored":628612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:51:12.656 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T08:51:12.656 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T08:51:12.657 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T08:51:12.657 DEBUG:teuthology.orchestra.run.trial040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T08:51:12.814 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:12.814 INFO:teuthology.orchestra.run.trial040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T08:51:12.826 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T08:51:12.827 INFO:teuthology.run_tasks:Running task ssh_keys... 2026-02-17T08:51:12.984 DEBUG:teuthology.orchestra.run.trial040:> echo 'StrictHostKeyChecking no 2026-02-17T08:51:12.985 DEBUG:teuthology.orchestra.run.trial040:> ' > /home/ubuntu/.ssh/config && echo 'UserKnownHostsFile ' /dev/null >> /home/ubuntu/.ssh/config && chmod 600 /home/ubuntu/.ssh/config 2026-02-17T08:51:12.989 INFO:teuthology.task.ssh_keys:generated public key AAAAB3NzaC1yc2EAAAADAQABAAABAQDH1CvtIzNLzF6DtcjRHNnGisXA9srVcjKO8SOHV+2KfAAymNXZK9Q2T4dVFzr7uSSUihQzWIGDTiDsouA25NAoenPwI3MqK4Ar52l7CCy8+9hrDBXZQwCtpZ2K+OY/tZWAdz6rXFHzTvq7xCwFywYIvXcFKW5WMl3gK+UbcAzZjNh+zbQbZeuUeB0cSS1hgNMzCGZsSDpGO6rBeZrTRkYlyouafCsQLM6arUAto+JReEqQDQL0zDlIj+m6X1S03kmpPXluLjEJ0D+VMzg6qWr80gfwiAI9ljEIYvh5LJglqsBez7odcyrmhOqlZKYbXhqQ/+UWp+gqNGvNUoiFxUKN 2026-02-17T08:51:12.989 INFO:teuthology.task.ssh_keys:pushing keys to trial040.front.sepia.ceph.com for ubuntu 2026-02-17T08:51:12.989 DEBUG:teuthology.orchestra.run.trial040:> rm -f -- /home/ubuntu/.ssh/id_rsa 2026-02-17T08:51:13.036 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:51:13.036 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/.ssh/id_rsa 2026-02-17T08:51:13.036 DEBUG:teuthology.orchestra.run.trial040:> chmod 0500 /home/ubuntu/.ssh/id_rsa 2026-02-17T08:51:13.082 DEBUG:teuthology.orchestra.run.trial040:> rm -f -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-17T08:51:13.129 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:51:13.129 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/.ssh/id_rsa.pub 2026-02-17T08:51:13.174 DEBUG:teuthology.orchestra.run.trial040:> cp -v -a /home/ubuntu/.ssh/authorized_keys /home/ubuntu/.ssh/authorized_keys_2026-02-17_08:51:13:174370 2026-02-17T08:51:13.221 INFO:teuthology.orchestra.run.trial040.stdout:'/home/ubuntu/.ssh/authorized_keys' -> '/home/ubuntu/.ssh/authorized_keys_2026-02-17_08:51:13:174370' 2026-02-17T08:51:13.222 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:51:13.222 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/.ssh/authorized_keys conv=notrunc oflag=append 2026-02-17T08:51:13.269 INFO:teuthology.run_tasks:Running task cbt... 2026-02-17T08:51:13.298 INFO:tasks.cbt:cbt configuration is {'cluster': {'user': 'ubuntu', 'head': 'ubuntu@trial040.front.sepia.ceph.com', 'osds': ['ubuntu@trial040.front.sepia.ceph.com'], 'mons': ['ubuntu@trial040.front.sepia.ceph.com'], 'clients': ['ubuntu@trial040.front.sepia.ceph.com'], 'rgws': {'ubuntu@trial040.front.sepia.ceph.com': None}, 'osds_per_node': 3, 'rebuild_every_test': False, 'use_existing': True, 'is_teuthology': True, 'iterations': 1, 'tmp_dir': '/tmp/cbt', 'pool_profiles': {'replicated': {'pg_size': 256, 'pgp_size': 256, 'replication': 'replicated'}}, 'pid_dir': '/var/run/ceph'}, 'benchmarks': {'radosbench': {'concurrent_ops': 4, 'concurrent_procs': 2, 'op_size': [4096], 'pool_monitoring_list': ['collectl'], 'pool_profile': 'replicated', 'run_monitoring_list': ['collectl'], 'time': 60, 'write_only': True}}, 'client_endpoints': None, 'monitoring_profiles': {'perf': {'args': 'stat -p {pid} -o {perf_dir}/perf_stat.{pid}', 'nodes': ['osds'], 'perf_cmd': 'perf', 'pid_glob': 'ceph-osd.*.pid'}}} 2026-02-17T08:51:13.298 DEBUG:teuthology.orchestra.run.trial040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/cbt 2026-02-17T08:51:13.321 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:51:13.321 DEBUG:teuthology.orchestra.run.trial040:> dd of=/home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-17T08:51:13.365 DEBUG:teuthology.orchestra.run.trial040:> git clone --depth 1 -b master https://github.com/ceph/cbt.git /home/ubuntu/cephtest/cbt 2026-02-17T08:51:13.418 INFO:teuthology.orchestra.run.trial040.stderr:Cloning into '/home/ubuntu/cephtest/cbt'... 2026-02-17T08:51:13.696 DEBUG:teuthology.orchestra.run.trial040:> sudo apt-get -y --force-yes install python3-yaml python3-lxml librbd-dev collectl linux-tools-generic 2026-02-17T08:51:13.769 INFO:teuthology.orchestra.run.trial040.stdout:Reading package lists... 2026-02-17T08:51:13.875 INFO:teuthology.orchestra.run.trial040.stdout:Building dependency tree... 2026-02-17T08:51:13.876 INFO:teuthology.orchestra.run.trial040.stdout:Reading state information... 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout:python3-lxml is already the newest version (4.8.0-1build1). 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout:python3-lxml set to manually installed. 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout:python3-yaml is already the newest version (5.4.1-1ubuntu1). 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout:python3-yaml set to manually installed. 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout:collectl is already the newest version (4.3.1-1). 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:51:13.964 INFO:teuthology.orchestra.run.trial040.stdout: sg3-utils-udev 2026-02-17T08:51:13.965 INFO:teuthology.orchestra.run.trial040.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:51:13.965 INFO:teuthology.orchestra.run.trial040.stdout:The following additional packages will be installed: 2026-02-17T08:51:13.965 INFO:teuthology.orchestra.run.trial040.stdout: hwdata librados-dev linux-tools-5.15.0-170 linux-tools-5.15.0-170-generic 2026-02-17T08:51:13.965 INFO:teuthology.orchestra.run.trial040.stdout: linux-tools-common 2026-02-17T08:51:13.976 INFO:teuthology.orchestra.run.trial040.stdout:The following NEW packages will be installed: 2026-02-17T08:51:13.976 INFO:teuthology.orchestra.run.trial040.stdout: hwdata librados-dev librbd-dev linux-tools-5.15.0-170 2026-02-17T08:51:13.976 INFO:teuthology.orchestra.run.trial040.stdout: linux-tools-5.15.0-170-generic linux-tools-common linux-tools-generic 2026-02-17T08:51:14.059 INFO:teuthology.orchestra.run.trial040.stdout:0 upgraded, 7 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:51:14.059 INFO:teuthology.orchestra.run.trial040.stdout:Need to get 8570 kB of archives. 2026-02-17T08:51:14.060 INFO:teuthology.orchestra.run.trial040.stdout:After this operation, 30.7 MB of additional disk space will be used. 2026-02-17T08:51:14.060 INFO:teuthology.orchestra.run.trial040.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librados-dev amd64 19.2.3-705-g04cf6dd4-1jammy [270 kB] 2026-02-17T08:51:14.104 INFO:teuthology.orchestra.run.trial040.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librbd-dev amd64 19.2.3-705-g04cf6dd4-1jammy [30.7 kB] 2026-02-17T08:51:14.338 INFO:teuthology.orchestra.run.trial040.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/main amd64 hwdata all 0.357-1 [26.6 kB] 2026-02-17T08:51:14.501 INFO:teuthology.orchestra.run.trial040.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-tools-common all 5.15.0-170.180 [295 kB] 2026-02-17T08:51:14.730 INFO:teuthology.orchestra.run.trial040.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-tools-5.15.0-170 amd64 5.15.0-170.180 [7944 kB] 2026-02-17T08:51:15.091 INFO:teuthology.orchestra.run.trial040.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-tools-5.15.0-170-generic amd64 5.15.0-170.180 [1788 B] 2026-02-17T08:51:15.091 INFO:teuthology.orchestra.run.trial040.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-tools-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T08:51:15.227 INFO:teuthology.orchestra.run.trial040.stderr:debconf: unable to initialize frontend: Dialog 2026-02-17T08:51:15.227 INFO:teuthology.orchestra.run.trial040.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2026-02-17T08:51:15.227 INFO:teuthology.orchestra.run.trial040.stderr:debconf: falling back to frontend: Readline 2026-02-17T08:51:15.232 INFO:teuthology.orchestra.run.trial040.stderr:debconf: unable to initialize frontend: Readline 2026-02-17T08:51:15.232 INFO:teuthology.orchestra.run.trial040.stderr:debconf: (This frontend requires a controlling tty.) 2026-02-17T08:51:15.232 INFO:teuthology.orchestra.run.trial040.stderr:debconf: falling back to frontend: Teletype 2026-02-17T08:51:15.236 INFO:teuthology.orchestra.run.trial040.stderr:dpkg-preconfigure: unable to re-open stdin: 2026-02-17T08:51:15.257 INFO:teuthology.orchestra.run.trial040.stdout:Fetched 8570 kB in 1s (7704 kB/s) 2026-02-17T08:51:15.275 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package hwdata. 2026-02-17T08:51:15.309 INFO:teuthology.orchestra.run.trial040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174280 files and directories currently installed.) 2026-02-17T08:51:15.311 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../0-hwdata_0.357-1_all.deb ... 2026-02-17T08:51:15.312 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking hwdata (0.357-1) ... 2026-02-17T08:51:15.326 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librados-dev. 2026-02-17T08:51:15.334 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../1-librados-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:51:15.334 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librados-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:51:15.352 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package librbd-dev. 2026-02-17T08:51:15.360 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../2-librbd-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:51:15.361 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking librbd-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:51:15.376 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-tools-common. 2026-02-17T08:51:15.384 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../3-linux-tools-common_5.15.0-170.180_all.deb ... 2026-02-17T08:51:15.385 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-tools-common (5.15.0-170.180) ... 2026-02-17T08:51:15.405 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-tools-5.15.0-170. 2026-02-17T08:51:15.413 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../4-linux-tools-5.15.0-170_5.15.0-170.180_amd64.deb ... 2026-02-17T08:51:15.413 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-tools-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:51:15.508 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-tools-5.15.0-170-generic. 2026-02-17T08:51:15.517 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../5-linux-tools-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:51:15.517 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-tools-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:15.530 INFO:teuthology.orchestra.run.trial040.stdout:Selecting previously unselected package linux-tools-generic. 2026-02-17T08:51:15.538 INFO:teuthology.orchestra.run.trial040.stdout:Preparing to unpack .../6-linux-tools-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:51:15.539 INFO:teuthology.orchestra.run.trial040.stdout:Unpacking linux-tools-generic (5.15.0.170.159) ... 2026-02-17T08:51:15.567 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librados-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:51:15.568 INFO:teuthology.orchestra.run.trial040.stdout:Setting up hwdata (0.357-1) ... 2026-02-17T08:51:15.568 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-tools-common (5.15.0-170.180) ... 2026-02-17T08:51:15.569 INFO:teuthology.orchestra.run.trial040.stdout:Setting up librbd-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:51:15.570 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-tools-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:51:15.571 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-tools-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:15.572 INFO:teuthology.orchestra.run.trial040.stdout:Setting up linux-tools-generic (5.15.0.170.159) ... 2026-02-17T08:51:15.573 INFO:teuthology.orchestra.run.trial040.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T08:51:16.178 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:16.178 INFO:teuthology.orchestra.run.trial040.stdout:Running kernel seems to be up-to-date. 2026-02-17T08:51:16.178 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:16.178 INFO:teuthology.orchestra.run.trial040.stdout:The processor microcode seems to be up-to-date. 2026-02-17T08:51:16.178 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:16.179 INFO:teuthology.orchestra.run.trial040.stdout:No services need to be restarted. 2026-02-17T08:51:16.179 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:16.179 INFO:teuthology.orchestra.run.trial040.stdout:No containers need to be restarted. 2026-02-17T08:51:16.179 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:16.179 INFO:teuthology.orchestra.run.trial040.stdout:No user sessions are running outdated binaries. 2026-02-17T08:51:16.179 INFO:teuthology.orchestra.run.trial040.stdout: 2026-02-17T08:51:16.179 INFO:teuthology.orchestra.run.trial040.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T08:51:16.853 INFO:teuthology.orchestra.run.trial040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T08:51:16.856 INFO:tasks.cbt:benchmark: radosbench 2026-02-17T08:51:16.856 DEBUG:teuthology.orchestra.run.trial040:> sudo /sbin/sysctl -q -w kernel.perf_event_paranoid=0 2026-02-17T08:51:16.905 DEBUG:teuthology.orchestra.run.trial040:> /home/ubuntu/cephtest/cbt/cbt.py -a /home/ubuntu/cephtest/archive/cbt /home/ubuntu/cephtest/archive/cbt/cbt_config.yaml 2026-02-17T08:51:17.019 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - DEBUG - cbt - Settings.cluster: 2026-02-17T08:51:17.019 INFO:teuthology.orchestra.run.trial040.stderr: {'archive_dir': '/home/ubuntu/cephtest/archive/cbt', 2026-02-17T08:51:17.019 INFO:teuthology.orchestra.run.trial040.stderr: 'clients': ['ubuntu@trial040.front.sepia.ceph.com'], 2026-02-17T08:51:17.019 INFO:teuthology.orchestra.run.trial040.stderr: 'conf_file': '/etc/ceph/ceph.conf', 2026-02-17T08:51:17.019 INFO:teuthology.orchestra.run.trial040.stderr: 'head': 'ubuntu@trial040.front.sepia.ceph.com', 2026-02-17T08:51:17.019 INFO:teuthology.orchestra.run.trial040.stderr: 'is_teuthology': True, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'iterations': 1, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'mons': ['ubuntu@trial040.front.sepia.ceph.com'], 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'osds': ['ubuntu@trial040.front.sepia.ceph.com'], 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'osds_per_node': 3, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'pid_dir': '/var/run/ceph', 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'pool_profiles': {'replicated': {'pg_size': 256, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'pgp_size': 256, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'replication': 'replicated'}}, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'rebuild_every_test': False, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'rgws': {'ubuntu@trial040.front.sepia.ceph.com': None}, 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'tmp_dir': '/tmp/cbt', 2026-02-17T08:51:17.020 INFO:teuthology.orchestra.run.trial040.stderr: 'use_existing': True, 2026-02-17T08:51:17.021 INFO:teuthology.orchestra.run.trial040.stderr: 'user': 'ubuntu'} 2026-02-17T08:51:17.021 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb 2026-02-17T08:51:17.021 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - INFO - cbt - Pausing for 60s for idle monitoring. 2026-02-17T08:51:17.021 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/idle_monitoring/collectl 2026-02-17T08:51:17.561 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/idle_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-17T08:51:17.563 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/idle_monitoring/perf 2026-02-17T08:51:17.738 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-17T08:51:17.738 INFO:teuthology.orchestra.run.trial040.stderr:08:51:17 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com for pid in `cat /var/run/ceph/ceph-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/idle_monitoring/perf/perf_stat.${pid} & done 2026-02-17T08:52:17.801 INFO:teuthology.orchestra.run.trial040.stderr:08:52:17 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-17T08:52:18.408 INFO:teuthology.orchestra.run.trial040.stderr:08:52:18 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-17T08:52:18.643 INFO:teuthology.orchestra.run.trial040.stderr:08:52:18 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/idle_monitoring/perf/perf.data 2026-02-17T08:52:18.645 INFO:teuthology.orchestra.run.trial040.stderr:08:52:18 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/idle_monitoring/perf/perf_stat.* 2026-02-17T08:52:18.648 INFO:teuthology.orchestra.run.trial040.stderr:08:52:18 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/* 2026-02-17T08:52:18.831 INFO:teuthology.orchestra.run.trial040.stderr:08:52:18 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial040.front.sepia.ceph.com -r /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb 2026-02-17T08:52:19.012 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo killall -9 rados 2026-02-17T08:52:19.222 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - INFO - cbt - Results dir: /home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb 2026-02-17T08:52:19.222 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - INFO - cbt - Skipping existing test in /home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb. 2026-02-17T08:52:19.222 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - INFO - cbt - Running benchmark /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004 2026-02-17T08:52:19.222 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb 2026-02-17T08:52:19.222 INFO:teuthology.orchestra.run.trial040.stderr:{'concurrent_ops': 4, 'concurrent_procs': 2, 'pool_profile': 'replicated', 'time': 60, 'write_only': True, 'op_size': 4096, 'pool_monitoring_list': 'collectl', 'run_monitoring_list': 'collectl', 'benchmark': 'radosbench', 'iteration': 0} == iteration 0 == 2026-02-17T08:52:19.223 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - INFO - cbt - Setting OSD Read Ahead to: 0 2026-02-17T08:52:19.223 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com find /dev/disk/by-partlabel/osd-device-*data -exec readlink {} \; | cut -d"/" -f 3 | sed "s/[0-9]$//" | xargs -I{} sudo sh -c "echo 0 > /sys/block/'{}'/queue/read_ahead_kb" 2026-02-17T08:52:19.224 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - Cleaning existing temporary run directory: /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004 2026-02-17T08:52:19.225 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo rm -rf /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004 2026-02-17T08:52:19.408 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/pool_monitoring/collectl 2026-02-17T08:52:19.583 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/pool_monitoring/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-17T08:52:19.585 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/pool_monitoring/perf 2026-02-17T08:52:19.763 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-17T08:52:19.763 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com for pid in `cat /var/run/ceph/ceph-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/pool_monitoring/perf/perf_stat.${pid} & done 2026-02-17T08:52:19.765 INFO:teuthology.orchestra.run.trial040.stderr:08:52:19 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool delete rados-bench-cbt rados-bench-cbt --yes-i-really-really-mean-it 2026-02-17T08:52:20.082 INFO:teuthology.orchestra.run.trial040.stderr:08:52:20 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool create rados-bench-cbt 256 256 2026-02-17T08:52:20.935 INFO:teuthology.orchestra.run.trial040.stderr:08:52:20 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf osd pool application enable rados-bench-cbt radosbench 2026-02-17T08:52:21.943 INFO:teuthology.orchestra.run.trial040.stderr:08:52:21 - INFO - cbt - Checking Health after pool creation. 2026-02-17T08:52:26.949 INFO:teuthology.orchestra.run.trial040.stderr:08:52:26 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-17T08:52:27.275 INFO:teuthology.orchestra.run.trial040.stderr:08:52:27 - INFO - cbt - Final Pool Health Check. 2026-02-17T08:52:32.281 INFO:teuthology.orchestra.run.trial040.stderr:08:52:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com /usr/bin/ceph -c /etc/ceph/ceph.conf health 2026-02-17T08:52:32.607 INFO:teuthology.orchestra.run.trial040.stderr:08:52:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-17T08:52:32.837 INFO:teuthology.orchestra.run.trial040.stderr:08:52:32 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-17T08:52:33.074 INFO:teuthology.orchestra.run.trial040.stderr:08:52:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/pool_monitoring/perf/perf.data 2026-02-17T08:52:33.075 INFO:teuthology.orchestra.run.trial040.stderr:08:52:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/pool_monitoring/perf/perf_stat.* 2026-02-17T08:52:33.077 INFO:teuthology.orchestra.run.trial040.stderr:08:52:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sync 2026-02-17T08:52:33.258 INFO:teuthology.orchestra.run.trial040.stderr:08:52:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com echo 3 | sudo tee /proc/sys/vm/drop_caches 2026-02-17T08:52:33.760 INFO:teuthology.orchestra.run.trial040.stderr:08:52:33 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com /usr/bin/rados -c /etc/ceph/ceph.conf -v 2026-02-17T08:52:33.993 INFO:teuthology.orchestra.run.trial040.stderr:08:52:33 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write 2026-02-17T08:52:34.168 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo /usr/bin/ceph -c /etc/ceph/ceph.conf daemon osd.0 config show > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/ceph_settings.out 2026-02-17T08:52:34.462 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/collectl 2026-02-17T08:52:34.635 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com collectl -s+mYZ -i 1:10 -F0 -f /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/collectl --rawdskfilt \"+cciss/c\d+d\d+ |hd[ab] | sd[a-z]+ |dm-\d+ |xvd[a-z] |fio[a-z]+ | vd[a-z]+ |emcpower[a-z]+ |psv\d+ |nvme[0-9]n[0-9]+p[0-9]+ \" 2026-02-17T08:52:34.636 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com mkdir -p -m0755 -- /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/perf 2026-02-17T08:52:34.811 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - PerfMonitoring: remote_node 2026-02-17T08:52:34.811 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com for pid in `cat /var/run/ceph/ceph-osd.*.pid`; do perf stat -p ${pid} -o /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/perf/perf_stat.${pid} & done 2026-02-17T08:52:34.812 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - INFO - cbt - Running radosbench write test. 2026-02-17T08:52:34.813 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com /usr/bin/rados -c /etc/ceph/ceph.conf -p rados-bench-cbt bench -b 4096 60 write --concurrent-ios 4 --run-name `hostname -f`-0 --no-cleanup 2> /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/objecter.0.log > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/output.0 2026-02-17T08:52:34.815 INFO:teuthology.orchestra.run.trial040.stderr:08:52:34 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com /usr/bin/rados -c /etc/ceph/ceph.conf -p rados-bench-cbt bench -b 4096 60 write --concurrent-ios 4 --run-name `hostname -f`-1 --no-cleanup 2> /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/objecter.1.log > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/output.1 2026-02-17T08:53:35.025 INFO:teuthology.orchestra.run.trial040.stderr:08:53:35 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com pkill -SIGINT -f collectl 2026-02-17T08:53:35.663 INFO:teuthology.orchestra.run.trial040.stderr:08:53:35 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo pkill -SIGINT -f perf\ 2026-02-17T08:53:35.904 INFO:teuthology.orchestra.run.trial040.stderr:08:53:35 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/perf/perf.data 2026-02-17T08:53:35.906 INFO:teuthology.orchestra.run.trial040.stderr:08:53:35 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/perf/perf_stat.* 2026-02-17T08:53:35.909 INFO:teuthology.orchestra.run.trial040.stderr:08:53:35 - DEBUG - cbt - CheckedPopen continue_if_error=True, shell=False args=pdsh -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com find /var/run/ceph/ceph-osd*.asok -maxdepth 1 -exec sudo /usr/bin/ceph --admin-daemon {} dump_historic_ops \; > /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/historic_ops.out 2026-02-17T08:53:36.278 INFO:teuthology.orchestra.run.trial040.stderr:08:53:36 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 1 -R ssh -w ubuntu@trial040.front.sepia.ceph.com sudo chown -R ubuntu.ubuntu /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/* 2026-02-17T08:53:36.452 INFO:teuthology.orchestra.run.trial040.stderr:08:53:36 - DEBUG - cbt - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w ubuntu@trial040.front.sepia.ceph.com -r /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-00004096/concurrent_ops-00000004/write/* /home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write 2026-02-17T08:53:36.632 INFO:teuthology.orchestra.run.trial040.stderr:08:53:36 - INFO - cbt - Convert results to json format. 2026-02-17T08:53:36.648 DEBUG:teuthology.run_tasks:Unwinding manager cbt 2026-02-17T08:53:36.663 DEBUG:teuthology.orchestra.run.trial040:> rm --one-file-system -rf -- /home/ubuntu/cephtest/cbt 2026-02-17T08:53:36.676 INFO:tasks.cbt_performance:Collecting CBT performance data config 2026-02-17T08:53:36.677 INFO:tasks.cbt_performance:reading cbt preferences 2026-02-17T08:53:36.677 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest -name 'json_output.*' 2026-02-17T08:53:36.723 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/json_output.0.trial040.front.sepia.ceph.com 2026-02-17T08:53:36.724 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/json_output.1.trial040.front.sepia.ceph.com 2026-02-17T08:53:36.724 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:36.725 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/json_output.0.trial040.front.sepia.ceph.com of=/dev/stdout 2026-02-17T08:53:36.771 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-17T08:53:36.772 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write -name 'perf_stat.*' 2026-02-17T08:53:36.819 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15619 2026-02-17T08:53:36.819 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15617 2026-02-17T08:53:36.819 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15618 2026-02-17T08:53:36.819 INFO:tasks.cbt_performance:cpu_cycles_paths: ['/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15619', '/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15617', '/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15618', ''] 2026-02-17T08:53:36.819 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:36.820 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15619 of=/dev/stdout 2026-02-17T08:53:36.868 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:36.868 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15617 of=/dev/stdout 2026-02-17T08:53:36.916 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:36.917 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15618 of=/dev/stdout 2026-02-17T08:53:36.963 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-17T08:53:36.964 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:36.964 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/json_output.1.trial040.front.sepia.ceph.com of=/dev/stdout 2026-02-17T08:53:37.014 INFO:tasks.cbt_performance:reading total cpu cycles 2026-02-17T08:53:37.015 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write -name 'perf_stat.*' 2026-02-17T08:53:37.062 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15619 2026-02-17T08:53:37.063 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15617 2026-02-17T08:53:37.063 INFO:teuthology.orchestra.run.trial040.stdout:/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15618 2026-02-17T08:53:37.063 INFO:tasks.cbt_performance:cpu_cycles_paths: ['/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15619', '/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15617', '/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15618', ''] 2026-02-17T08:53:37.063 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:37.063 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15619 of=/dev/stdout 2026-02-17T08:53:37.111 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:37.111 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15617 of=/dev/stdout 2026-02-17T08:53:37.159 DEBUG:teuthology.orchestra.run.trial040:> set -ex 2026-02-17T08:53:37.159 DEBUG:teuthology.orchestra.run.trial040:> dd if=/home/ubuntu/cephtest/archive/cbt/results/00000000/id-8b8185cb/write/perf.trial040.front.sepia.ceph.com/perf_stat.15618 of=/dev/stdout 2026-02-17T08:53:37.207 INFO:tasks.cbt_performance:total cpu cycles: 0 2026-02-17T08:53:37.213 WARNING:tasks.cbt_performance:Could not send performance data to http://mira118.front.sepia.ceph.com:4000/cbt_performance: HTTPConnectionPool(host='mira118.front.sepia.ceph.com', port=4000): Max retries exceeded with url: /cbt_performance (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name or service not known')) 2026-02-17T08:53:37.213 WARNING:tasks.cbt_performance:Continuing without performance data collection 2026-02-17T08:53:37.214 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys 2026-02-17T08:53:37.234 INFO:teuthology.task.ssh_keys:Cleaning up SSH keys 2026-02-17T08:53:37.234 INFO:teuthology.task.ssh_keys:cleaning up keys added for testing 2026-02-17T08:53:37.234 INFO:teuthology.task.ssh_keys: cleaning up keys for user ubuntu on trial040.front.sepia.ceph.com 2026-02-17T08:53:37.234 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/.ssh/id_rsa 2026-02-17T08:53:37.255 DEBUG:teuthology.orchestra.run.trial040:> rm -- /home/ubuntu/.ssh/id_rsa.pub 2026-02-17T08:53:37.306 DEBUG:teuthology.orchestra.run.trial040:> stat -c '"%a"' /home/ubuntu/.ssh/authorized_keys 2026-02-17T08:53:37.350 INFO:teuthology.orchestra.run.trial040.stdout:"600" 2026-02-17T08:53:37.351 DEBUG:teuthology.orchestra.run.trial040:> mv -- /home/ubuntu/.ssh/authorized_keys_2026-02-17_08:51:13:174370 /home/ubuntu/.ssh/authorized_keys 2026-02-17T08:53:37.398 DEBUG:teuthology.orchestra.run.trial040:> chmod 600 /home/ubuntu/.ssh/authorized_keys 2026-02-17T08:53:37.446 DEBUG:teuthology.orchestra.run.trial040:> rm /home/ubuntu/.ssh/config 2026-02-17T08:53:37.494 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T08:53:37.520 DEBUG:teuthology.orchestra.run.trial040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T08:53:37.689 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T08:53:37.689 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T08:53:37.689 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T08:53:37.690 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:53:43.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-17T08:53:43.791 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T08:53:43.791 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T08:53:43.791 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:53:48.916 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-17T08:53:48.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-17T08:53:49.893 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T08:53:49.894 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T08:53:49.894 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:53:54.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T08:53:54.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-17T08:53:55.996 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T08:53:55.996 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T08:53:55.996 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T08:53:55.997 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:53:56.034 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T08:53:56.034 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T08:53:56.035 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T08:53:56.035 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:53:56.046 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T08:53:56.046 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T08:53:56.047 DEBUG:teuthology.orchestra.run.trial040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(PG_' | egrep -v '\(OSD_' | egrep -v '\(OBJECT_' | egrep -v 'overall HEALTH' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-17T08:53:56.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:53:56.105 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T08:53:56.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:53:56.350 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T08:53:56.384 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:53:56.384 DEBUG:teuthology.orchestra.run.trial040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T08:53:56.465 INFO:tasks.ceph:Archiving mon data... 2026-02-17T08:53:56.467 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51191/data/mon.a.tgz 2026-02-17T08:53:56.467 DEBUG:teuthology.orchestra.run.trial040:> mktemp 2026-02-17T08:53:56.513 INFO:teuthology.orchestra.run.trial040.stdout:/tmp/tmp.SUg5tSxqla 2026-02-17T08:53:56.513 DEBUG:teuthology.orchestra.run.trial040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SUg5tSxqla 2026-02-17T08:53:56.589 DEBUG:teuthology.orchestra.run.trial040:> sudo chmod 0666 /tmp/tmp.SUg5tSxqla 2026-02-17T08:53:56.691 DEBUG:teuthology.orchestra.remote:trial040:/tmp/tmp.SUg5tSxqla is 197KB 2026-02-17T08:53:56.702 DEBUG:teuthology.orchestra.run.trial040:> rm -fr /tmp/tmp.SUg5tSxqla 2026-02-17T08:53:56.705 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T08:53:56.705 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T08:53:56.809 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T08:53:56.809 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T08:53:56.812 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51191/remote/trial040/crash 2026-02-17T08:53:56.813 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T08:53:56.862 INFO:tasks.ceph:Compressing logs... 2026-02-17T08:53:56.862 DEBUG:teuthology.orchestra.run.trial040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:53:56.913 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23597.log 2026-02-17T08:53:56.917 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21846.log 2026-02-17T08:53:56.917 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22288.log 2026-02-17T08:53:56.917 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23597.log: /var/log/ceph/ceph-client.admin.21846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21846.log.gz 2026-02-17T08:53:56.917 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23597.log.gz 2026-02-17T08:53:56.917 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15557.log 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21801.log 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22288.log: /var/log/ceph/ceph-client.admin.15557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22288.log.gz 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15557.log.gz 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21931.log 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22009.log 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21801.log.gz 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22080.log 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21931.log.gz 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22009.log.gz 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22187.log 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22008.log 2026-02-17T08:53:56.918 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22080.log.gz 2026-02-17T08:53:56.919 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21872.log 2026-02-17T08:53:56.919 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22187.log.gz 2026-02-17T08:53:56.919 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22008.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T08:53:56.919 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22008.log.gz 2026-02-17T08:53:56.919 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21872.log.gz 2026-02-17T08:53:56.919 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22010.log 2026-02-17T08:53:56.930 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23773.log 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.22010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21932.log 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22010.log.gz 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22236.log 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23773.log.gz 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21932.log: /var/log/ceph/ceph-client.admin.22236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21932.log.gz 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15687.log 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22236.log.gz 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21930.log 2026-02-17T08:53:56.931 INFO:teuthology.orchestra.run.trial040.stderr:gzip/var/log/ceph/ceph-client.admin.15687.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23848.log 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15687.log.gz 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21930.log.gz 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22158.log 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23848.log.gz 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15533.log 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22158.log.gz 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15581.log 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22088.log 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.15533.log: /var/log/ceph/ceph-client.admin.15581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15533.log.gz 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15581.log.gz 2026-02-17T08:53:56.932 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22087.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24786.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22088.log.gz 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22087.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22087.log.gz 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.24786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24786.log.gz 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11819.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15616.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph.tmp-client.admin.11819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23926.log 2026-02-17T08:53:56.933 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11819.log.gz 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15443.log 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.15616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15616.log.gz 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.23926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21776.log 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23926.log.gz 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.15443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15443.log.gz 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25281.log 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22162.log 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21776.log.gz 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.25281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25281.log.gz 2026-02-17T08:53:56.934 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22162.log.gz 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21633.log 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21898.log 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.21633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21633.log.gz 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21826.log 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21898.log.gz 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.21826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22262.log 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21826.log.gz 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24783.log 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.22262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23695.log 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22262.log.gz 2026-02-17T08:53:56.935 INFO:teuthology.orchestra.run.trial040.stderr:/var/log/ceph/ceph-client.admin.24783.log: /var/log/ceph/ceph-client.admin.23695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24783.log.gz 2026-02-17T08:53:56.936 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23695.log.gz 2026-02-17T08:53:59.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-17T08:54:10.946 INFO:teuthology.orchestra.run.trial040.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T08:54:11.436 INFO:teuthology.orchestra.run.trial040.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T08:54:12.450 INFO:teuthology.orchestra.run.trial040.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T08:54:12.451 INFO:teuthology.orchestra.run.trial040.stderr: 2026-02-17T08:54:12.451 INFO:teuthology.orchestra.run.trial040.stderr:real 0m15.545s 2026-02-17T08:54:12.451 INFO:teuthology.orchestra.run.trial040.stderr:user 0m42.045s 2026-02-17T08:54:12.451 INFO:teuthology.orchestra.run.trial040.stderr:sys 0m2.066s 2026-02-17T08:54:12.452 INFO:tasks.ceph:Archiving logs... 2026-02-17T08:54:12.452 DEBUG:teuthology.misc:Transferring archived files from trial040:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51191/remote/trial040/log 2026-02-17T08:54:12.453 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T08:54:15.896 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T08:54:15.911 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T08:54:15.911 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T08:54:15.982 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T08:54:15.994 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T08:54:15.994 DEBUG:teuthology.orchestra.run.trial040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:54:16.033 INFO:teuthology.orchestra.run.trial040.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T08:54:16.033 INFO:teuthology.orchestra.run.trial040.stdout:============================================================================== 2026-02-17T08:54:16.033 INFO:teuthology.orchestra.run.trial040.stdout: s2-a.time.mci1. 135.45.28.167 2 u 44 64 17 29.798 +3.744 2.584 2026-02-17T08:54:16.033 INFO:teuthology.orchestra.run.trial040.stdout: 172-238-164-57. 168.61.215.74 4 u 47 64 17 27.433 +7.448 2.892 2026-02-17T08:54:16.033 INFO:teuthology.orchestra.run.trial040.stdout:*us-east-2.clear 245.199.57.207 2 u 47 64 17 37.016 +5.581 2.852 2026-02-17T08:54:16.033 INFO:teuthology.orchestra.run.trial040.stdout: ntp.maxhost.io 132.163.97.4 2 u 46 64 7 69.717 +4.643 7.767 2026-02-17T08:54:16.034 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T08:54:16.045 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T08:54:16.045 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T08:54:16.059 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T08:54:16.073 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T08:54:16.087 INFO:teuthology.task.internal:Duration was 396.424085 seconds 2026-02-17T08:54:16.087 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T08:54:16.099 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T08:54:16.099 DEBUG:teuthology.orchestra.run.trial040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T08:54:16.129 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T08:54:16.130 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial040.front.sepia.ceph.com 2026-02-17T08:54:16.130 DEBUG:teuthology.orchestra.run.trial040:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T08:54:16.182 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T08:54:16.182 DEBUG:teuthology.orchestra.run.trial040:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:54:16.396 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T08:54:16.397 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:54:16.405 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:54:16.406 INFO:teuthology.orchestra.run.trial040.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:54:16.406 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:54:16.406 INFO:teuthology.orchestra.run.trial040.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T08:54:16.406 INFO:teuthology.orchestra.run.trial040.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T08:54:16.455 INFO:teuthology.orchestra.run.trial040.stderr: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T08:54:16.457 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T08:54:16.474 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T08:54:16.475 DEBUG:teuthology.orchestra.run.trial040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T08:54:16.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T08:54:16.526 DEBUG:teuthology.orchestra.run.trial040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:54:16.560 INFO:teuthology.orchestra.run.trial040.stdout:kernel.core_pattern = core 2026-02-17T08:54:16.568 DEBUG:teuthology.orchestra.run.trial040:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:54:16.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:54:16.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T08:54:16.633 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T08:54:16.635 DEBUG:teuthology.misc:Transferring archived files from trial040:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51191/remote/trial040 2026-02-17T08:54:16.635 DEBUG:teuthology.orchestra.run.trial040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T08:54:16.741 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T08:54:16.742 DEBUG:teuthology.orchestra.run.trial040:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T08:54:16.760 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T08:54:16.773 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T08:54:16.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T08:54:16.787 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T08:54:16.787 DEBUG:teuthology.orchestra.run.trial040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T08:54:16.807 INFO:teuthology.orchestra.run.trial040.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 08:54 /home/ubuntu/cephtest 2026-02-17T08:54:16.808 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T08:54:16.819 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T08:54:16.847 INFO:teuthology.run:Summary data: description: rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} duration: 396.4240846633911 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T08:54:16.847 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:54:16.945 INFO:teuthology.run:pass